[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:12.554802 16125 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.191.126:37165
I20260709 12:08:12.556520 16125 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:12.557677 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:12.577369 16134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:12.577714 16131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:12.579574 16125 server_base.cc:1061] running on GCE node
W20260709 12:08:12.577421 16132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:13.704834 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:13.705098 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:13.705324 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598893705290 us; error 0 us; skew 500 ppm
I20260709 12:08:13.706254 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:13.712571 16125 webserver.cc:533] Webserver started at http://127.15.191.126:34327/ using document root <none> and password file <none>
I20260709 12:08:13.713527 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:13.713763 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:13.714275 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:13.720374 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/master-0-root/instance:
uuid: "185b27f3b6414735b4f7a01579678bcb"
format_stamp: "Formatted at 2026-07-09 12:08:13 on dist-test-slave-1sdq"
I20260709 12:08:13.728785 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:08:13.734323 16140 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:13.735603 16125 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:08:13.735975 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/master-0-root
uuid: "185b27f3b6414735b4f7a01579678bcb"
format_stamp: "Formatted at 2026-07-09 12:08:13 on dist-test-slave-1sdq"
I20260709 12:08:13.736310 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:13.795782 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:13.797340 16125 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:13.797812 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:13.883636 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.126:37165
I20260709 12:08:13.883699 16191 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.126:37165 every 8 connection(s)
I20260709 12:08:13.892516 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:13.915079 16192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb: Bootstrap starting.
I20260709 12:08:13.922405 16192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:13.925379 16192 log.cc:826] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:13.931331 16192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb: No bootstrap required, opened a new log
I20260709 12:08:13.955523 16192 raft_consensus.cc:359] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185b27f3b6414735b4f7a01579678bcb" member_type: VOTER }
I20260709 12:08:13.956147 16192 raft_consensus.cc:385] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:13.956436 16192 raft_consensus.cc:740] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185b27f3b6414735b4f7a01579678bcb, State: Initialized, Role: FOLLOWER
I20260709 12:08:13.957475 16192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185b27f3b6414735b4f7a01579678bcb" member_type: VOTER }
I20260709 12:08:13.958031 16192 raft_consensus.cc:399] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:13.958400 16192 raft_consensus.cc:493] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:13.958791 16192 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:13.963366 16192 raft_consensus.cc:515] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185b27f3b6414735b4f7a01579678bcb" member_type: VOTER }
I20260709 12:08:13.964207 16192 leader_election.cc:304] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 185b27f3b6414735b4f7a01579678bcb; no voters: 
I20260709 12:08:13.966084 16192 leader_election.cc:290] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:13.966450 16195 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:13.970428 16195 raft_consensus.cc:697] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 1 LEADER]: Becoming Leader. State: Replica: 185b27f3b6414735b4f7a01579678bcb, State: Running, Role: LEADER
I20260709 12:08:13.971414 16195 consensus_queue.cc:237] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185b27f3b6414735b4f7a01579678bcb" member_type: VOTER }
I20260709 12:08:13.972782 16192 sys_catalog.cc:565] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:13.983407 16196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 185b27f3b6414735b4f7a01579678bcb. Latest consensus state: current_term: 1 leader_uuid: "185b27f3b6414735b4f7a01579678bcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185b27f3b6414735b4f7a01579678bcb" member_type: VOTER } }
I20260709 12:08:13.983250 16197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "185b27f3b6414735b4f7a01579678bcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185b27f3b6414735b4f7a01579678bcb" member_type: VOTER } }
I20260709 12:08:13.984117 16196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:13.984203 16197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:13.989177 16203 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:14.002269 16203 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:14.006333 16125 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:14.021857 16203 catalog_manager.cc:1383] Generated new cluster ID: 4348405d4c584c6683864e33bbd651d7
I20260709 12:08:14.022142 16203 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:14.045816 16203 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:14.048205 16203 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:14.064785 16203 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb: Generated new TSK 0
I20260709 12:08:14.065769 16203 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:14.072984 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:14.081924 16214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:14.083180 16215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:14.088706 16217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:14.088939 16125 server_base.cc:1061] running on GCE node
I20260709 12:08:14.089757 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:14.089955 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:14.090163 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598894090140 us; error 0 us; skew 500 ppm
I20260709 12:08:14.090761 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:14.095257 16125 webserver.cc:533] Webserver started at http://127.15.191.65:36009/ using document root <none> and password file <none>
I20260709 12:08:14.095827 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:14.096019 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:14.096292 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:14.097414 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-0-root/instance:
uuid: "5e76c69ff1374c6bad8060bb59e584d2"
format_stamp: "Formatted at 2026-07-09 12:08:14 on dist-test-slave-1sdq"
I20260709 12:08:14.104146 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
I20260709 12:08:14.109671 16222 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:14.110695 16125 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:08:14.110999 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "5e76c69ff1374c6bad8060bb59e584d2"
format_stamp: "Formatted at 2026-07-09 12:08:14 on dist-test-slave-1sdq"
I20260709 12:08:14.111310 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:14.141776 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:14.143221 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:14.145977 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:14.150271 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:14.150533 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:14.150800 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:14.150960 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:14.260803 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:40591
I20260709 12:08:14.260917 16284 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:40591 every 8 connection(s)
I20260709 12:08:14.268332 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:14.291114 16289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:14.295363 16290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:14.296224 16292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:14.297724 16125 server_base.cc:1061] running on GCE node
I20260709 12:08:14.298828 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:14.299166 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:14.299408 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598894299384 us; error 0 us; skew 500 ppm
I20260709 12:08:14.300122 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:14.303283 16125 webserver.cc:533] Webserver started at http://127.15.191.66:35755/ using document root <none> and password file <none>
I20260709 12:08:14.303928 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:14.304138 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:14.304502 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:14.305234 16285 heartbeater.cc:344] Connected to a master server at 127.15.191.126:37165
I20260709 12:08:14.305774 16285 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:14.305996 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-1-root/instance:
uuid: "ccf30b4a50c74998a673a82478bdbf5a"
format_stamp: "Formatted at 2026-07-09 12:08:14 on dist-test-slave-1sdq"
I20260709 12:08:14.307071 16285 heartbeater.cc:507] Master 127.15.191.126:37165 requested a full tablet report, sending...
I20260709 12:08:14.311111 16157 ts_manager.cc:194] Registered new tserver with Master: 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591)
I20260709 12:08:14.314042 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:14.314440 16157 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35968
I20260709 12:08:14.318627 16297 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:14.319492 16125 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:08:14.319852 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-1-root
uuid: "ccf30b4a50c74998a673a82478bdbf5a"
format_stamp: "Formatted at 2026-07-09 12:08:14 on dist-test-slave-1sdq"
I20260709 12:08:14.320220 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:14.342433 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:14.344146 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:14.348621 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:14.353211 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:14.353530 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:14.353835 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:14.354051 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:14.457731 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.66:43685
I20260709 12:08:14.457962 16359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.66:43685 every 8 connection(s)
I20260709 12:08:14.465548 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:14.475059 16363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:14.481308 16360 heartbeater.cc:344] Connected to a master server at 127.15.191.126:37165
I20260709 12:08:14.481765 16360 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:14.482867 16360 heartbeater.cc:507] Master 127.15.191.126:37165 requested a full tablet report, sending...
I20260709 12:08:14.486068 16157 ts_manager.cc:194] Registered new tserver with Master: ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
W20260709 12:08:14.486795 16364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:14.488881 16157 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35984
I20260709 12:08:14.490134 16125 server_base.cc:1061] running on GCE node
W20260709 12:08:14.490463 16366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:14.491684 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:14.491959 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:14.492110 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598894492095 us; error 0 us; skew 500 ppm
I20260709 12:08:14.492715 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:14.495550 16125 webserver.cc:533] Webserver started at http://127.15.191.67:35057/ using document root <none> and password file <none>
I20260709 12:08:14.496037 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:14.496210 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:14.496457 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:14.497567 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-2-root/instance:
uuid: "98732c84f5f14689afa96e3ca3c750e0"
format_stamp: "Formatted at 2026-07-09 12:08:14 on dist-test-slave-1sdq"
I20260709 12:08:14.502218 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:14.505681 16371 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:14.506564 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:14.506949 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-2-root
uuid: "98732c84f5f14689afa96e3ca3c750e0"
format_stamp: "Formatted at 2026-07-09 12:08:14 on dist-test-slave-1sdq"
I20260709 12:08:14.507313 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598892377095-16125-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:14.532284 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:14.533965 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:14.536017 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:14.539747 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:14.540045 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:14.540344 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:14.540555 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:14.629405 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.67:36155
I20260709 12:08:14.629460 16433 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.67:36155 every 8 connection(s)
I20260709 12:08:14.646884 16434 heartbeater.cc:344] Connected to a master server at 127.15.191.126:37165
I20260709 12:08:14.647290 16434 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:14.648134 16434 heartbeater.cc:507] Master 127.15.191.126:37165 requested a full tablet report, sending...
I20260709 12:08:14.650269 16157 ts_manager.cc:194] Registered new tserver with Master: 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:14.650571 16125 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013745312s
I20260709 12:08:14.651647 16157 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35990
I20260709 12:08:14.710320 16157 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35992:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:14.714352 16157 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:14.831733 16399 tablet_service.cc:1511] Processing CreateTablet for tablet dcd3b03b94f743f38807408bb0cae94d (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:14.833527 16399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd3b03b94f743f38807408bb0cae94d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.841084 16398 tablet_service.cc:1511] Processing CreateTablet for tablet 0e66bf165f274349a3f4a2c10b6dfff6 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:14.843803 16397 tablet_service.cc:1511] Processing CreateTablet for tablet 58031efc6b9143d8a65d4e1847b4dbd8 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:14.850535 16248 tablet_service.cc:1511] Processing CreateTablet for tablet 58031efc6b9143d8a65d4e1847b4dbd8 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:14.837960 16395 tablet_service.cc:1511] Processing CreateTablet for tablet 5c332053e81d47cea700ff3259d09587 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:14.851377 16249 tablet_service.cc:1511] Processing CreateTablet for tablet 0e66bf165f274349a3f4a2c10b6dfff6 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:14.854954 16250 tablet_service.cc:1511] Processing CreateTablet for tablet dcd3b03b94f743f38807408bb0cae94d (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:14.857070 16398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e66bf165f274349a3f4a2c10b6dfff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.859606 16394 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5b8de7db5c4361b136094be74071ec (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:14.864024 16397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58031efc6b9143d8a65d4e1847b4dbd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.864019 16247 tablet_service.cc:1511] Processing CreateTablet for tablet 480c10bcac3b4624a57d6fdfa5a22f54 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:14.861466 16396 tablet_service.cc:1511] Processing CreateTablet for tablet 480c10bcac3b4624a57d6fdfa5a22f54 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:14.866360 16248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58031efc6b9143d8a65d4e1847b4dbd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.871057 16395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c332053e81d47cea700ff3259d09587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.870942 16393 tablet_service.cc:1511] Processing CreateTablet for tablet caac123abc2b422fa04d7a3f250fb9f9 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:14.871776 16394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5b8de7db5c4361b136094be74071ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.872505 16396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480c10bcac3b4624a57d6fdfa5a22f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.875597 16245 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5b8de7db5c4361b136094be74071ec (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:14.875521 16246 tablet_service.cc:1511] Processing CreateTablet for tablet 5c332053e81d47cea700ff3259d09587 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:14.876685 16392 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc2c279910b4501b6be7ac7c1e67dcc (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:14.880436 16243 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc2c279910b4501b6be7ac7c1e67dcc (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:14.877822 16244 tablet_service.cc:1511] Processing CreateTablet for tablet caac123abc2b422fa04d7a3f250fb9f9 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:14.885306 16250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd3b03b94f743f38807408bb0cae94d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.886399 16393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caac123abc2b422fa04d7a3f250fb9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.886373 16242 tablet_service.cc:1511] Processing CreateTablet for tablet 005d85ad9d8841fd9593113d5885ea0f (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:14.891564 16391 tablet_service.cc:1511] Processing CreateTablet for tablet 005d85ad9d8841fd9593113d5885ea0f (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:14.894702 16392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc2c279910b4501b6be7ac7c1e67dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.896236 16391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005d85ad9d8841fd9593113d5885ea0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.898993 16249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e66bf165f274349a3f4a2c10b6dfff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.906642 16242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005d85ad9d8841fd9593113d5885ea0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.926504 16243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc2c279910b4501b6be7ac7c1e67dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.931100 16245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5b8de7db5c4361b136094be74071ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.933533 16247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480c10bcac3b4624a57d6fdfa5a22f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.935529 16246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c332053e81d47cea700ff3259d09587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:14.937220 16244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caac123abc2b422fa04d7a3f250fb9f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:08:15.006737 16205 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:15.014190 16325 tablet_service.cc:1511] Processing CreateTablet for tablet dcd3b03b94f743f38807408bb0cae94d (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:15.022701 16325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd3b03b94f743f38807408bb0cae94d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.018877 16324 tablet_service.cc:1511] Processing CreateTablet for tablet 0e66bf165f274349a3f4a2c10b6dfff6 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:15.019850 16323 tablet_service.cc:1511] Processing CreateTablet for tablet 58031efc6b9143d8a65d4e1847b4dbd8 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:15.018875 16322 tablet_service.cc:1511] Processing CreateTablet for tablet 480c10bcac3b4624a57d6fdfa5a22f54 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:15.038057 16319 tablet_service.cc:1511] Processing CreateTablet for tablet caac123abc2b422fa04d7a3f250fb9f9 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:15.046535 16321 tablet_service.cc:1511] Processing CreateTablet for tablet 5c332053e81d47cea700ff3259d09587 (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:15.050805 16324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e66bf165f274349a3f4a2c10b6dfff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.036293 16320 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5b8de7db5c4361b136094be74071ec (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:15.052881 16318 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc2c279910b4501b6be7ac7c1e67dcc (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:15.059419 16322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480c10bcac3b4624a57d6fdfa5a22f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.065618 16317 tablet_service.cc:1511] Processing CreateTablet for tablet 005d85ad9d8841fd9593113d5885ea0f (DEFAULT_TABLE table=test-workload [id=084e17a60ff34417804ee6cb58aa00b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:15.068905 16451 tablet_bootstrap.cc:492] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0: Bootstrap starting.
I20260709 12:08:15.073972 16318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc2c279910b4501b6be7ac7c1e67dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.084940 16319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caac123abc2b422fa04d7a3f250fb9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.086377 16320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5b8de7db5c4361b136094be74071ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.094305 16321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c332053e81d47cea700ff3259d09587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.097532 16317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005d85ad9d8841fd9593113d5885ea0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.117962 16452 tablet_bootstrap.cc:492] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2: Bootstrap starting.
I20260709 12:08:15.118795 16323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58031efc6b9143d8a65d4e1847b4dbd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.157203 16451 tablet_bootstrap.cc:654] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.170174 16452 tablet_bootstrap.cc:654] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.225715 16451 tablet_bootstrap.cc:492] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0: No bootstrap required, opened a new log
I20260709 12:08:15.226408 16451 ts_tablet_manager.cc:1403] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0: Time spent bootstrapping tablet: real 0.192s	user 0.015s	sys 0.010s
I20260709 12:08:15.231482 16451 raft_consensus.cc:359] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.232437 16452 tablet_bootstrap.cc:492] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2: No bootstrap required, opened a new log
I20260709 12:08:15.232908 16452 ts_tablet_manager.cc:1403] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent bootstrapping tablet: real 0.121s	user 0.020s	sys 0.007s
I20260709 12:08:15.235136 16451 raft_consensus.cc:385] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.236505 16451 raft_consensus.cc:740] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.236708 16452 raft_consensus.cc:359] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.237478 16452 raft_consensus.cc:385] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.236617 16455 tablet_bootstrap.cc:492] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a: Bootstrap starting.
I20260709 12:08:15.237341 16451 consensus_queue.cc:260] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.237792 16452 raft_consensus.cc:740] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.240020 16452 consensus_queue.cc:260] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.240945 16434 heartbeater.cc:499] Master 127.15.191.126:37165 was elected leader, sending a full tablet report...
I20260709 12:08:15.248574 16451 ts_tablet_manager.cc:1434] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.005s
I20260709 12:08:15.249689 16455 tablet_bootstrap.cc:654] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.249828 16451 tablet_bootstrap.cc:492] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0: Bootstrap starting.
I20260709 12:08:15.257982 16285 heartbeater.cc:499] Master 127.15.191.126:37165 was elected leader, sending a full tablet report...
I20260709 12:08:15.275692 16451 tablet_bootstrap.cc:654] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.278743 16452 ts_tablet_manager.cc:1434] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.009s
I20260709 12:08:15.280597 16452 tablet_bootstrap.cc:492] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2: Bootstrap starting.
I20260709 12:08:15.293639 16452 tablet_bootstrap.cc:654] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.303225 16455 tablet_bootstrap.cc:492] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a: No bootstrap required, opened a new log
I20260709 12:08:15.303649 16455 ts_tablet_manager.cc:1403] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.023s
I20260709 12:08:15.304667 16451 tablet_bootstrap.cc:492] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0: No bootstrap required, opened a new log
I20260709 12:08:15.305217 16451 ts_tablet_manager.cc:1403] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.011s
I20260709 12:08:15.306203 16452 tablet_bootstrap.cc:492] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2: No bootstrap required, opened a new log
I20260709 12:08:15.306730 16452 ts_tablet_manager.cc:1403] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.007s
I20260709 12:08:15.306779 16455 raft_consensus.cc:359] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.307622 16455 raft_consensus.cc:385] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.307916 16455 raft_consensus.cc:740] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.308789 16455 consensus_queue.cc:260] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.309283 16451 raft_consensus.cc:359] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.310153 16451 raft_consensus.cc:385] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.309964 16452 raft_consensus.cc:359] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.310617 16451 raft_consensus.cc:740] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.310775 16452 raft_consensus.cc:385] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.311201 16452 raft_consensus.cc:740] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.311733 16451 consensus_queue.cc:260] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.311986 16452 consensus_queue.cc:260] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.314800 16452 ts_tablet_manager.cc:1434] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:08:15.315907 16452 tablet_bootstrap.cc:492] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2: Bootstrap starting.
I20260709 12:08:15.316435 16451 ts_tablet_manager.cc:1434] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:08:15.317507 16451 tablet_bootstrap.cc:492] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0: Bootstrap starting.
I20260709 12:08:15.323447 16452 tablet_bootstrap.cc:654] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.327641 16360 heartbeater.cc:499] Master 127.15.191.126:37165 was elected leader, sending a full tablet report...
I20260709 12:08:15.327989 16455 ts_tablet_manager.cc:1434] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a: Time spent starting tablet: real 0.024s	user 0.013s	sys 0.002s
I20260709 12:08:15.328985 16455 tablet_bootstrap.cc:492] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a: Bootstrap starting.
I20260709 12:08:15.330521 16451 tablet_bootstrap.cc:654] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.340039 16455 tablet_bootstrap.cc:654] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.352712 16451 tablet_bootstrap.cc:492] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0: No bootstrap required, opened a new log
I20260709 12:08:15.353322 16451 ts_tablet_manager.cc:1403] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.007s
I20260709 12:08:15.358230 16451 raft_consensus.cc:359] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.359084 16451 raft_consensus.cc:385] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.359450 16451 raft_consensus.cc:740] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.360441 16451 consensus_queue.cc:260] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.365893 16451 ts_tablet_manager.cc:1434] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:08:15.367111 16451 tablet_bootstrap.cc:492] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0: Bootstrap starting.
I20260709 12:08:15.367862 16452 tablet_bootstrap.cc:492] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2: No bootstrap required, opened a new log
I20260709 12:08:15.368469 16452 ts_tablet_manager.cc:1403] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.008s
I20260709 12:08:15.378160 16451 tablet_bootstrap.cc:654] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:15.388651 16435 tablet.cc:2406] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:15.389132 16452 raft_consensus.cc:359] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.389920 16452 raft_consensus.cc:385] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.390250 16452 raft_consensus.cc:740] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.392241 16451 tablet_bootstrap.cc:492] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0: No bootstrap required, opened a new log
I20260709 12:08:15.392771 16451 ts_tablet_manager.cc:1403] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 12:08:15.391888 16452 consensus_queue.cc:260] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.397804 16451 raft_consensus.cc:359] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.398689 16451 raft_consensus.cc:385] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.399039 16451 raft_consensus.cc:740] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.401229 16451 consensus_queue.cc:260] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.407370 16451 ts_tablet_manager.cc:1434] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:08:15.408535 16451 tablet_bootstrap.cc:492] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0: Bootstrap starting.
I20260709 12:08:15.411499 16452 ts_tablet_manager.cc:1434] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 12:08:15.415524 16455 tablet_bootstrap.cc:492] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a: No bootstrap required, opened a new log
I20260709 12:08:15.416129 16455 ts_tablet_manager.cc:1403] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a: Time spent bootstrapping tablet: real 0.087s	user 0.022s	sys 0.053s
I20260709 12:08:15.417505 16451 tablet_bootstrap.cc:654] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.419327 16455 raft_consensus.cc:359] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.420187 16455 raft_consensus.cc:385] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.420560 16455 raft_consensus.cc:740] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.421396 16455 consensus_queue.cc:260] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.428164 16455 ts_tablet_manager.cc:1434] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 12:08:15.432026 16455 tablet_bootstrap.cc:492] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a: Bootstrap starting.
I20260709 12:08:15.428434 16452 tablet_bootstrap.cc:492] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2: Bootstrap starting.
I20260709 12:08:15.430830 16451 tablet_bootstrap.cc:492] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0: No bootstrap required, opened a new log
I20260709 12:08:15.439065 16451 ts_tablet_manager.cc:1403] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 12:08:15.439404 16455 tablet_bootstrap.cc:654] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.442337 16451 raft_consensus.cc:359] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.443261 16451 raft_consensus.cc:385] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.443602 16451 raft_consensus.cc:740] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.445465 16452 tablet_bootstrap.cc:654] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.444535 16451 consensus_queue.cc:260] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.448958 16456 raft_consensus.cc:493] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.449582 16456 raft_consensus.cc:515] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.452205 16451 ts_tablet_manager.cc:1434] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:08:15.453475 16451 tablet_bootstrap.cc:492] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0: Bootstrap starting.
I20260709 12:08:15.459052 16456 leader_election.cc:290] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:15.473510 16451 tablet_bootstrap.cc:654] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.484503 16455 tablet_bootstrap.cc:492] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a: No bootstrap required, opened a new log
I20260709 12:08:15.485143 16455 ts_tablet_manager.cc:1403] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a: Time spent bootstrapping tablet: real 0.053s	user 0.027s	sys 0.014s
I20260709 12:08:15.486249 16452 tablet_bootstrap.cc:492] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2: No bootstrap required, opened a new log
I20260709 12:08:15.486763 16452 ts_tablet_manager.cc:1403] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.014s
I20260709 12:08:15.489111 16455 raft_consensus.cc:359] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.490047 16455 raft_consensus.cc:385] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.490523 16455 raft_consensus.cc:740] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.491114 16457 raft_consensus.cc:493] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.491583 16457 raft_consensus.cc:515] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.491628 16455 consensus_queue.cc:260] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.490067 16452 raft_consensus.cc:359] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.494494 16457 leader_election.cc:290] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.497884 16452 raft_consensus.cc:385] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.499173 16452 raft_consensus.cc:740] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.500665 16455 ts_tablet_manager.cc:1434] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:08:15.502519 16452 consensus_queue.cc:260] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.505134 16455 tablet_bootstrap.cc:492] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a: Bootstrap starting.
I20260709 12:08:15.507202 16461 raft_consensus.cc:493] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.508108 16461 raft_consensus.cc:515] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.511583 16461 leader_election.cc:290] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.516990 16452 ts_tablet_manager.cc:1434] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.003s
I20260709 12:08:15.517200 16461 raft_consensus.cc:493] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.517638 16461 raft_consensus.cc:515] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.518059 16452 tablet_bootstrap.cc:492] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2: Bootstrap starting.
I20260709 12:08:15.546852 16452 tablet_bootstrap.cc:654] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.553107 16461 leader_election.cc:290] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155), 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591)
I20260709 12:08:15.564241 16455 tablet_bootstrap.cc:654] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.572384 16451 tablet_bootstrap.cc:492] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0: No bootstrap required, opened a new log
I20260709 12:08:15.573421 16451 ts_tablet_manager.cc:1403] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0: Time spent bootstrapping tablet: real 0.120s	user 0.041s	sys 0.010s
I20260709 12:08:15.583102 16456 raft_consensus.cc:493] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.586789 16335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:15.586470 16456 raft_consensus.cc:515] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.588299 16451 raft_consensus.cc:359] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.589138 16451 raft_consensus.cc:385] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.589370 16456 leader_election.cc:290] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:15.589643 16451 raft_consensus.cc:740] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.594309 16457 raft_consensus.cc:493] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.594923 16457 raft_consensus.cc:515] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.597302 16457 leader_election.cc:290] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.602133 16335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:15.599767 16451 consensus_queue.cc:260] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.617444 16456 raft_consensus.cc:493] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.618031 16456 raft_consensus.cc:515] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.620131 16456 leader_election.cc:290] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:15.626053 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
W20260709 12:08:15.629318 16372 leader_election.cc:343] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:15.641917 16372 leader_election.cc:343] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.625478 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
W20260709 12:08:15.645063 16298 leader_election.cc:343] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.647085 16335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:15.652760 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:15.653842 16408 raft_consensus.cc:2468] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 0.
I20260709 12:08:15.650157 16335 raft_consensus.cc:2468] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 0.
I20260709 12:08:15.677971 16225 leader_election.cc:304] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
W20260709 12:08:15.679955 16298 leader_election.cc:343] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.658178 16409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:15.682020 16457 raft_consensus.cc:2804] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:15.682572 16457 raft_consensus.cc:493] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:15.685942 16457 raft_consensus.cc:3060] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.690694 16372 leader_election.cc:304] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:15.694020 16335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:15.694216 16456 raft_consensus.cc:2804] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:15.694447 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:15.694702 16456 raft_consensus.cc:493] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:15.695158 16456 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:15.696406 16223 leader_election.cc:343] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:15.697229 16223 leader_election.cc:343] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.699602 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:15.702045 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:15.704443 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:15.711498 16456 raft_consensus.cc:515] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
W20260709 12:08:15.714766 16225 leader_election.cc:343] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.715328 16225 leader_election.cc:304] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2; no voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a
W20260709 12:08:15.712896 16372 leader_election.cc:343] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.717819 16372 leader_election.cc:304] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0; no voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:15.731495 16451 ts_tablet_manager.cc:1434] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0: Time spent starting tablet: real 0.157s	user 0.009s	sys 0.004s
I20260709 12:08:15.732268 16452 tablet_bootstrap.cc:492] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2: No bootstrap required, opened a new log
I20260709 12:08:15.735035 16484 raft_consensus.cc:2749] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:15.738690 16452 ts_tablet_manager.cc:1403] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2: Time spent bootstrapping tablet: real 0.221s	user 0.016s	sys 0.015s
I20260709 12:08:15.738835 16484 raft_consensus.cc:493] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.739426 16455 tablet_bootstrap.cc:492] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a: No bootstrap required, opened a new log
I20260709 12:08:15.739310 16484 raft_consensus.cc:515] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.736243 16483 raft_consensus.cc:493] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.739962 16455 ts_tablet_manager.cc:1403] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a: Time spent bootstrapping tablet: real 0.236s	user 0.053s	sys 0.102s
I20260709 12:08:15.740280 16483 raft_consensus.cc:515] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.742170 16452 raft_consensus.cc:359] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.742887 16483 leader_election.cc:290] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.743003 16452 raft_consensus.cc:385] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.743444 16452 raft_consensus.cc:740] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.743774 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:15.743610 16455 raft_consensus.cc:359] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.744356 16455 raft_consensus.cc:385] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.744422 16334 raft_consensus.cc:2468] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 0.
I20260709 12:08:15.744774 16455 raft_consensus.cc:740] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.745059 16456 leader_election.cc:290] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:15.744475 16452 consensus_queue.cc:260] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.745618 16456 raft_consensus.cc:2749] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:15.745874 16223 leader_election.cc:304] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:15.745568 16455 consensus_queue.cc:260] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.748174 16484 leader_election.cc:290] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.748904 16483 raft_consensus.cc:2804] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:15.749035 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:15.749647 16452 ts_tablet_manager.cc:1434] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:08:15.749908 16483 raft_consensus.cc:493] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:15.750320 16483 raft_consensus.cc:3060] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:15.750708 16223 leader_election.cc:343] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.754931 16455 ts_tablet_manager.cc:1434] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.007s
I20260709 12:08:15.760773 16455 tablet_bootstrap.cc:492] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a: Bootstrap starting.
I20260709 12:08:15.767460 16455 tablet_bootstrap.cc:654] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.769451 16483 raft_consensus.cc:515] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.771697 16483 leader_election.cc:290] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 election: Requested vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.772779 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:15.773461 16334 raft_consensus.cc:3060] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.774611 16452 tablet_bootstrap.cc:492] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2: Bootstrap starting.
I20260709 12:08:15.779335 16455 tablet_bootstrap.cc:492] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a: No bootstrap required, opened a new log
I20260709 12:08:15.779863 16455 ts_tablet_manager.cc:1403] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:08:15.781062 16334 raft_consensus.cc:2468] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 1.
I20260709 12:08:15.781740 16451 tablet_bootstrap.cc:492] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0: Bootstrap starting.
I20260709 12:08:15.782433 16223 leader_election.cc:304] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:15.782923 16455 raft_consensus.cc:359] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.783385 16483 raft_consensus.cc:2804] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:15.783674 16455 raft_consensus.cc:385] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.783991 16455 raft_consensus.cc:740] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.784065 16483 raft_consensus.cc:697] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:15.784859 16455 consensus_queue.cc:260] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.785816 16483 consensus_queue.cc:237] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.791846 16455 ts_tablet_manager.cc:1434] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:08:15.792877 16455 tablet_bootstrap.cc:492] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a: Bootstrap starting.
I20260709 12:08:15.729676 16457 raft_consensus.cc:515] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.797331 16409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:15.797596 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:15.798121 16409 raft_consensus.cc:2468] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 0.
I20260709 12:08:15.799408 16409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
W20260709 12:08:15.799883 16225 leader_election.cc:343] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.799979 16409 raft_consensus.cc:3060] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.800290 16452 tablet_bootstrap.cc:654] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:15.802229 16372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:40591, user_credentials={real_user=slave}} blocked reactor thread for 89100.7us
I20260709 12:08:15.800396 16225 leader_election.cc:304] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2; no voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a
W20260709 12:08:15.804443 16372 leader_election.cc:343] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.806768 16372 leader_election.cc:304] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0; no voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:15.810420 16457 leader_election.cc:290] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 election: Requested vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.811877 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:15.813347 16486 raft_consensus.cc:2749] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:15.813563 16485 raft_consensus.cc:2749] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:08:15.814527 16223 leader_election.cc:343] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:15.816061 16372 leader_election.cc:343] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.816298 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:15.817685 16408 raft_consensus.cc:3060] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.820839 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:15.821250 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:15.821827 16334 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.823066 16455 tablet_bootstrap.cc:654] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.826192 16485 raft_consensus.cc:493] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.829188 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:15.829641 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
W20260709 12:08:15.829950 16372 leader_election.cc:343] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.832546 16407 raft_consensus.cc:2393] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccf30b4a50c74998a673a82478bdbf5a in current term 1: Already voted for candidate 98732c84f5f14689afa96e3ca3c750e0 in this term.
I20260709 12:08:15.827900 16485 raft_consensus.cc:515] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.835286 16406 raft_consensus.cc:2468] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 0.
I20260709 12:08:15.835671 16409 raft_consensus.cc:2468] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 1.
I20260709 12:08:15.836519 16300 leader_election.cc:304] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccf30b4a50c74998a673a82478bdbf5a; no voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:15.837481 16451 tablet_bootstrap.cc:654] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.839888 16452 tablet_bootstrap.cc:492] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2: No bootstrap required, opened a new log
I20260709 12:08:15.841591 16452 ts_tablet_manager.cc:1403] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.004s
I20260709 12:08:15.841825 16334 raft_consensus.cc:2468] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 1.
I20260709 12:08:15.842159 16408 raft_consensus.cc:2468] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 1.
I20260709 12:08:15.842306 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:15.843758 16477 raft_consensus.cc:2749] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:15.843672 16260 raft_consensus.cc:2468] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 0.
I20260709 12:08:15.845705 16372 leader_election.cc:304] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a; no voters: 5e76c69ff1374c6bad8060bb59e584d2
I20260709 12:08:15.845714 16225 leader_election.cc:304] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:15.847311 16456 raft_consensus.cc:2804] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:15.848255 16486 raft_consensus.cc:2804] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:15.848853 16486 raft_consensus.cc:697] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:15.849427 16455 tablet_bootstrap.cc:492] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a: No bootstrap required, opened a new log
I20260709 12:08:15.849963 16455 ts_tablet_manager.cc:1403] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.006s
I20260709 12:08:15.849802 16486 consensus_queue.cc:237] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.850490 16452 raft_consensus.cc:359] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.851383 16452 raft_consensus.cc:385] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.851743 16452 raft_consensus.cc:740] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.853009 16456 raft_consensus.cc:697] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Becoming Leader. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:15.853999 16456 consensus_queue.cc:237] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.854514 16455 raft_consensus.cc:359] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.855872 16455 raft_consensus.cc:385] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.856207 16455 raft_consensus.cc:740] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.857105 16455 consensus_queue.cc:260] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.845815 16485 leader_election.cc:290] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:15.860412 16455 ts_tablet_manager.cc:1434] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:08:15.861534 16455 tablet_bootstrap.cc:492] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a: Bootstrap starting.
I20260709 12:08:15.864487 16372 leader_election.cc:304] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:15.859165 16452 consensus_queue.cc:260] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.867051 16485 raft_consensus.cc:2804] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:15.868074 16485 raft_consensus.cc:493] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:15.868685 16485 raft_consensus.cc:3060] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.869191 16451 tablet_bootstrap.cc:492] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0: No bootstrap required, opened a new log
I20260709 12:08:15.869388 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:15.869752 16451 ts_tablet_manager.cc:1403] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.005s
I20260709 12:08:15.869841 16452 ts_tablet_manager.cc:1434] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:08:15.870738 16334 raft_consensus.cc:2468] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 0.
I20260709 12:08:15.871230 16452 tablet_bootstrap.cc:492] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2: Bootstrap starting.
I20260709 12:08:15.872735 16300 leader_election.cc:304] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a; no voters: 5e76c69ff1374c6bad8060bb59e584d2
I20260709 12:08:15.873934 16477 raft_consensus.cc:2804] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:15.863831 16154 catalog_manager.cc:5697] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:15.875392 16477 raft_consensus.cc:493] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:15.876842 16477 raft_consensus.cc:3060] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.876899 16451 raft_consensus.cc:359] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.879087 16451 raft_consensus.cc:385] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.880345 16451 raft_consensus.cc:740] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.884433 16451 consensus_queue.cc:260] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.893333 16461 raft_consensus.cc:493] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.893603 16451 ts_tablet_manager.cc:1434] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:08:15.894001 16461 raft_consensus.cc:515] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.894511 16452 tablet_bootstrap.cc:654] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.894742 16451 tablet_bootstrap.cc:492] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0: Bootstrap starting.
I20260709 12:08:15.897643 16461 leader_election.cc:290] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.898289 16477 raft_consensus.cc:515] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.898461 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:15.899286 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:15.899838 16260 raft_consensus.cc:2468] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 0.
W20260709 12:08:15.903323 16300 leader_election.cc:343] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.904446 16298 leader_election.cc:304] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:15.905921 16461 raft_consensus.cc:2804] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:15.909004 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:15.909063 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:15.906446 16461 raft_consensus.cc:493] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:15.910006 16477 leader_election.cc:290] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Requested vote from peers 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155), 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591)
I20260709 12:08:15.910832 16260 raft_consensus.cc:3060] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.910547 16461 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.907074 16485 raft_consensus.cc:515] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:15.916659 16477 raft_consensus.cc:493] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.917218 16477 raft_consensus.cc:515] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.918671 16452 tablet_bootstrap.cc:492] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2: No bootstrap required, opened a new log
I20260709 12:08:15.919445 16406 raft_consensus.cc:2393] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccf30b4a50c74998a673a82478bdbf5a in current term 1: Already voted for candidate 98732c84f5f14689afa96e3ca3c750e0 in this term.
I20260709 12:08:15.918922 16455 tablet_bootstrap.cc:654] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.923185 16452 ts_tablet_manager.cc:1403] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.004s
I20260709 12:08:15.924935 16485 leader_election.cc:290] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:15.926323 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:15.927425 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:15.929613 16334 raft_consensus.cc:2393] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 98732c84f5f14689afa96e3ca3c750e0 in current term 1: Already voted for candidate ccf30b4a50c74998a673a82478bdbf5a in this term.
I20260709 12:08:15.936720 16461 raft_consensus.cc:515] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.934034 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:15.934653 16451 tablet_bootstrap.cc:654] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.940114 16477 leader_election.cc:290] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.934681 16372 leader_election.cc:304] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0; no voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:15.940104 16258 raft_consensus.cc:2468] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 0.
I20260709 12:08:15.943053 16485 raft_consensus.cc:2749] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:15.943449 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:15.943639 16452 raft_consensus.cc:359] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.947516 16298 leader_election.cc:304] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:15.947840 16452 raft_consensus.cc:385] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.947968 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:15.948199 16452 raft_consensus.cc:740] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.948386 16477 raft_consensus.cc:2804] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:15.948776 16477 raft_consensus.cc:493] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:15.949146 16477 raft_consensus.cc:3060] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.949203 16259 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.948941 16452 consensus_queue.cc:260] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.949370 16455 tablet_bootstrap.cc:492] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a: No bootstrap required, opened a new log
I20260709 12:08:15.950659 16455 ts_tablet_manager.cc:1403] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.018s
I20260709 12:08:15.950683 16461 leader_election.cc:290] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
W20260709 12:08:15.952919 16300 leader_election.cc:343] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.953662 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:15.954385 16452 ts_tablet_manager.cc:1434] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
W20260709 12:08:15.955597 16300 leader_election.cc:343] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:15.957057 16452 tablet_bootstrap.cc:492] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2: Bootstrap starting.
I20260709 12:08:15.958146 16461 raft_consensus.cc:493] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:15.958364 16260 raft_consensus.cc:2468] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 1.
I20260709 12:08:15.967717 16298 leader_election.cc:304] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:15.965535 16461 raft_consensus.cc:515] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.976950 16259 raft_consensus.cc:2468] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 1.
I20260709 12:08:15.978628 16461 leader_election.cc:290] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:15.977612 16477 raft_consensus.cc:515] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:15.987716 16461 raft_consensus.cc:2804] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:15.988332 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:15.993196 16406 raft_consensus.cc:2468] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 0.
I20260709 12:08:15.991724 16461 raft_consensus.cc:697] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:16.001214 16461 consensus_queue.cc:237] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:16.002199 16455 raft_consensus.cc:359] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.002991 16455 raft_consensus.cc:385] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.003470 16455 raft_consensus.cc:740] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.003644 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:16.004209 16452 tablet_bootstrap.cc:654] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.004545 16477 leader_election.cc:290] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:16.005774 16300 leader_election.cc:304] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
W20260709 12:08:16.006798 16300 leader_election.cc:343] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:16.009063 16477 raft_consensus.cc:2804] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:16.014274 16477 raft_consensus.cc:493] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:16.014654 16477 raft_consensus.cc:3060] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.009073 16455 consensus_queue.cc:260] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.011953 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:16.014766 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:16.015210 16260 raft_consensus.cc:3060] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.015409 16452 tablet_bootstrap.cc:492] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2: No bootstrap required, opened a new log
I20260709 12:08:16.015821 16452 ts_tablet_manager.cc:1403] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.010s
I20260709 12:08:16.018647 16452 raft_consensus.cc:359] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.019318 16452 raft_consensus.cc:385] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.019603 16452 raft_consensus.cc:740] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.018846 16155 catalog_manager.cc:5697] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "98732c84f5f14689afa96e3ca3c750e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:16.020694 16452 consensus_queue.cc:260] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.022739 16452 ts_tablet_manager.cc:1434] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:16.026686 16452 tablet_bootstrap.cc:492] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2: Bootstrap starting.
I20260709 12:08:16.026722 16154 catalog_manager.cc:5697] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 0 to 1, leader changed from <none> to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 1 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:16.028009 16455 ts_tablet_manager.cc:1434] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:08:16.029036 16455 tablet_bootstrap.cc:492] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a: Bootstrap starting.
I20260709 12:08:16.024302 16259 raft_consensus.cc:2468] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 0.
I20260709 12:08:16.030225 16260 raft_consensus.cc:2468] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 1.
I20260709 12:08:16.011447 16298 leader_election.cc:304] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:16.032181 16156 catalog_manager.cc:5697] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:16.033288 16451 tablet_bootstrap.cc:492] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0: No bootstrap required, opened a new log
I20260709 12:08:16.033561 16461 raft_consensus.cc:2804] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.034516 16461 raft_consensus.cc:697] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:16.034510 16451 ts_tablet_manager.cc:1403] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.003s
I20260709 12:08:16.035727 16452 tablet_bootstrap.cc:654] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.037595 16451 raft_consensus.cc:359] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
W20260709 12:08:16.013219 16205 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:16.039776 16451 raft_consensus.cc:385] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.040210 16451 raft_consensus.cc:740] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.040936 16451 consensus_queue.cc:260] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.038944 16461 consensus_queue.cc:237] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.033396 16298 leader_election.cc:304] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:16.046628 16455 tablet_bootstrap.cc:654] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.047235 16451 ts_tablet_manager.cc:1434] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:08:16.049749 16451 tablet_bootstrap.cc:492] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0: Bootstrap starting.
I20260709 12:08:16.051932 16500 raft_consensus.cc:2804] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.065397 16477 raft_consensus.cc:515] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.069743 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:16.070430 16260 raft_consensus.cc:3060] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.078651 16486 raft_consensus.cc:493] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:16.079470 16500 raft_consensus.cc:697] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:16.080628 16486 raft_consensus.cc:515] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.081314 16500 consensus_queue.cc:237] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.085840 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:16.086159 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:16.086711 16334 raft_consensus.cc:2393] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e76c69ff1374c6bad8060bb59e584d2 in current term 1: Already voted for candidate 98732c84f5f14689afa96e3ca3c750e0 in this term.
I20260709 12:08:16.087815 16260 raft_consensus.cc:2468] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 1.
I20260709 12:08:16.087980 16486 leader_election.cc:290] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:16.088089 16223 leader_election.cc:304] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2; no voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:16.089059 16457 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.093788 16485 raft_consensus.cc:493] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:16.094267 16298 leader_election.cc:304] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:16.097074 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:16.097729 16408 raft_consensus.cc:3060] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.094682 16485 raft_consensus.cc:515] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.098452 16451 tablet_bootstrap.cc:654] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.101007 16461 raft_consensus.cc:2804] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.103667 16485 leader_election.cc:290] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:16.105275 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:16.108503 16452 tablet_bootstrap.cc:492] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2: No bootstrap required, opened a new log
I20260709 12:08:16.108894 16452 ts_tablet_manager.cc:1403] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent bootstrapping tablet: real 0.082s	user 0.026s	sys 0.024s
I20260709 12:08:16.099612 16477 leader_election.cc:290] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:16.113548 16457 raft_consensus.cc:2749] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:16.114240 16452 raft_consensus.cc:359] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.115079 16452 raft_consensus.cc:385] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.115365 16452 raft_consensus.cc:740] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.116117 16452 consensus_queue.cc:260] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.118296 16452 ts_tablet_manager.cc:1434] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:08:16.119598 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:16.123116 16260 raft_consensus.cc:2393] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98732c84f5f14689afa96e3ca3c750e0 in current term 1: Already voted for candidate ccf30b4a50c74998a673a82478bdbf5a in this term.
I20260709 12:08:16.118880 16461 raft_consensus.cc:697] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:16.124617 16461 consensus_queue.cc:237] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.125043 16372 leader_election.cc:304] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0; no voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:16.126359 16485 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.119364 16408 raft_consensus.cc:2468] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 1.
I20260709 12:08:16.137244 16485 raft_consensus.cc:2749] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:16.145888 16455 tablet_bootstrap.cc:492] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a: No bootstrap required, opened a new log
I20260709 12:08:16.146416 16455 ts_tablet_manager.cc:1403] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a: Time spent bootstrapping tablet: real 0.118s	user 0.019s	sys 0.003s
I20260709 12:08:16.149564 16455 raft_consensus.cc:359] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.150308 16455 raft_consensus.cc:385] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.150648 16455 raft_consensus.cc:740] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.151425 16455 consensus_queue.cc:260] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.153857 16451 tablet_bootstrap.cc:492] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0: No bootstrap required, opened a new log
I20260709 12:08:16.154256 16455 ts_tablet_manager.cc:1434] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:08:16.154352 16451 ts_tablet_manager.cc:1403] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.008s
I20260709 12:08:16.155323 16455 tablet_bootstrap.cc:492] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a: Bootstrap starting.
I20260709 12:08:16.155846 16156 catalog_manager.cc:5697] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 0 to 1, leader changed from <none> to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 1 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:16.157650 16451 raft_consensus.cc:359] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.158367 16451 raft_consensus.cc:385] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.158649 16451 raft_consensus.cc:740] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.157999 16156 catalog_manager.cc:5697] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 0 to 1, leader changed from <none> to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 1 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:16.159315 16451 consensus_queue.cc:260] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.161356 16451 ts_tablet_manager.cc:1434] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:08:16.160115 16156 catalog_manager.cc:5697] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 0 to 1, leader changed from <none> to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 1 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:16.162009 16455 tablet_bootstrap.cc:654] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.169190 16455 tablet_bootstrap.cc:492] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a: No bootstrap required, opened a new log
I20260709 12:08:16.169673 16455 ts_tablet_manager.cc:1403] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:08:16.172109 16455 raft_consensus.cc:359] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.172780 16455 raft_consensus.cc:385] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.173022 16455 raft_consensus.cc:740] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.173640 16455 consensus_queue.cc:260] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.175958 16455 ts_tablet_manager.cc:1434] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:08:16.204312 16486 consensus_queue.cc:1048] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.216516 16483 consensus_queue.cc:1048] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.231699 16485 raft_consensus.cc:493] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:16.232343 16485 raft_consensus.cc:515] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.235488 16485 leader_election.cc:290] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:16.236968 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c332053e81d47cea700ff3259d09587" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:16.237949 16260 raft_consensus.cc:2468] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 0.
I20260709 12:08:16.239562 16372 leader_election.cc:304] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:16.240108 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c332053e81d47cea700ff3259d09587" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:16.241146 16334 raft_consensus.cc:2468] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 0.
I20260709 12:08:16.242796 16485 raft_consensus.cc:2804] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:16.243230 16485 raft_consensus.cc:493] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:16.243558 16485 raft_consensus.cc:3060] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.251276 16485 raft_consensus.cc:515] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.253572 16485 leader_election.cc:290] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:16.254318 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c332053e81d47cea700ff3259d09587" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:16.254719 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c332053e81d47cea700ff3259d09587" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:16.255124 16260 raft_consensus.cc:3060] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.255331 16334 raft_consensus.cc:3060] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.262698 16260 raft_consensus.cc:2468] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 1.
I20260709 12:08:16.264156 16372 leader_election.cc:304] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:16.265220 16334 raft_consensus.cc:2468] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 1.
I20260709 12:08:16.265522 16485 raft_consensus.cc:2804] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.266376 16485 raft_consensus.cc:697] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Becoming Leader. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:16.267319 16485 consensus_queue.cc:237] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.276723 16154 catalog_manager.cc:5697] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "98732c84f5f14689afa96e3ca3c750e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:16.295349 16485 consensus_queue.cc:1048] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.307541 16491 consensus_queue.cc:1048] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:16.314343 16483 consensus_queue.cc:1048] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.341288 16334 raft_consensus.cc:3060] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.353811 16486 consensus_queue.cc:1048] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:16.367605 16500 raft_consensus.cc:493] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:16.368130 16500 raft_consensus.cc:515] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.370442 16500 leader_election.cc:290] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:16.371639 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:16.371994 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:16.372346 16260 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 0.
I20260709 12:08:16.372639 16408 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 0.
I20260709 12:08:16.373462 16298 leader_election.cc:304] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:16.374287 16500 raft_consensus.cc:2804] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:16.374610 16500 raft_consensus.cc:493] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:16.374881 16500 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.380244 16500 raft_consensus.cc:515] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.381894 16500 leader_election.cc:290] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:16.382936 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:16.383076 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:16.383453 16260 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.383699 16408 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.388348 16260 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 1.
I20260709 12:08:16.389490 16298 leader_election.cc:304] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:16.390213 16500 raft_consensus.cc:2804] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.390506 16408 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 1.
I20260709 12:08:16.390625 16500 raft_consensus.cc:697] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:16.391505 16500 consensus_queue.cc:237] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.398670 16156 catalog_manager.cc:5697] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 0 to 1, leader changed from <none> to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 1 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:16.403242 16500 consensus_queue.cc:1048] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.417311 16477 consensus_queue.cc:1048] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.460353 16477 consensus_queue.cc:1048] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.471921 16509 consensus_queue.cc:1048] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:16.511160 16509 consensus_queue.cc:1048] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.517843 16509 consensus_queue.cc:1048] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.528738 16408 raft_consensus.cc:3060] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.543809 16509 consensus_queue.cc:1048] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:16.551955 16461 consensus_queue.cc:1048] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.623420 16334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
mode: GRACEFUL
new_leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:45244
I20260709 12:08:16.624169 16334 raft_consensus.cc:606] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Received request to transfer leadership to TS 5e76c69ff1374c6bad8060bb59e584d2
I20260709 12:08:16.630339 16334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
mode: GRACEFUL
new_leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:45244
I20260709 12:08:16.630986 16334 raft_consensus.cc:606] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Received request to transfer leadership to TS 5e76c69ff1374c6bad8060bb59e584d2
I20260709 12:08:16.650708 16408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54"
dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
mode: GRACEFUL
new_leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:56110
I20260709 12:08:16.651396 16408 raft_consensus.cc:606] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Received request to transfer leadership to TS 5e76c69ff1374c6bad8060bb59e584d2
I20260709 12:08:16.656488 16408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c332053e81d47cea700ff3259d09587"
dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
mode: GRACEFUL
new_leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:56110
I20260709 12:08:16.657013 16408 raft_consensus.cc:606] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Received request to transfer leadership to TS ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:16.676261 16259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
mode: GRACEFUL
new_leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:43786
I20260709 12:08:16.676983 16259 raft_consensus.cc:606] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Received request to transfer leadership to TS ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:16.682683 16334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
mode: GRACEFUL
new_leader_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:45244
I20260709 12:08:16.683290 16334 raft_consensus.cc:606] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Received request to transfer leadership to TS 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:16.684906 16456 raft_consensus.cc:993] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0: : Instructing follower 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:16.685292 16491 raft_consensus.cc:1081] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Signalling peer 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:16.686952 16259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:43774
I20260709 12:08:16.687486 16259 raft_consensus.cc:493] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:16.687783 16259 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.696252 16259 raft_consensus.cc:515] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.698549 16259 leader_election.cc:290] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 2 election: Requested vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:16.699577 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:16.699555 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:16.700354 16334 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.700327 16408 raft_consensus.cc:3055] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:16.700915 16408 raft_consensus.cc:740] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:16.701785 16408 consensus_queue.cc:260] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.703284 16408 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.707264 16334 raft_consensus.cc:2468] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 2.
I20260709 12:08:16.708647 16223 leader_election.cc:304] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:16.709497 16483 raft_consensus.cc:2804] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:16.710146 16408 raft_consensus.cc:2468] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 2.
I20260709 12:08:16.710139 16483 raft_consensus.cc:697] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:16.711721 16483 consensus_queue.cc:237] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.716399 16491 consensus_queue.cc:1048] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.720049 16156 catalog_manager.cc:5697] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 reported cstate change: term changed from 1 to 2, leader changed from 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67) to 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:16.733249 16456 consensus_queue.cc:1048] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.743525 16485 raft_consensus.cc:993] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0: : Instructing follower ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:16.744019 16485 raft_consensus.cc:1081] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Signalling peer ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:16.749256 16334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c332053e81d47cea700ff3259d09587"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:45228
I20260709 12:08:16.749933 16334 raft_consensus.cc:493] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:16.750378 16334 raft_consensus.cc:3060] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.757388 16334 raft_consensus.cc:515] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.759830 16334 leader_election.cc:290] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 2 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:16.760422 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c332053e81d47cea700ff3259d09587" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:16.761091 16259 raft_consensus.cc:3060] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.761411 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c332053e81d47cea700ff3259d09587" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:16.762058 16408 raft_consensus.cc:3055] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:16.762435 16408 raft_consensus.cc:740] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:16.763273 16408 consensus_queue.cc:260] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.764603 16408 raft_consensus.cc:3060] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.767443 16259 raft_consensus.cc:2468] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 2.
I20260709 12:08:16.769441 16298 leader_election.cc:304] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:16.770706 16461 raft_consensus.cc:2804] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:16.771234 16461 raft_consensus.cc:697] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 2 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:16.772104 16461 consensus_queue.cc:237] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.773933 16408 raft_consensus.cc:2468] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 2.
I20260709 12:08:16.779206 16154 catalog_manager.cc:5697] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 1 to 2, leader changed from 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67) to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 2 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:16.809203 16486 raft_consensus.cc:993] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2: : Instructing follower ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:16.809734 16483 raft_consensus.cc:1081] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Signalling peer ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:16.811278 16334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:45236
I20260709 12:08:16.811762 16334 raft_consensus.cc:493] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:16.812052 16334 raft_consensus.cc:3060] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.816713 16334 raft_consensus.cc:515] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.818732 16334 leader_election.cc:290] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 2 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:16.819507 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:16.819926 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:16.820242 16259 raft_consensus.cc:3055] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:16.820523 16408 raft_consensus.cc:3060] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.820619 16259 raft_consensus.cc:740] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:16.821655 16259 consensus_queue.cc:260] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.822901 16259 raft_consensus.cc:3060] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.826735 16408 raft_consensus.cc:2468] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 2.
I20260709 12:08:16.827847 16300 leader_election.cc:304] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:16.828537 16461 raft_consensus.cc:2804] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:16.829098 16461 raft_consensus.cc:697] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 2 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:16.829934 16259 raft_consensus.cc:2468] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 2.
I20260709 12:08:16.829921 16461 consensus_queue.cc:237] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.839128 16154 catalog_manager.cc:5697] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 1 to 2, leader changed from 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65) to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 2 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:16.900894 16461 raft_consensus.cc:993] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a: : Instructing follower 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:16.901428 16508 raft_consensus.cc:1081] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Signalling peer 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:16.903303 16260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:08:16.903930 16260 raft_consensus.cc:493] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:16.904316 16260 raft_consensus.cc:3060] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.909570 16260 raft_consensus.cc:515] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:16.911298 16260 leader_election.cc:290] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 2 election: Requested vote from peers 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:16.912547 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:16.912503 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:16.913229 16408 raft_consensus.cc:3060] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.913270 16334 raft_consensus.cc:3055] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:16.913762 16334 raft_consensus.cc:740] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:16.914638 16334 consensus_queue.cc:260] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:16.915840 16334 raft_consensus.cc:3060] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.922773 16334 raft_consensus.cc:2468] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 2.
I20260709 12:08:16.924134 16223 leader_election.cc:304] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:16.925030 16457 raft_consensus.cc:2804] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:16.925524 16457 raft_consensus.cc:697] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:16.924639 16408 raft_consensus.cc:2468] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 2.
I20260709 12:08:16.926378 16457 consensus_queue.cc:237] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:16.933749 16154 catalog_manager.cc:5697] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 reported cstate change: term changed from 1 to 2, leader changed from ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66) to 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:16.936232 16461 consensus_queue.cc:1048] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:16.951517 16509 raft_consensus.cc:993] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a: : Instructing follower 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:16.951997 16477 raft_consensus.cc:1081] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Signalling peer 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:16.952911 16508 consensus_queue.cc:1048] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:16.954425 16260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:08:16.955063 16260 raft_consensus.cc:493] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:16.955437 16260 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.963500 16260 raft_consensus.cc:515] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.966192 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:16.966897 16334 raft_consensus.cc:3055] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:16.967267 16334 raft_consensus.cc:740] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:16.968076 16334 consensus_queue.cc:260] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:16.969218 16334 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.979828 16260 leader_election.cc:290] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 2 election: Requested vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:16.980255 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:16.980933 16408 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.989285 16508 raft_consensus.cc:993] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a: : Instructing follower 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:16.990304 16500 raft_consensus.cc:1081] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Signalling peer 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:16.993019 16406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f"
dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:56098
I20260709 12:08:16.993636 16406 raft_consensus.cc:493] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:16.994001 16406 raft_consensus.cc:3060] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.995247 16334 raft_consensus.cc:2468] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 2.
I20260709 12:08:16.996302 16223 leader_election.cc:304] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:16.997149 16457 raft_consensus.cc:2804] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:16.997596 16457 raft_consensus.cc:697] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:16.998433 16457 consensus_queue.cc:237] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:17.001884 16406 raft_consensus.cc:515] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:17.004069 16406 leader_election.cc:290] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 2 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:17.004627 16408 raft_consensus.cc:2468] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 2.
I20260709 12:08:17.006063 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:17.006718 16260 raft_consensus.cc:3060] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:17.008098 16154 catalog_manager.cc:5697] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 reported cstate change: term changed from 1 to 2, leader changed from ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66) to 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:17.010190 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005d85ad9d8841fd9593113d5885ea0f" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:17.011463 16334 raft_consensus.cc:3055] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:17.011858 16334 raft_consensus.cc:740] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:17.012742 16334 consensus_queue.cc:260] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:17.013756 16260 raft_consensus.cc:2468] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 2.
I20260709 12:08:17.014026 16334 raft_consensus.cc:3060] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:17.015126 16372 leader_election.cc:304] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:17.015911 16485 raft_consensus.cc:2804] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:17.016364 16485 raft_consensus.cc:697] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Becoming Leader. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:17.017163 16485 consensus_queue.cc:237] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:17.025074 16154 catalog_manager.cc:5697] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 reported cstate change: term changed from 1 to 2, leader changed from ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66) to 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "98732c84f5f14689afa96e3ca3c750e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:17.025835 16334 raft_consensus.cc:2468] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 2.
I20260709 12:08:17.142637 16406 raft_consensus.cc:1275] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.144057 16483 consensus_queue.cc:1048] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.155742 16334 raft_consensus.cc:1275] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.157720 16483 consensus_queue.cc:1048] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.230515 16406 raft_consensus.cc:1275] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.232018 16508 consensus_queue.cc:1048] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.241586 16260 raft_consensus.cc:1275] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.243410 16508 consensus_queue.cc:1048] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.344604 16406 raft_consensus.cc:1275] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.345850 16508 consensus_queue.cc:1048] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.353389 16260 raft_consensus.cc:1275] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.355679 16508 consensus_queue.cc:1048] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.487071 16260 raft_consensus.cc:1275] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.488250 16485 consensus_queue.cc:1048] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.497432 16334 raft_consensus.cc:1275] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.498835 16485 consensus_queue.cc:1048] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.502959 16406 raft_consensus.cc:1275] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.504314 16483 consensus_queue.cc:1048] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.514753 16334 raft_consensus.cc:1275] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.517680 16457 consensus_queue.cc:1048] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:17.521680 16335 raft_consensus.cc:1275] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.526934 16457 consensus_queue.cc:1048] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.527943 16406 raft_consensus.cc:1275] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.529402 16545 consensus_queue.cc:1048] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.715548 16125 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:19.716368 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:19.735805 16260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
mode: GRACEFUL
new_leader_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:43788
I20260709 12:08:19.736373 16260 raft_consensus.cc:606] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Received request to transfer leadership to TS 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:19.746687 16334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
mode: GRACEFUL
new_leader_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:08:19.747189 16334 raft_consensus.cc:606] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Received request to transfer leadership to TS 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:19.748252 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:19.748677 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:19.976236 16508 raft_consensus.cc:993] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a: : Instructing follower 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:19.976683 16554 raft_consensus.cc:1081] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Signalling peer 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:19.978284 16408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9"
dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:56098
I20260709 12:08:19.978765 16408 raft_consensus.cc:493] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.979074 16408 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.983703 16408 raft_consensus.cc:515] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:19.985450 16408 leader_election.cc:290] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 2 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:19.986557 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:19.986500 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:19.987159 16334 raft_consensus.cc:3055] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.987465 16260 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.987522 16334 raft_consensus.cc:740] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:19.988420 16334 consensus_queue.cc:260] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:19.989508 16334 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.994997 16260 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 2.
I20260709 12:08:19.996233 16372 leader_election.cc:304] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:19.997076 16485 raft_consensus.cc:2804] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.996631 16334 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 2.
I20260709 12:08:19.998476 16485 raft_consensus.cc:697] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Becoming Leader. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:19.999346 16485 consensus_queue.cc:237] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:20.006904 16154 catalog_manager.cc:5697] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 reported cstate change: term changed from 1 to 2, leader changed from ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66) to 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "98732c84f5f14689afa96e3ca3c750e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:20.087481 16561 raft_consensus.cc:993] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2: : Instructing follower 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:20.087936 16549 raft_consensus.cc:1081] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Signalling peer 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:20.089721 16408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8"
dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:56086
I20260709 12:08:20.090312 16408 raft_consensus.cc:493] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.090584 16408 raft_consensus.cc:3060] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.094734 16408 raft_consensus.cc:515] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:20.096336 16408 leader_election.cc:290] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 2 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:20.097263 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:20.097586 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:20.097816 16260 raft_consensus.cc:3055] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.098335 16260 raft_consensus.cc:740] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:20.098397 16334 raft_consensus.cc:3060] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.099035 16260 consensus_queue.cc:260] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:20.099946 16260 raft_consensus.cc:3060] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.103772 16334 raft_consensus.cc:2468] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 2.
I20260709 12:08:20.104305 16260 raft_consensus.cc:2468] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 2.
I20260709 12:08:20.104909 16372 leader_election.cc:304] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:20.105686 16485 raft_consensus.cc:2804] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.106194 16485 raft_consensus.cc:697] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Becoming Leader. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:20.106871 16485 consensus_queue.cc:237] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:20.114353 16154 catalog_manager.cc:5697] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 reported cstate change: term changed from 1 to 2, leader changed from 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65) to 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "98732c84f5f14689afa96e3ca3c750e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:20.461673 16334 raft_consensus.cc:1275] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.462906 16485 consensus_queue.cc:1048] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.474082 16260 raft_consensus.cc:1275] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.475332 16565 consensus_queue.cc:1048] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.584656 16260 raft_consensus.cc:1275] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.586055 16565 consensus_queue.cc:1048] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.594704 16334 raft_consensus.cc:1275] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.596401 16485 consensus_queue.cc:1048] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.749601 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:20.755306 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:20.755829 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:21.756888 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:21.763012 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:21.763435 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.764571 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:22.770254 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:22.770717 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:23.771806 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.777202 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:23.777645 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:24.778599 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.783587 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.784034 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.205897 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.274278 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.274952 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:26.494045 16281 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6060 after lost signal to thread 16128
I20260709 12:08:26.547703 16580 raft_consensus.cc:493] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccf30b4a50c74998a673a82478bdbf5a)
I20260709 12:08:26.548652 16580 raft_consensus.cc:515] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:26.560006 16580 leader_election.cc:290] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:26.599521 16554 raft_consensus.cc:493] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e76c69ff1374c6bad8060bb59e584d2)
I20260709 12:08:26.600175 16554 raft_consensus.cc:515] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
W20260709 12:08:26.600443 16372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:43685, user_credentials={real_user=slave}} blocked reactor thread for 71465.3us
I20260709 12:08:26.638631 16554 leader_election.cc:290] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155), 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591)
I20260709 12:08:26.640754 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c332053e81d47cea700ff3259d09587" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:26.643815 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c332053e81d47cea700ff3259d09587" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:26.648263 16580 raft_consensus.cc:493] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccf30b4a50c74998a673a82478bdbf5a)
I20260709 12:08:26.648862 16580 raft_consensus.cc:515] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:26.651248 16580 leader_election.cc:290] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:26.654127 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:26.668673 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:26.679023 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:26.680931 16554 raft_consensus.cc:493] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e76c69ff1374c6bad8060bb59e584d2)
I20260709 12:08:26.681504 16554 raft_consensus.cc:515] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:26.683173 16587 raft_consensus.cc:493] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e76c69ff1374c6bad8060bb59e584d2)
I20260709 12:08:26.683656 16587 raft_consensus.cc:515] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:26.684311 16554 leader_election.cc:290] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:26.685325 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:26.692190 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a" is_pre_election: true
I20260709 12:08:26.698385 16587 leader_election.cc:290] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:26.698976 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2" is_pre_election: true
I20260709 12:08:26.703111 16300 leader_election.cc:304] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccf30b4a50c74998a673a82478bdbf5a; no voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:26.704231 16583 raft_consensus.cc:2749] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:08:26.704389 16372 leader_election.cc:304] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0; no voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a
W20260709 12:08:26.705169 16281 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6740 after lost signal to thread 16191
I20260709 12:08:26.705690 16580 raft_consensus.cc:2749] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:08:26.706274 16281 debug-util.cc:398] Leaking SignalData structure 0x7b08001e40c0 after lost signal to thread 16284
W20260709 12:08:26.707360 16281 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3da0 after lost signal to thread 16359
I20260709 12:08:26.707965 16372 leader_election.cc:304] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0; no voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a
W20260709 12:08:26.708267 16281 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0280 after lost signal to thread 16433
I20260709 12:08:26.709174 16580 raft_consensus.cc:2749] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:08:26.710776 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:26.711704 16409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98732c84f5f14689afa96e3ca3c750e0" is_pre_election: true
I20260709 12:08:26.712129 16300 leader_election.cc:304] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccf30b4a50c74998a673a82478bdbf5a; no voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:26.712873 16583 raft_consensus.cc:2749] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:08:26.713712 16300 leader_election.cc:304] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccf30b4a50c74998a673a82478bdbf5a; no voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:26.714761 16583 raft_consensus.cc:2749] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:08:27.276091 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.282822 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.283427 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.284437 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.290977 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.291380 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.292303 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.297219 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.297971 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.331801 16125 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:30.339224 16260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
mode: GRACEFUL
new_leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:43786
I20260709 12:08:30.339874 16260 raft_consensus.cc:606] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Received request to transfer leadership to TS ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:30.347172 16260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
mode: GRACEFUL
new_leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:43786
I20260709 12:08:30.347642 16260 raft_consensus.cc:606] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Received request to transfer leadership to TS ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:30.353436 16409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8"
dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
mode: GRACEFUL
new_leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:56110
I20260709 12:08:30.354023 16409 raft_consensus.cc:606] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Received request to transfer leadership to TS ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:30.359988 16260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
mode: GRACEFUL
new_leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:43786
I20260709 12:08:30.360435 16260 raft_consensus.cc:606] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Received request to transfer leadership to TS ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:30.372079 16409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9"
dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
mode: GRACEFUL
new_leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:56110
I20260709 12:08:30.372643 16409 raft_consensus.cc:606] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Received request to transfer leadership to TS ccf30b4a50c74998a673a82478bdbf5a
I20260709 12:08:30.402604 16588 raft_consensus.cc:993] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0: : Instructing follower ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.403055 16585 raft_consensus.cc:1081] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Signalling peer ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.404721 16335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:45228
I20260709 12:08:30.405207 16335 raft_consensus.cc:493] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:30.405481 16335 raft_consensus.cc:3060] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.410974 16335 raft_consensus.cc:515] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.412717 16335 leader_election.cc:290] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:30.413789 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:30.413926 16409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58031efc6b9143d8a65d4e1847b4dbd8" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:30.414405 16260 raft_consensus.cc:3060] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.414515 16409 raft_consensus.cc:3055] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:30.414839 16409 raft_consensus.cc:740] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:30.415586 16409 consensus_queue.cc:260] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.416596 16409 raft_consensus.cc:3060] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.419549 16260 raft_consensus.cc:2468] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.420953 16298 leader_election.cc:304] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:30.421667 16409 raft_consensus.cc:2468] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.421854 16583 raft_consensus.cc:2804] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:30.423120 16583 raft_consensus.cc:697] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:30.423957 16583 consensus_queue.cc:237] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.429535 16591 raft_consensus.cc:993] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2: : Instructing follower ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.430141 16578 raft_consensus.cc:1081] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Signalling peer ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.431571 16335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:45236
I20260709 12:08:30.432121 16335 raft_consensus.cc:493] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:30.432492 16335 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.435298 16591 raft_consensus.cc:993] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2: : Instructing follower ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.436012 16591 raft_consensus.cc:1081] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Signalling peer ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.435786 16156 catalog_manager.cc:5697] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 2 to 3, leader changed from 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67) to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 3 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:30.437765 16334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:45236
I20260709 12:08:30.438387 16334 raft_consensus.cc:493] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:30.438335 16335 raft_consensus.cc:515] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.438832 16334 raft_consensus.cc:3060] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.443724 16334 raft_consensus.cc:515] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:30.445770 16334 leader_election.cc:290] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Requested vote from peers 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155), 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591)
I20260709 12:08:30.445773 16335 leader_election.cc:290] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:30.448020 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:30.448201 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:30.448596 16260 raft_consensus.cc:3055] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:30.448742 16259 raft_consensus.cc:3055] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:30.448673 16409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd3b03b94f743f38807408bb0cae94d" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:30.448937 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:30.449085 16260 raft_consensus.cc:740] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:30.449225 16259 raft_consensus.cc:740] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:30.449455 16409 raft_consensus.cc:3060] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.449548 16408 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.449963 16260 consensus_queue.cc:260] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.450119 16259 consensus_queue.cc:260] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:30.451237 16260 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.451401 16259 raft_consensus.cc:3060] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.456902 16409 raft_consensus.cc:2468] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.457000 16408 raft_consensus.cc:2468] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.458228 16300 leader_election.cc:304] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:30.458576 16260 raft_consensus.cc:2468] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.458932 16259 raft_consensus.cc:2468] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.459594 16583 raft_consensus.cc:2804] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:30.460085 16583 raft_consensus.cc:697] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:30.459312 16300 leader_election.cc:304] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:30.461512 16589 raft_consensus.cc:2804] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:30.461083 16583 consensus_queue.cc:237] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } }
I20260709 12:08:30.463729 16589 raft_consensus.cc:697] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:30.464789 16589 consensus_queue.cc:237] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.472692 16156 catalog_manager.cc:5697] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 2 to 3, leader changed from 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65) to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 3 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:30.473956 16156 catalog_manager.cc:5697] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 2 to 3, leader changed from 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65) to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 3 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:30.537563 16578 raft_consensus.cc:993] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2: : Instructing follower ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.538156 16591 raft_consensus.cc:1081] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Signalling peer ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.540165 16334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:45236
I20260709 12:08:30.540647 16334 raft_consensus.cc:493] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:30.540905 16334 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.544963 16334 raft_consensus.cc:515] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.547042 16334 leader_election.cc:290] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:30.547984 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:30.548207 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:30.548594 16260 raft_consensus.cc:3055] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:30.548686 16408 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.548931 16260 raft_consensus.cc:740] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:30.549671 16260 consensus_queue.cc:260] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.550891 16260 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.555413 16408 raft_consensus.cc:2468] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.557015 16260 raft_consensus.cc:2468] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.556870 16300 leader_election.cc:304] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98732c84f5f14689afa96e3ca3c750e0, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:30.558247 16589 raft_consensus.cc:2804] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:30.558806 16589 raft_consensus.cc:697] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:30.559628 16589 consensus_queue.cc:237] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.567446 16156 catalog_manager.cc:5697] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 2 to 3, leader changed from 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65) to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 3 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:30.743764 16588 raft_consensus.cc:993] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0: : Instructing follower ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.744186 16588 raft_consensus.cc:1081] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Signalling peer ccf30b4a50c74998a673a82478bdbf5a to start an election
I20260709 12:08:30.745707 16334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
 from {username='slave'} at 127.0.0.1:45228
I20260709 12:08:30.746235 16334 raft_consensus.cc:493] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:30.746510 16334 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.750671 16334 raft_consensus.cc:515] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.752133 16334 leader_election.cc:290] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:30.753127 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:30.753118 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "ccf30b4a50c74998a673a82478bdbf5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:30.753625 16408 raft_consensus.cc:3055] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:30.753931 16408 raft_consensus.cc:740] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:30.754047 16260 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.754634 16408 consensus_queue.cc:260] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.755573 16408 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:30.758800 16260 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.759593 16408 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf30b4a50c74998a673a82478bdbf5a in term 3.
I20260709 12:08:30.760041 16298 leader_election.cc:304] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, ccf30b4a50c74998a673a82478bdbf5a; no voters: 
I20260709 12:08:30.760973 16589 raft_consensus.cc:2804] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:30.761474 16589 raft_consensus.cc:697] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Becoming Leader. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:30.762352 16589 consensus_queue.cc:237] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:30.769565 16156 catalog_manager.cc:5697] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a reported cstate change: term changed from 2 to 3, leader changed from 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67) to ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66). New cstate: current_term: 3 leader_uuid: "ccf30b4a50c74998a673a82478bdbf5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:30.872051 16260 raft_consensus.cc:1275] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:30.873241 16589 consensus_queue.cc:1048] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:30.887095 16408 raft_consensus.cc:1275] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:30.888556 16583 consensus_queue.cc:1048] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:30.891891 16260 raft_consensus.cc:1275] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:30.893290 16583 consensus_queue.cc:1048] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:30.906250 16408 raft_consensus.cc:1275] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:30.908506 16596 consensus_queue.cc:1048] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:31.011016 16408 raft_consensus.cc:1275] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.012282 16596 consensus_queue.cc:1048] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:31.019145 16260 raft_consensus.cc:1275] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.020654 16583 consensus_queue.cc:1048] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:31.024585 16260 raft_consensus.cc:1275] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.026893 16583 consensus_queue.cc:1048] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:31.033442 16408 raft_consensus.cc:1275] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.035068 16596 consensus_queue.cc:1048] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:31.162326 16408 raft_consensus.cc:1275] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.163677 16583 consensus_queue.cc:1048] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:31.173151 16260 raft_consensus.cc:1275] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Refusing update from remote peer ccf30b4a50c74998a673a82478bdbf5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.174584 16583 consensus_queue.cc:1048] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.415064 16125 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:33.416213 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:33.424789 16334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
mode: GRACEFUL
new_leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:08:33.425695 16334 raft_consensus.cc:606] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Received request to transfer leadership to TS 5e76c69ff1374c6bad8060bb59e584d2
I20260709 12:08:33.429615 16334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
mode: GRACEFUL
new_leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:08:33.430153 16334 raft_consensus.cc:606] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Received request to transfer leadership to TS 5e76c69ff1374c6bad8060bb59e584d2
I20260709 12:08:33.433229 16334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
mode: GRACEFUL
new_leader_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:08:33.433934 16334 raft_consensus.cc:606] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Received request to transfer leadership to TS 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:33.437558 16334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
mode: GRACEFUL
new_leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:08:33.438071 16334 raft_consensus.cc:606] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 2 LEADER]: Received request to transfer leadership to TS 5e76c69ff1374c6bad8060bb59e584d2
I20260709 12:08:33.440657 16334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9"
dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
mode: GRACEFUL
new_leader_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:08:33.441133 16334 raft_consensus.cc:606] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Received request to transfer leadership to TS 98732c84f5f14689afa96e3ca3c750e0
I20260709 12:08:33.442342 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:33.442796 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:33.483119 16583 raft_consensus.cc:993] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a: : Instructing follower 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:33.483588 16583 raft_consensus.cc:1081] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Signalling peer 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:33.485229 16409 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec"
dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:56098
I20260709 12:08:33.485754 16409 raft_consensus.cc:493] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.486089 16409 raft_consensus.cc:3060] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:33.494222 16409 raft_consensus.cc:515] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.496523 16409 leader_election.cc:290] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 2 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:33.497797 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:33.498136 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5b8de7db5c4361b136094be74071ec" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:33.498675 16334 raft_consensus.cc:3055] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:33.498646 16260 raft_consensus.cc:3060] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:33.499116 16334 raft_consensus.cc:740] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:33.500032 16334 consensus_queue.cc:260] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.501360 16334 raft_consensus.cc:3060] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:33.506642 16260 raft_consensus.cc:2468] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 2.
I20260709 12:08:33.508072 16372 leader_election.cc:304] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:33.508277 16334 raft_consensus.cc:2468] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 2.
I20260709 12:08:33.508903 16588 raft_consensus.cc:2804] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:33.510215 16588 raft_consensus.cc:697] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Becoming Leader. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:33.511157 16588 consensus_queue.cc:237] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.519733 16156 catalog_manager.cc:5697] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 reported cstate change: term changed from 1 to 2, leader changed from ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66) to 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "98732c84f5f14689afa96e3ca3c750e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:33.713022 16589 raft_consensus.cc:993] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a: : Instructing follower 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:33.713450 16589 raft_consensus.cc:1081] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Signalling peer 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:33.714785 16260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:08:33.715221 16260 raft_consensus.cc:493] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.715495 16260 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.719664 16260 raft_consensus.cc:515] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.721504 16260 leader_election.cc:290] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 4 election: Requested vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:33.722674 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:33.722687 16409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c10bcac3b4624a57d6fdfa5a22f54" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:33.723254 16334 raft_consensus.cc:3055] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:33.723304 16409 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.723534 16334 raft_consensus.cc:740] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:33.724231 16334 consensus_queue.cc:260] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.725149 16334 raft_consensus.cc:3060] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.729068 16409 raft_consensus.cc:2468] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 4.
I20260709 12:08:33.730180 16334 raft_consensus.cc:2468] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 4.
I20260709 12:08:33.730293 16225 leader_election.cc:304] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:33.732244 16623 raft_consensus.cc:2804] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:33.733306 16623 raft_consensus.cc:697] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:33.734047 16623 consensus_queue.cc:237] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.740921 16156 catalog_manager.cc:5697] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 reported cstate change: term changed from 3 to 4, leader changed from ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66) to 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65). New cstate: current_term: 4 leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.754586 16583 raft_consensus.cc:993] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a: : Instructing follower 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:33.755002 16589 raft_consensus.cc:1081] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 2 LEADER]: Signalling peer 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:33.756295 16260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:08:33.756685 16260 raft_consensus.cc:493] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.756911 16260 raft_consensus.cc:3060] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.761204 16260 raft_consensus.cc:515] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.762596 16260 leader_election.cc:290] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 3 election: Requested vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:33.763480 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:33.763589 16409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc2c279910b4501b6be7ac7c1e67dcc" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:33.763968 16334 raft_consensus.cc:3055] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:33.764093 16409 raft_consensus.cc:3060] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.764223 16334 raft_consensus.cc:740] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:33.764910 16334 consensus_queue.cc:260] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.765849 16334 raft_consensus.cc:3060] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.768924 16409 raft_consensus.cc:2468] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 3.
I20260709 12:08:33.770306 16225 leader_election.cc:304] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:33.770750 16334 raft_consensus.cc:2468] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 3.
I20260709 12:08:33.771121 16623 raft_consensus.cc:2804] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:33.771554 16623 raft_consensus.cc:697] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:33.772393 16623 consensus_queue.cc:237] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.779762 16156 catalog_manager.cc:5697] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 reported cstate change: term changed from 2 to 3, leader changed from ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66) to 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.819250 16583 raft_consensus.cc:993] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a: : Instructing follower 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:33.819653 16589 raft_consensus.cc:1081] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Signalling peer 98732c84f5f14689afa96e3ca3c750e0 to start an election
I20260709 12:08:33.821071 16409 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9"
dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
 from {username='slave'} at 127.0.0.1:56098
I20260709 12:08:33.821503 16409 raft_consensus.cc:493] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.821760 16409 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.826442 16409 raft_consensus.cc:515] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.828034 16409 leader_election.cc:290] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 4 election: Requested vote from peers 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591), ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685)
I20260709 12:08:33.829025 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
I20260709 12:08:33.829319 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caac123abc2b422fa04d7a3f250fb9f9" candidate_uuid: "98732c84f5f14689afa96e3ca3c750e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:33.829556 16260 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.829800 16334 raft_consensus.cc:3055] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:33.830144 16334 raft_consensus.cc:740] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:33.830773 16334 consensus_queue.cc:260] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.831602 16334 raft_consensus.cc:3060] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.833990 16260 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 4.
I20260709 12:08:33.835177 16372 leader_election.cc:304] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:33.835848 16588 raft_consensus.cc:2804] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:33.836239 16588 raft_consensus.cc:697] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 LEADER]: Becoming Leader. State: Replica: 98732c84f5f14689afa96e3ca3c750e0, State: Running, Role: LEADER
I20260709 12:08:33.837056 16334 raft_consensus.cc:2468] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98732c84f5f14689afa96e3ca3c750e0 in term 4.
I20260709 12:08:33.837121 16588 consensus_queue.cc:237] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:33.844439 16156 catalog_manager.cc:5697] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 reported cstate change: term changed from 3 to 4, leader changed from ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66) to 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67). New cstate: current_term: 4 leader_uuid: "98732c84f5f14689afa96e3ca3c750e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:34.021375 16583 raft_consensus.cc:993] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a: : Instructing follower 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:34.022632 16589 raft_consensus.cc:1081] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Signalling peer 5e76c69ff1374c6bad8060bb59e584d2 to start an election
I20260709 12:08:34.024185 16260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6"
dest_uuid: "5e76c69ff1374c6bad8060bb59e584d2"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:08:34.024698 16260 raft_consensus.cc:493] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.024964 16260 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.029271 16260 raft_consensus.cc:515] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:34.031018 16260 leader_election.cc:290] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 4 election: Requested vote from peers ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685), 98732c84f5f14689afa96e3ca3c750e0 (127.15.191.67:36155)
I20260709 12:08:34.031927 16334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ccf30b4a50c74998a673a82478bdbf5a"
I20260709 12:08:34.032030 16409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e66bf165f274349a3f4a2c10b6dfff6" candidate_uuid: "5e76c69ff1374c6bad8060bb59e584d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "98732c84f5f14689afa96e3ca3c750e0"
I20260709 12:08:34.032406 16334 raft_consensus.cc:3055] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:34.032646 16409 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.032724 16334 raft_consensus.cc:740] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccf30b4a50c74998a673a82478bdbf5a, State: Running, Role: LEADER
I20260709 12:08:34.033464 16334 consensus_queue.cc:260] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:34.034319 16334 raft_consensus.cc:3060] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.037439 16409 raft_consensus.cc:2468] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 4.
I20260709 12:08:34.038533 16225 leader_election.cc:304] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e76c69ff1374c6bad8060bb59e584d2, 98732c84f5f14689afa96e3ca3c750e0; no voters: 
I20260709 12:08:34.039023 16334 raft_consensus.cc:2468] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e76c69ff1374c6bad8060bb59e584d2 in term 4.
I20260709 12:08:34.039203 16623 raft_consensus.cc:2804] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:34.039713 16623 raft_consensus.cc:697] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e76c69ff1374c6bad8060bb59e584d2, State: Running, Role: LEADER
I20260709 12:08:34.040585 16623 consensus_queue.cc:237] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } }
I20260709 12:08:34.048249 16156 catalog_manager.cc:5697] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 reported cstate change: term changed from 3 to 4, leader changed from ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66) to 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65). New cstate: current_term: 4 leader_uuid: "5e76c69ff1374c6bad8060bb59e584d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.054972 16334 raft_consensus.cc:1275] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:34.056593 16588 consensus_queue.cc:1048] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:34.068385 16260 raft_consensus.cc:1275] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:34.070753 16588 consensus_queue.cc:1048] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:34.158420 16409 raft_consensus.cc:1275] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:34.159631 16623 consensus_queue.cc:1048] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:34.169804 16334 raft_consensus.cc:1275] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:34.171418 16623 consensus_queue.cc:1048] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:34.202265 16409 raft_consensus.cc:1275] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.203540 16623 consensus_queue.cc:1048] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:34.214679 16334 raft_consensus.cc:1275] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.216673 16624 consensus_queue.cc:1048] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:34.300807 16334 raft_consensus.cc:1275] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.301920 16588 consensus_queue.cc:1048] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:34.310432 16260 raft_consensus.cc:1275] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Refusing update from remote peer 98732c84f5f14689afa96e3ca3c750e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.312580 16617 consensus_queue.cc:1048] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e76c69ff1374c6bad8060bb59e584d2" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 40591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:34.444028 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:34.448853 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:34.449301 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:34.485773 16334 raft_consensus.cc:1275] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.487012 16624 consensus_queue.cc:1048] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf30b4a50c74998a673a82478bdbf5a" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:34.495952 16409 raft_consensus.cc:1275] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Refusing update from remote peer 5e76c69ff1374c6bad8060bb59e584d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.497579 16636 consensus_queue.cc:1048] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98732c84f5f14689afa96e3ca3c750e0" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:35.451166 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:35.456830 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:35.457284 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:36.458482 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.463265 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:36.463676 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.464625 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.469354 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.469784 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.470821 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.475759 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.476166 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.477190 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.482710 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.483119 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.484160 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.489193 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.489645 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.490715 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.495631 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.496052 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.497094 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.504395 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.504913 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.534981 16125 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:43.535573 16125 tablet_server.cc:179] TabletServer@127.15.191.65:0 shutting down...
I20260709 12:08:43.563920 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:43.564764 16125 tablet_replica.cc:333] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2: stopping tablet replica
I20260709 12:08:43.565536 16125 raft_consensus.cc:2243] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.566177 16125 raft_consensus.cc:2272] T 5c332053e81d47cea700ff3259d09587 P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.568409 16125 tablet_replica.cc:333] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2: stopping tablet replica
I20260709 12:08:43.568933 16125 raft_consensus.cc:2243] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.569373 16125 raft_consensus.cc:2272] T caac123abc2b422fa04d7a3f250fb9f9 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.571070 16125 tablet_replica.cc:333] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2: stopping tablet replica
I20260709 12:08:43.571559 16125 raft_consensus.cc:2243] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.572009 16125 raft_consensus.cc:2272] T 8f5b8de7db5c4361b136094be74071ec P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.573665 16125 tablet_replica.cc:333] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2: stopping tablet replica
I20260709 12:08:43.574219 16125 raft_consensus.cc:2243] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.574628 16125 raft_consensus.cc:2272] T 005d85ad9d8841fd9593113d5885ea0f P 5e76c69ff1374c6bad8060bb59e584d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.576448 16125 tablet_replica.cc:333] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2: stopping tablet replica
I20260709 12:08:43.577054 16125 raft_consensus.cc:2243] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:43.577883 16125 raft_consensus.cc:2272] T 0e66bf165f274349a3f4a2c10b6dfff6 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.579735 16125 tablet_replica.cc:333] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2: stopping tablet replica
I20260709 12:08:43.580178 16125 raft_consensus.cc:2243] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.580570 16125 raft_consensus.cc:2272] T 58031efc6b9143d8a65d4e1847b4dbd8 P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.582173 16125 tablet_replica.cc:333] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2: stopping tablet replica
I20260709 12:08:43.582628 16125 raft_consensus.cc:2243] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:43.583405 16125 raft_consensus.cc:2272] T 480c10bcac3b4624a57d6fdfa5a22f54 P 5e76c69ff1374c6bad8060bb59e584d2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.584933 16125 tablet_replica.cc:333] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2: stopping tablet replica
I20260709 12:08:43.585350 16125 raft_consensus.cc:2243] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:43.586057 16125 raft_consensus.cc:2272] T 9dc2c279910b4501b6be7ac7c1e67dcc P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.588037 16125 tablet_replica.cc:333] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2: stopping tablet replica
I20260709 12:08:43.588449 16125 raft_consensus.cc:2243] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.588824 16125 raft_consensus.cc:2272] T dcd3b03b94f743f38807408bb0cae94d P 5e76c69ff1374c6bad8060bb59e584d2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:43.672627 16372 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:40591: connect: Connection refused (error 111)
W20260709 12:08:43.676352 16372 consensus_peers.cc:597] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 -> Peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Couldn't send request to peer 5e76c69ff1374c6bad8060bb59e584d2. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:40591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:43.684544 16372 consensus_peers.cc:597] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 -> Peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Couldn't send request to peer 5e76c69ff1374c6bad8060bb59e584d2. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:40591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:43.689721 16372 consensus_peers.cc:597] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 -> Peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Couldn't send request to peer 5e76c69ff1374c6bad8060bb59e584d2. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:40591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:43.694141 16125 tablet_server.cc:196] TabletServer@127.15.191.65:0 shutdown complete.
W20260709 12:08:43.715039 16298 consensus_peers.cc:597] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a -> Peer 5e76c69ff1374c6bad8060bb59e584d2 (127.15.191.65:40591): Couldn't send request to peer 5e76c69ff1374c6bad8060bb59e584d2. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:40591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:43.719102 16125 tablet_server.cc:179] TabletServer@127.15.191.66:0 shutting down...
W20260709 12:08:43.740528 16372 consensus_peers.cc:597] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 -> Peer ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685): Couldn't send request to peer ccf30b4a50c74998a673a82478bdbf5a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:43.745397 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:43.746156 16125 tablet_replica.cc:333] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a: stopping tablet replica
I20260709 12:08:43.746969 16125 raft_consensus.cc:2243] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:43.747917 16125 raft_consensus.cc:2272] T 5c332053e81d47cea700ff3259d09587 P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.749842 16125 tablet_replica.cc:333] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a: stopping tablet replica
I20260709 12:08:43.750455 16125 raft_consensus.cc:2243] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.750851 16125 raft_consensus.cc:2272] T 005d85ad9d8841fd9593113d5885ea0f P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.752590 16125 tablet_replica.cc:333] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a: stopping tablet replica
I20260709 12:08:43.753082 16125 raft_consensus.cc:2243] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.753507 16125 raft_consensus.cc:2272] T caac123abc2b422fa04d7a3f250fb9f9 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.755203 16125 tablet_replica.cc:333] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a: stopping tablet replica
I20260709 12:08:43.755705 16125 raft_consensus.cc:2243] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.756072 16125 raft_consensus.cc:2272] T 8f5b8de7db5c4361b136094be74071ec P ccf30b4a50c74998a673a82478bdbf5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.757893 16125 tablet_replica.cc:333] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a: stopping tablet replica
I20260709 12:08:43.758459 16125 raft_consensus.cc:2243] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.758882 16125 raft_consensus.cc:2272] T 480c10bcac3b4624a57d6fdfa5a22f54 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.760684 16125 tablet_replica.cc:333] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a: stopping tablet replica
I20260709 12:08:43.761193 16125 raft_consensus.cc:2243] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.761624 16125 raft_consensus.cc:2272] T 9dc2c279910b4501b6be7ac7c1e67dcc P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.763598 16125 tablet_replica.cc:333] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a: stopping tablet replica
I20260709 12:08:43.764122 16125 raft_consensus.cc:2243] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:43.764897 16125 raft_consensus.cc:2272] T 58031efc6b9143d8a65d4e1847b4dbd8 P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.766580 16125 tablet_replica.cc:333] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a: stopping tablet replica
I20260709 12:08:43.767030 16125 raft_consensus.cc:2243] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.767431 16125 raft_consensus.cc:2272] T 0e66bf165f274349a3f4a2c10b6dfff6 P ccf30b4a50c74998a673a82478bdbf5a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.769027 16125 tablet_replica.cc:333] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a: stopping tablet replica
I20260709 12:08:43.769443 16125 raft_consensus.cc:2243] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:43.770272 16125 raft_consensus.cc:2272] T dcd3b03b94f743f38807408bb0cae94d P ccf30b4a50c74998a673a82478bdbf5a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.799289 16125 tablet_server.cc:196] TabletServer@127.15.191.66:0 shutdown complete.
W20260709 12:08:43.803336 16372 consensus_peers.cc:597] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 -> Peer ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685): Couldn't send request to peer ccf30b4a50c74998a673a82478bdbf5a. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:43685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:43.819344 16125 tablet_server.cc:179] TabletServer@127.15.191.67:0 shutting down...
I20260709 12:08:43.845122 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:43.846036 16125 tablet_replica.cc:333] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0: stopping tablet replica
I20260709 12:08:43.846903 16125 raft_consensus.cc:2243] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:43.847872 16125 raft_consensus.cc:2272] T 005d85ad9d8841fd9593113d5885ea0f P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:43.848510 16372 consensus_peers.cc:597] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 -> Peer ccf30b4a50c74998a673a82478bdbf5a (127.15.191.66:43685): Couldn't send request to peer ccf30b4a50c74998a673a82478bdbf5a. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:43685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:43.849956 16125 tablet_replica.cc:333] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0: stopping tablet replica
I20260709 12:08:43.850539 16125 raft_consensus.cc:2243] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.850978 16125 raft_consensus.cc:2272] T 5c332053e81d47cea700ff3259d09587 P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.852622 16125 tablet_replica.cc:333] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0: stopping tablet replica
I20260709 12:08:43.853121 16125 raft_consensus.cc:2243] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.853533 16125 raft_consensus.cc:2272] T 0e66bf165f274349a3f4a2c10b6dfff6 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.855237 16125 tablet_replica.cc:333] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0: stopping tablet replica
I20260709 12:08:43.855756 16125 raft_consensus.cc:2243] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.856161 16125 raft_consensus.cc:2272] T 58031efc6b9143d8a65d4e1847b4dbd8 P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.857969 16125 tablet_replica.cc:333] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0: stopping tablet replica
I20260709 12:08:43.858527 16125 raft_consensus.cc:2243] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.859004 16125 raft_consensus.cc:2272] T 9dc2c279910b4501b6be7ac7c1e67dcc P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.860716 16125 tablet_replica.cc:333] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0: stopping tablet replica
I20260709 12:08:43.861229 16125 raft_consensus.cc:2243] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.861675 16125 raft_consensus.cc:2272] T 480c10bcac3b4624a57d6fdfa5a22f54 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.863324 16125 tablet_replica.cc:333] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0: stopping tablet replica
I20260709 12:08:43.863794 16125 raft_consensus.cc:2243] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:43.864192 16125 raft_consensus.cc:2272] T dcd3b03b94f743f38807408bb0cae94d P 98732c84f5f14689afa96e3ca3c750e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.865813 16125 tablet_replica.cc:333] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0: stopping tablet replica
I20260709 12:08:43.866333 16125 raft_consensus.cc:2243] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:43.867100 16125 raft_consensus.cc:2272] T caac123abc2b422fa04d7a3f250fb9f9 P 98732c84f5f14689afa96e3ca3c750e0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.868673 16125 tablet_replica.cc:333] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0: stopping tablet replica
I20260709 12:08:43.869091 16125 raft_consensus.cc:2243] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:43.869820 16125 raft_consensus.cc:2272] T 8f5b8de7db5c4361b136094be74071ec P 98732c84f5f14689afa96e3ca3c750e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:43.896979 16125 tablet_server.cc:196] TabletServer@127.15.191.67:0 shutdown complete.
I20260709 12:08:43.915390 16125 master.cc:562] Master@127.15.191.126:37165 shutting down...
I20260709 12:08:44.064246 16125 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:44.064839 16125 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:44.065161 16125 tablet_replica.cc:333] T 00000000000000000000000000000000 P 185b27f3b6414735b4f7a01579678bcb: stopping tablet replica
I20260709 12:08:44.084759 16125 master.cc:584] Master@127.15.191.126:37165 shutdown complete.
5e76c69ff1374c6bad8060bb59e584d2  4
98732c84f5f14689afa96e3ca3c750e0  1
ccf30b4a50c74998a673a82478bdbf5a  4
5e76c69ff1374c6bad8060bb59e584d2  3
98732c84f5f14689afa96e3ca3c750e0  3
ccf30b4a50c74998a673a82478bdbf5a  3
5e76c69ff1374c6bad8060bb59e584d2  0
98732c84f5f14689afa96e3ca3c750e0  1
ccf30b4a50c74998a673a82478bdbf5a  8
5e76c69ff1374c6bad8060bb59e584d2  3
98732c84f5f14689afa96e3ca3c750e0  3
ccf30b4a50c74998a673a82478bdbf5a  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31576 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:44.125721 16125 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.191.126:41955
I20260709 12:08:44.126967 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:44.132565 16657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:44.132575 16658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:44.134047 16660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:44.135036 16125 server_base.cc:1061] running on GCE node
I20260709 12:08:44.135959 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:44.136158 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:44.136319 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598924136300 us; error 0 us; skew 500 ppm
I20260709 12:08:44.136843 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:44.139321 16125 webserver.cc:533] Webserver started at http://127.15.191.126:34727/ using document root <none> and password file <none>
I20260709 12:08:44.139820 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:44.139997 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:44.140255 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:44.141400 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/master-0-root/instance:
uuid: "72f06c3e9b94494c94dcb01eee54bb51"
format_stamp: "Formatted at 2026-07-09 12:08:44 on dist-test-slave-1sdq"
I20260709 12:08:44.146232 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:44.149730 16665 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.150569 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:08:44.150823 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/master-0-root
uuid: "72f06c3e9b94494c94dcb01eee54bb51"
format_stamp: "Formatted at 2026-07-09 12:08:44 on dist-test-slave-1sdq"
I20260709 12:08:44.151109 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:44.177870 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:44.179167 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:44.218475 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.126:41955
I20260709 12:08:44.218557 16716 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.126:41955 every 8 connection(s)
I20260709 12:08:44.222402 16717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.232299 16717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51: Bootstrap starting.
I20260709 12:08:44.237010 16717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:44.241211 16717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51: No bootstrap required, opened a new log
I20260709 12:08:44.243459 16717 raft_consensus.cc:359] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f06c3e9b94494c94dcb01eee54bb51" member_type: VOTER }
I20260709 12:08:44.243898 16717 raft_consensus.cc:385] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:44.244079 16717 raft_consensus.cc:740] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f06c3e9b94494c94dcb01eee54bb51, State: Initialized, Role: FOLLOWER
I20260709 12:08:44.244546 16717 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f06c3e9b94494c94dcb01eee54bb51" member_type: VOTER }
I20260709 12:08:44.244977 16717 raft_consensus.cc:399] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:44.245173 16717 raft_consensus.cc:493] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:44.245378 16717 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:44.249297 16717 raft_consensus.cc:515] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f06c3e9b94494c94dcb01eee54bb51" member_type: VOTER }
I20260709 12:08:44.249804 16717 leader_election.cc:304] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72f06c3e9b94494c94dcb01eee54bb51; no voters: 
I20260709 12:08:44.250865 16717 leader_election.cc:290] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:44.251258 16720 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:44.252588 16720 raft_consensus.cc:697] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 1 LEADER]: Becoming Leader. State: Replica: 72f06c3e9b94494c94dcb01eee54bb51, State: Running, Role: LEADER
I20260709 12:08:44.253384 16720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f06c3e9b94494c94dcb01eee54bb51" member_type: VOTER }
I20260709 12:08:44.253795 16717 sys_catalog.cc:565] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:44.258342 16721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72f06c3e9b94494c94dcb01eee54bb51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f06c3e9b94494c94dcb01eee54bb51" member_type: VOTER } }
I20260709 12:08:44.258451 16722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72f06c3e9b94494c94dcb01eee54bb51. Latest consensus state: current_term: 1 leader_uuid: "72f06c3e9b94494c94dcb01eee54bb51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f06c3e9b94494c94dcb01eee54bb51" member_type: VOTER } }
I20260709 12:08:44.259203 16721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:44.259258 16722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:44.261917 16728 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:44.267132 16728 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:44.275127 16125 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:44.277381 16728 catalog_manager.cc:1383] Generated new cluster ID: 4980f9e31c6343f7ab759f83878910fe
I20260709 12:08:44.277657 16728 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:44.300177 16728 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:44.301380 16728 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:44.312202 16728 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51: Generated new TSK 0
I20260709 12:08:44.312788 16728 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:44.342217 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:44.348068 16738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:44.349232 16739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:44.351861 16125 server_base.cc:1061] running on GCE node
W20260709 12:08:44.351895 16741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:44.353232 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:44.353446 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:44.353626 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598924353605 us; error 0 us; skew 500 ppm
I20260709 12:08:44.354315 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:44.357110 16125 webserver.cc:533] Webserver started at http://127.15.191.65:40113/ using document root <none> and password file <none>
I20260709 12:08:44.357652 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:44.357833 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:44.358155 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:44.359263 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-0-root/instance:
uuid: "d9a757f7aa4749f48d654f66c27b5bad"
format_stamp: "Formatted at 2026-07-09 12:08:44 on dist-test-slave-1sdq"
I20260709 12:08:44.364192 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:44.367627 16746 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.368350 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:08:44.368649 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "d9a757f7aa4749f48d654f66c27b5bad"
format_stamp: "Formatted at 2026-07-09 12:08:44 on dist-test-slave-1sdq"
I20260709 12:08:44.368950 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:44.384776 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:44.386055 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:44.387549 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:44.389848 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:44.390054 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.390331 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:44.390499 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.432381 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:38619
I20260709 12:08:44.432507 16808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:38619 every 8 connection(s)
I20260709 12:08:44.437916 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:44.446439 16813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:44.448212 16814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:44.451207 16125 server_base.cc:1061] running on GCE node
W20260709 12:08:44.451185 16816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:44.453019 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:44.453264 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:44.453454 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598924453436 us; error 0 us; skew 500 ppm
I20260709 12:08:44.453922 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:44.456670 16125 webserver.cc:533] Webserver started at http://127.15.191.66:45103/ using document root <none> and password file <none>
I20260709 12:08:44.457365 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:44.457553 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:44.457806 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:44.458060 16809 heartbeater.cc:344] Connected to a master server at 127.15.191.126:41955
I20260709 12:08:44.458490 16809 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:44.459358 16809 heartbeater.cc:507] Master 127.15.191.126:41955 requested a full tablet report, sending...
I20260709 12:08:44.459326 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-1-root/instance:
uuid: "f2d90bf245754935965fe9bbd57f3af7"
format_stamp: "Formatted at 2026-07-09 12:08:44 on dist-test-slave-1sdq"
I20260709 12:08:44.461824 16682 ts_manager.cc:194] Registered new tserver with Master: d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619)
I20260709 12:08:44.463936 16682 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50054
I20260709 12:08:44.464627 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:08:44.468298 16821 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.469090 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:44.469435 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-1-root
uuid: "f2d90bf245754935965fe9bbd57f3af7"
format_stamp: "Formatted at 2026-07-09 12:08:44 on dist-test-slave-1sdq"
I20260709 12:08:44.469734 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:44.493328 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:44.494612 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:44.496078 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:44.498375 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:44.498589 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.498816 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:44.498967 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.539032 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.66:45109
I20260709 12:08:44.539155 16883 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.66:45109 every 8 connection(s)
I20260709 12:08:44.543596 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:44.550897 16887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:44.551478 16888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:44.554576 16890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:44.555346 16125 server_base.cc:1061] running on GCE node
I20260709 12:08:44.556385 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:44.556572 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:44.556695 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598924556685 us; error 0 us; skew 500 ppm
I20260709 12:08:44.557124 16884 heartbeater.cc:344] Connected to a master server at 127.15.191.126:41955
I20260709 12:08:44.557292 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:44.557420 16884 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:44.558365 16884 heartbeater.cc:507] Master 127.15.191.126:41955 requested a full tablet report, sending...
I20260709 12:08:44.559837 16125 webserver.cc:533] Webserver started at http://127.15.191.67:42005/ using document root <none> and password file <none>
I20260709 12:08:44.560339 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:44.560525 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:44.560532 16682 ts_manager.cc:194] Registered new tserver with Master: f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:44.560845 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:44.561973 16682 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50056
I20260709 12:08:44.562006 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-2-root/instance:
uuid: "323b92b05053418fbfbe5a62fac3832c"
format_stamp: "Formatted at 2026-07-09 12:08:44 on dist-test-slave-1sdq"
I20260709 12:08:44.566828 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:08:44.570240 16895 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.571020 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:08:44.571313 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-2-root
uuid: "323b92b05053418fbfbe5a62fac3832c"
format_stamp: "Formatted at 2026-07-09 12:08:44 on dist-test-slave-1sdq"
I20260709 12:08:44.571650 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598892377095-16125-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:44.584048 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:44.585199 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:44.586660 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:44.588881 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:44.589083 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.589327 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:44.589476 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:44.628242 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.67:35815
I20260709 12:08:44.628324 16957 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.67:35815 every 8 connection(s)
I20260709 12:08:44.642300 16958 heartbeater.cc:344] Connected to a master server at 127.15.191.126:41955
I20260709 12:08:44.642658 16958 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:44.643355 16958 heartbeater.cc:507] Master 127.15.191.126:41955 requested a full tablet report, sending...
I20260709 12:08:44.645342 16682 ts_manager.cc:194] Registered new tserver with Master: 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:44.646003 16125 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014706602s
I20260709 12:08:44.646724 16682 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50068
I20260709 12:08:44.671476 16682 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50076:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:44.674513 16682 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:44.750615 16921 tablet_service.cc:1511] Processing CreateTablet for tablet aecd6a6ae3c74558a1e97a521912f184 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:44.751297 16922 tablet_service.cc:1511] Processing CreateTablet for tablet e585d997a0734c67aadab4751008ec31 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:44.752079 16921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecd6a6ae3c74558a1e97a521912f184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.749435 16923 tablet_service.cc:1511] Processing CreateTablet for tablet 667690a210f24c44a15d764956705f63 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:44.753240 16923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 667690a210f24c44a15d764956705f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.755939 16922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e585d997a0734c67aadab4751008ec31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.769261 16920 tablet_service.cc:1511] Processing CreateTablet for tablet 24eb1aecec09401b809c5788851e1f1e (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:44.771240 16919 tablet_service.cc:1511] Processing CreateTablet for tablet f36775931bb14fee96f0c86f9c77a22e (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:44.773381 16918 tablet_service.cc:1511] Processing CreateTablet for tablet f188f28d7d444c33bf561b1eea8c8692 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:44.775362 16915 tablet_service.cc:1511] Processing CreateTablet for tablet 2a86c668e3ba4f3fa3b1264e3327600a (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:44.775592 16917 tablet_service.cc:1511] Processing CreateTablet for tablet 07bdbe4717074644ac240a3df1d37b35 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:44.776470 16774 tablet_service.cc:1511] Processing CreateTablet for tablet 667690a210f24c44a15d764956705f63 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:44.777807 16774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 667690a210f24c44a15d764956705f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.778126 16773 tablet_service.cc:1511] Processing CreateTablet for tablet e585d997a0734c67aadab4751008ec31 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:44.777740 16916 tablet_service.cc:1511] Processing CreateTablet for tablet 8db5812b8c2543b2ae02b84325fce438 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:44.779682 16773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e585d997a0734c67aadab4751008ec31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.779546 16914 tablet_service.cc:1511] Processing CreateTablet for tablet 7e181957f7e24733aaae2f472c422ce5 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:44.780594 16920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24eb1aecec09401b809c5788851e1f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.784474 16914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e181957f7e24733aaae2f472c422ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.789803 16919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36775931bb14fee96f0c86f9c77a22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.794732 16771 tablet_service.cc:1511] Processing CreateTablet for tablet 24eb1aecec09401b809c5788851e1f1e (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:44.796397 16771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24eb1aecec09401b809c5788851e1f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.792062 16772 tablet_service.cc:1511] Processing CreateTablet for tablet aecd6a6ae3c74558a1e97a521912f184 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:44.798558 16917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bdbe4717074644ac240a3df1d37b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.799108 16772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecd6a6ae3c74558a1e97a521912f184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.800768 16972 tablet_bootstrap.cc:492] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:44.802402 16915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a86c668e3ba4f3fa3b1264e3327600a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.803058 16916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db5812b8c2543b2ae02b84325fce438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.803558 16973 tablet_bootstrap.cc:492] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:44.803737 16918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f188f28d7d444c33bf561b1eea8c8692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.823310 16772 tablet_service.cc:1511] Processing CreateTablet for tablet f36775931bb14fee96f0c86f9c77a22e (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:44.827863 16772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36775931bb14fee96f0c86f9c77a22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.831108 16770 tablet_service.cc:1511] Processing CreateTablet for tablet 2a86c668e3ba4f3fa3b1264e3327600a (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:44.832615 16770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a86c668e3ba4f3fa3b1264e3327600a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.825517 16973 tablet_bootstrap.cc:654] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:44.825695 16771 tablet_service.cc:1511] Processing CreateTablet for tablet f188f28d7d444c33bf561b1eea8c8692 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:44.826193 16774 tablet_service.cc:1511] Processing CreateTablet for tablet 07bdbe4717074644ac240a3df1d37b35 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:44.838824 16774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bdbe4717074644ac240a3df1d37b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.808110 16972 tablet_bootstrap.cc:654] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:44.842577 16771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f188f28d7d444c33bf561b1eea8c8692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.853216 16769 tablet_service.cc:1511] Processing CreateTablet for tablet 7e181957f7e24733aaae2f472c422ce5 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:44.854815 16769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e181957f7e24733aaae2f472c422ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.828876 16773 tablet_service.cc:1511] Processing CreateTablet for tablet 8db5812b8c2543b2ae02b84325fce438 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:44.869637 16773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db5812b8c2543b2ae02b84325fce438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.870800 16849 tablet_service.cc:1511] Processing CreateTablet for tablet 667690a210f24c44a15d764956705f63 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:44.872275 16849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 667690a210f24c44a15d764956705f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.875403 16848 tablet_service.cc:1511] Processing CreateTablet for tablet e585d997a0734c67aadab4751008ec31 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:44.876044 16973 tablet_bootstrap.cc:492] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:44.876552 16973 ts_tablet_manager.cc:1403] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.073s	user 0.004s	sys 0.023s
I20260709 12:08:44.876879 16848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e585d997a0734c67aadab4751008ec31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.880198 16847 tablet_service.cc:1511] Processing CreateTablet for tablet aecd6a6ae3c74558a1e97a521912f184 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:44.881738 16847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecd6a6ae3c74558a1e97a521912f184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.881940 16842 tablet_service.cc:1511] Processing CreateTablet for tablet 8db5812b8c2543b2ae02b84325fce438 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:44.883370 16846 tablet_service.cc:1511] Processing CreateTablet for tablet 24eb1aecec09401b809c5788851e1f1e (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:44.884936 16841 tablet_service.cc:1511] Processing CreateTablet for tablet 2a86c668e3ba4f3fa3b1264e3327600a (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:44.885747 16845 tablet_service.cc:1511] Processing CreateTablet for tablet f36775931bb14fee96f0c86f9c77a22e (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:44.888134 16844 tablet_service.cc:1511] Processing CreateTablet for tablet f188f28d7d444c33bf561b1eea8c8692 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:44.888083 16840 tablet_service.cc:1511] Processing CreateTablet for tablet 7e181957f7e24733aaae2f472c422ce5 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:44.891105 16843 tablet_service.cc:1511] Processing CreateTablet for tablet 07bdbe4717074644ac240a3df1d37b35 (DEFAULT_TABLE table=test-workload [id=0f39875e2ff2436986f6c80c493f39e0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:44.892693 16844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f188f28d7d444c33bf561b1eea8c8692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.894460 16842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db5812b8c2543b2ae02b84325fce438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.897920 16972 tablet_bootstrap.cc:492] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:44.898485 16841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a86c668e3ba4f3fa3b1264e3327600a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.899231 16840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e181957f7e24733aaae2f472c422ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.898461 16972 ts_tablet_manager.cc:1403] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.098s	user 0.021s	sys 0.008s
I20260709 12:08:44.906512 16845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36775931bb14fee96f0c86f9c77a22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.907069 16973 raft_consensus.cc:359] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:44.907816 16973 raft_consensus.cc:385] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:44.908128 16973 raft_consensus.cc:740] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
I20260709 12:08:44.910589 16843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bdbe4717074644ac240a3df1d37b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.914666 16846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24eb1aecec09401b809c5788851e1f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:44.929311 16976 tablet_bootstrap.cc:492] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:44.934393 16973 consensus_queue.cc:260] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:44.936425 16972 raft_consensus.cc:359] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:44.937129 16958 heartbeater.cc:499] Master 127.15.191.126:41955 was elected leader, sending a full tablet report...
I20260709 12:08:44.937244 16972 raft_consensus.cc:385] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:44.937608 16972 raft_consensus.cc:740] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:44.938581 16972 consensus_queue.cc:260] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:44.940018 16976 tablet_bootstrap.cc:654] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:44.948203 16973 ts_tablet_manager.cc:1434] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.003s
I20260709 12:08:44.949311 16973 tablet_bootstrap.cc:492] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:44.952584 16809 heartbeater.cc:499] Master 127.15.191.126:41955 was elected leader, sending a full tablet report...
I20260709 12:08:44.955798 16972 ts_tablet_manager.cc:1434] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.002s
I20260709 12:08:44.957584 16972 tablet_bootstrap.cc:492] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:44.964409 16972 tablet_bootstrap.cc:654] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:44.969861 16973 tablet_bootstrap.cc:654] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:44.992134 16972 tablet_bootstrap.cc:492] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:44.992667 16973 tablet_bootstrap.cc:492] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:44.992686 16972 ts_tablet_manager.cc:1403] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.007s
I20260709 12:08:44.993510 16973 ts_tablet_manager.cc:1403] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.018s
I20260709 12:08:44.996086 16972 raft_consensus.cc:359] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:44.996438 16973 raft_consensus.cc:359] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:44.996912 16972 raft_consensus.cc:385] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:44.997375 16972 raft_consensus.cc:740] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:44.997383 16973 raft_consensus.cc:385] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:44.999337 16973 raft_consensus.cc:740] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
I20260709 12:08:44.998260 16972 consensus_queue.cc:260] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:44.999966 16976 tablet_bootstrap.cc:492] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.000473 16976 ts_tablet_manager.cc:1403] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.072s	user 0.007s	sys 0.042s
I20260709 12:08:45.000356 16973 consensus_queue.cc:260] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:45.001766 16972 ts_tablet_manager.cc:1434] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:08:45.002832 16972 tablet_bootstrap.cc:492] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:45.003152 16973 ts_tablet_manager.cc:1434] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:08:45.003541 16976 raft_consensus.cc:359] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.004246 16976 raft_consensus.cc:385] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.004355 16973 tablet_bootstrap.cc:492] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:45.004594 16976 raft_consensus.cc:740] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.005548 16976 consensus_queue.cc:260] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.009792 16972 tablet_bootstrap.cc:654] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.011704 16973 tablet_bootstrap.cc:654] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.014540 16976 ts_tablet_manager.cc:1434] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.006s
I20260709 12:08:45.014772 16884 heartbeater.cc:499] Master 127.15.191.126:41955 was elected leader, sending a full tablet report...
I20260709 12:08:45.015707 16976 tablet_bootstrap.cc:492] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:45.023185 16976 tablet_bootstrap.cc:654] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.028146 16972 tablet_bootstrap.cc:492] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:45.028688 16972 ts_tablet_manager.cc:1403] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.004s
I20260709 12:08:45.031715 16972 raft_consensus.cc:359] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.032501 16972 raft_consensus.cc:385] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.032821 16972 raft_consensus.cc:740] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.033584 16972 consensus_queue.cc:260] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.035292 16976 tablet_bootstrap.cc:492] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.035805 16976 ts_tablet_manager.cc:1403] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:08:45.036610 16972 ts_tablet_manager.cc:1434] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:45.037712 16972 tablet_bootstrap.cc:492] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:45.038756 16973 tablet_bootstrap.cc:492] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:45.038741 16976 raft_consensus.cc:359] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.039453 16973 ts_tablet_manager.cc:1403] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.035s	user 0.025s	sys 0.007s
I20260709 12:08:45.039711 16976 raft_consensus.cc:385] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.040055 16976 raft_consensus.cc:740] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.040941 16976 consensus_queue.cc:260] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.042619 16973 raft_consensus.cc:359] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.043354 16976 ts_tablet_manager.cc:1434] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:08:45.044353 16976 tablet_bootstrap.cc:492] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:45.043367 16973 raft_consensus.cc:385] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.044855 16973 raft_consensus.cc:740] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.045248 16972 tablet_bootstrap.cc:654] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.045650 16973 consensus_queue.cc:260] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.048256 16973 ts_tablet_manager.cc:1434] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:45.049357 16973 tablet_bootstrap.cc:492] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:45.051429 16976 tablet_bootstrap.cc:654] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.059937 16973 tablet_bootstrap.cc:654] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.064169 16972 tablet_bootstrap.cc:492] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:45.064852 16972 ts_tablet_manager.cc:1403] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.016s
I20260709 12:08:45.068117 16972 raft_consensus.cc:359] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.068979 16972 raft_consensus.cc:385] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.069299 16972 raft_consensus.cc:740] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.070523 16973 tablet_bootstrap.cc:492] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:45.070214 16972 consensus_queue.cc:260] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.070995 16973 ts_tablet_manager.cc:1403] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 12:08:45.072590 16972 ts_tablet_manager.cc:1434] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:45.074748 16972 tablet_bootstrap.cc:492] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:45.074898 16973 raft_consensus.cc:359] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.075604 16973 raft_consensus.cc:385] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.075925 16976 tablet_bootstrap.cc:492] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.075902 16973 raft_consensus.cc:740] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.076486 16976 ts_tablet_manager.cc:1403] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.008s
I20260709 12:08:45.076792 16973 consensus_queue.cc:260] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.079779 16976 raft_consensus.cc:359] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.080543 16976 raft_consensus.cc:385] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.080842 16976 raft_consensus.cc:740] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.081251 16972 tablet_bootstrap.cc:654] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.081593 16976 consensus_queue.cc:260] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.082412 16973 ts_tablet_manager.cc:1434] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:08:45.083452 16973 tablet_bootstrap.cc:492] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:45.084128 16976 ts_tablet_manager.cc:1434] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:45.085225 16976 tablet_bootstrap.cc:492] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:45.089655 16982 raft_consensus.cc:493] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.089838 16973 tablet_bootstrap.cc:654] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.090230 16982 raft_consensus.cc:515] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.092198 16976 tablet_bootstrap.cc:654] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.093047 16982 leader_election.cc:290] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:45.098595 16978 raft_consensus.cc:493] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.099181 16978 raft_consensus.cc:515] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:45.102082 16977 raft_consensus.cc:493] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.102576 16977 raft_consensus.cc:515] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.105194 16977 leader_election.cc:290] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.101943 16978 leader_election.cc:290] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.116907 16982 raft_consensus.cc:493] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.117542 16982 raft_consensus.cc:515] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.119695 16982 leader_election.cc:290] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:45.160920 16973 tablet_bootstrap.cc:492] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:45.161485 16973 ts_tablet_manager.cc:1403] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.003s
I20260709 12:08:45.172945 16973 raft_consensus.cc:359] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.173816 16973 raft_consensus.cc:385] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.174160 16973 raft_consensus.cc:740] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.175040 16973 consensus_queue.cc:260] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.186415 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.187408 16784 raft_consensus.cc:2468] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.188758 16976 tablet_bootstrap.cc:492] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.189195 16899 leader_election.cc:304] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:45.193179 16977 raft_consensus.cc:493] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.193786 16977 raft_consensus.cc:515] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:45.196203 16977 leader_election.cc:290] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619)
I20260709 12:08:45.196888 16977 raft_consensus.cc:2804] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.197247 16977 raft_consensus.cc:493] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.197626 16977 raft_consensus.cc:3060] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.189277 16976 ts_tablet_manager.cc:1403] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.104s	user 0.034s	sys 0.066s
I20260709 12:08:45.198081 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667690a210f24c44a15d764956705f63" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c" is_pre_election: true
I20260709 12:08:45.198948 16933 raft_consensus.cc:2468] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 0.
I20260709 12:08:45.204064 16750 leader_election.cc:304] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:45.205456 16973 ts_tablet_manager.cc:1434] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 12:08:45.206969 16978 raft_consensus.cc:2804] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.207386 16978 raft_consensus.cc:493] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.207188 16976 raft_consensus.cc:359] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.207342 16973 tablet_bootstrap.cc:492] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:45.207762 16978 raft_consensus.cc:3060] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.207965 16976 raft_consensus.cc:385] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.208272 16976 raft_consensus.cc:740] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.209030 16976 consensus_queue.cc:260] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.209492 16977 raft_consensus.cc:515] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.211581 16977 leader_election.cc:290] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.212179 16977 raft_consensus.cc:493] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.212630 16977 raft_consensus.cc:515] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.215888 16972 tablet_bootstrap.cc:492] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:45.216501 16972 ts_tablet_manager.cc:1403] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.142s	user 0.051s	sys 0.078s
I20260709 12:08:45.217357 17000 raft_consensus.cc:493] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.218349 16976 ts_tablet_manager.cc:1434] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:08:45.218221 16978 raft_consensus.cc:515] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:45.219512 16972 raft_consensus.cc:359] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.220232 16972 raft_consensus.cc:385] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.220556 16972 raft_consensus.cc:740] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.221513 16976 tablet_bootstrap.cc:492] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:45.221448 16972 consensus_queue.cc:260] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.222275 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667690a210f24c44a15d764956705f63" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:45.222913 16933 raft_consensus.cc:3060] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.223268 16977 leader_election.cc:290] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.224558 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667690a210f24c44a15d764956705f63" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.225411 16784 raft_consensus.cc:2393] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 323b92b05053418fbfbe5a62fac3832c in current term 1: Already voted for candidate d9a757f7aa4749f48d654f66c27b5bad in this term.
I20260709 12:08:45.227727 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:45.228380 16784 raft_consensus.cc:3060] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.230482 16976 tablet_bootstrap.cc:654] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.236001 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.236536 16782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.237285 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c" is_pre_election: true
I20260709 12:08:45.237306 16782 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 0.
I20260709 12:08:45.240355 16782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e585d997a0734c67aadab4751008ec31" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.240517 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c" is_pre_election: true
I20260709 12:08:45.241304 16782 raft_consensus.cc:2468] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.244364 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.245196 16859 raft_consensus.cc:2468] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.247359 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667690a210f24c44a15d764956705f63" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.220765 16978 leader_election.cc:290] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 election: Requested vote from peers 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.251317 16858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e585d997a0734c67aadab4751008ec31" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.249641 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:45.253279 16859 raft_consensus.cc:3060] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:45.250082 16825 leader_election.cc:343] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.255901 16825 leader_election.cc:304] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:45.257653 16933 raft_consensus.cc:2468] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 1.
I20260709 12:08:45.258203 16784 raft_consensus.cc:2468] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 1.
I20260709 12:08:45.263321 16899 leader_election.cc:304] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:45.263660 16982 raft_consensus.cc:2804] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.264067 16982 raft_consensus.cc:493] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.264403 16982 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.264899 16977 raft_consensus.cc:2804] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.265308 16977 raft_consensus.cc:493] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.265700 16977 raft_consensus.cc:3060] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.273146 16977 raft_consensus.cc:515] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.262986 16750 leader_election.cc:304] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:45.275391 16978 raft_consensus.cc:2804] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.217833 17000 raft_consensus.cc:515] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.276067 16978 raft_consensus.cc:697] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 1 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:45.276641 16932 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 0.
I20260709 12:08:45.277420 16978 consensus_queue.cc:237] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:45.282244 17000 leader_election.cc:290] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
W20260709 12:08:45.278595 16825 leader_election.cc:343] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:45.275518 16730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:45.280406 16899 leader_election.cc:304] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:45.283058 16825 leader_election.cc:304] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f2d90bf245754935965fe9bbd57f3af7; no voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:45.284931 16973 tablet_bootstrap.cc:654] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.283280 16859 raft_consensus.cc:2468] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 1.
I20260709 12:08:45.287061 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e585d997a0734c67aadab4751008ec31" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:45.274115 16982 raft_consensus.cc:515] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.275517 16977 leader_election.cc:290] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.287717 16784 raft_consensus.cc:3060] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.288229 16977 raft_consensus.cc:2804] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.288717 16977 raft_consensus.cc:697] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:45.289609 16982 leader_election.cc:290] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:45.289577 16977 consensus_queue.cc:237] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.290577 16982 raft_consensus.cc:2749] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:45.296288 16782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.297093 16782 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.298043 16858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.298892 16858 raft_consensus.cc:2393] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 323b92b05053418fbfbe5a62fac3832c in current term 1: Already voted for candidate f2d90bf245754935965fe9bbd57f3af7 in this term.
I20260709 12:08:45.299911 16973 tablet_bootstrap.cc:492] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:45.300450 16973 ts_tablet_manager.cc:1403] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.093s	user 0.007s	sys 0.003s
W20260709 12:08:45.301568 16899 leader_election.cc:343] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.296274 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e585d997a0734c67aadab4751008ec31" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:45.302022 16899 leader_election.cc:304] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c; no voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7
I20260709 12:08:45.304545 17000 raft_consensus.cc:2749] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:45.304358 16973 raft_consensus.cc:359] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.304378 16972 ts_tablet_manager.cc:1434] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.088s	user 0.028s	sys 0.024s
I20260709 12:08:45.306411 16972 tablet_bootstrap.cc:492] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:45.305166 16973 raft_consensus.cc:385] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.308393 16973 raft_consensus.cc:740] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
W20260709 12:08:45.308495 16899 leader_election.cc:343] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.306210 16681 catalog_manager.cc:5697] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 1 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:45.309633 16973 consensus_queue.cc:260] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
W20260709 12:08:45.310621 16899 leader_election.cc:343] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.317312 16973 ts_tablet_manager.cc:1434] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:08:45.318367 16973 tablet_bootstrap.cc:492] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:45.318908 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667690a210f24c44a15d764956705f63" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.311538 16784 raft_consensus.cc:2468] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 1.
I20260709 12:08:45.311547 16782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:45.320724 16782 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.321127 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667690a210f24c44a15d764956705f63" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:45.314970 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:45.323657 16932 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:45.324261 16750 leader_election.cc:343] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:45.325196 16750 leader_election.cc:343] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.325640 16976 tablet_bootstrap.cc:492] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.326144 16976 ts_tablet_manager.cc:1403] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.105s	user 0.031s	sys 0.043s
I20260709 12:08:45.327548 16899 leader_election.cc:304] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: f2d90bf245754935965fe9bbd57f3af7
I20260709 12:08:45.328943 16899 leader_election.cc:304] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: f2d90bf245754935965fe9bbd57f3af7
I20260709 12:08:45.329847 17000 raft_consensus.cc:2804] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.329609 16976 raft_consensus.cc:359] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.317173 16972 tablet_bootstrap.cc:654] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.330447 16976 raft_consensus.cc:385] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.330588 17000 raft_consensus.cc:697] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:45.330803 16976 raft_consensus.cc:740] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.326022 16973 tablet_bootstrap.cc:654] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.331485 17000 consensus_queue.cc:237] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.334827 16976 consensus_queue.cc:260] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.334019 16680 catalog_manager.cc:5697] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 0 to 1, leader changed from <none> to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:45.335988 16932 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 1.
I20260709 12:08:45.336535 16977 raft_consensus.cc:2764] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:08:45.339061 16825 leader_election.cc:304] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:45.340029 17004 raft_consensus.cc:2804] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.342548 17004 raft_consensus.cc:697] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 1 LEADER]: Becoming Leader. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:08:45.343639 16976 ts_tablet_manager.cc:1434] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:08:45.343567 17004 consensus_queue.cc:237] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.344736 16976 tablet_bootstrap.cc:492] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:45.351318 16782 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 1.
I20260709 12:08:45.356251 16976 tablet_bootstrap.cc:654] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.357890 16973 tablet_bootstrap.cc:492] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:45.358922 16973 ts_tablet_manager.cc:1403] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 12:08:45.362190 16973 raft_consensus.cc:359] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.363054 16973 raft_consensus.cc:385] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.363368 16973 raft_consensus.cc:740] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.364598 16973 consensus_queue.cc:260] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.368108 16973 ts_tablet_manager.cc:1434] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:08:45.369302 16973 tablet_bootstrap.cc:492] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:45.369581 16682 catalog_manager.cc:5697] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "f2d90bf245754935965fe9bbd57f3af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:45.378289 16973 tablet_bootstrap.cc:654] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.408246 16972 tablet_bootstrap.cc:492] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:45.408799 16972 ts_tablet_manager.cc:1403] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.103s	user 0.029s	sys 0.025s
I20260709 12:08:45.409523 16976 tablet_bootstrap.cc:492] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.410048 16976 ts_tablet_manager.cc:1403] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.026s
I20260709 12:08:45.410138 16973 tablet_bootstrap.cc:492] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:45.411548 16972 raft_consensus.cc:359] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.412122 16972 raft_consensus.cc:385] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.412345 16972 raft_consensus.cc:740] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.413038 16972 consensus_queue.cc:260] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.413164 16976 raft_consensus.cc:359] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.413913 16976 raft_consensus.cc:385] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.414273 16976 raft_consensus.cc:740] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.413497 16682 catalog_manager.cc:5697] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 0 to 1, leader changed from <none> to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:45.415313 16972 ts_tablet_manager.cc:1434] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:08:45.415120 16976 consensus_queue.cc:260] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.410691 16973 ts_tablet_manager.cc:1403] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.006s
I20260709 12:08:45.417497 16976 ts_tablet_manager.cc:1434] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:45.418562 16976 tablet_bootstrap.cc:492] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:45.418671 16973 raft_consensus.cc:359] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.419521 16973 raft_consensus.cc:385] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.419862 16973 raft_consensus.cc:740] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.420744 16973 consensus_queue.cc:260] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.421978 16972 tablet_bootstrap.cc:492] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:45.422958 16973 ts_tablet_manager.cc:1434] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:45.424156 16973 tablet_bootstrap.cc:492] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:45.425348 16976 tablet_bootstrap.cc:654] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.429272 16972 tablet_bootstrap.cc:654] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.430204 16973 tablet_bootstrap.cc:654] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:45.439543 16810 tablet.cc:2406] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:45.461320 16976 tablet_bootstrap.cc:492] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.461844 16976 ts_tablet_manager.cc:1403] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.019s
I20260709 12:08:45.462014 16972 tablet_bootstrap.cc:492] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:45.462538 16972 ts_tablet_manager.cc:1403] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.015s
I20260709 12:08:45.462787 16973 tablet_bootstrap.cc:492] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:45.463230 16973 ts_tablet_manager.cc:1403] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.039s	user 0.026s	sys 0.011s
I20260709 12:08:45.464294 16976 raft_consensus.cc:359] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.464862 16976 raft_consensus.cc:385] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.465111 16976 raft_consensus.cc:740] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.465418 16972 raft_consensus.cc:359] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.465582 16973 raft_consensus.cc:359] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.465778 16976 consensus_queue.cc:260] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.466225 16972 raft_consensus.cc:385] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.466293 16973 raft_consensus.cc:385] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.466668 16973 raft_consensus.cc:740] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.466645 16972 raft_consensus.cc:740] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.468063 16976 ts_tablet_manager.cc:1434] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:08:45.467623 16973 consensus_queue.cc:260] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.467623 16972 consensus_queue.cc:260] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.469108 16976 tablet_bootstrap.cc:492] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:45.472237 16972 ts_tablet_manager.cc:1434] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:08:45.473335 16972 tablet_bootstrap.cc:492] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:45.476229 16976 tablet_bootstrap.cc:654] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.477377 16973 ts_tablet_manager.cc:1434] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:08:45.479315 16973 tablet_bootstrap.cc:492] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c: Bootstrap starting.
I20260709 12:08:45.485162 16973 tablet_bootstrap.cc:654] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.488552 16972 tablet_bootstrap.cc:654] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.494347 17004 raft_consensus.cc:493] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.495211 17004 raft_consensus.cc:515] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.497686 17004 leader_election.cc:290] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:45.500165 16782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a86c668e3ba4f3fa3b1264e3327600a" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.500957 16782 raft_consensus.cc:2468] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 0.
I20260709 12:08:45.502218 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a86c668e3ba4f3fa3b1264e3327600a" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c" is_pre_election: true
I20260709 12:08:45.502262 16825 leader_election.cc:304] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
W20260709 12:08:45.503765 16825 leader_election.cc:343] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.504482 17004 raft_consensus.cc:2804] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.504860 17004 raft_consensus.cc:493] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.505125 17004 raft_consensus.cc:3060] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.510159 17004 raft_consensus.cc:515] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.512647 16976 tablet_bootstrap.cc:492] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.513091 16973 tablet_bootstrap.cc:492] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c: No bootstrap required, opened a new log
I20260709 12:08:45.513406 16976 ts_tablet_manager.cc:1403] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.022s
I20260709 12:08:45.513319 16782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a86c668e3ba4f3fa3b1264e3327600a" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:45.514045 16782 raft_consensus.cc:3060] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.515470 17004 leader_election.cc:290] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:45.513554 16973 ts_tablet_manager.cc:1403] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.014s
I20260709 12:08:45.516322 16972 tablet_bootstrap.cc:492] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:45.516264 16976 raft_consensus.cc:359] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.516902 16972 ts_tablet_manager.cc:1403] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.000s
I20260709 12:08:45.517072 16976 raft_consensus.cc:385] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.517352 16976 raft_consensus.cc:740] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.518066 16976 consensus_queue.cc:260] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.518551 16973 raft_consensus.cc:359] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.519244 16973 raft_consensus.cc:385] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.519521 16973 raft_consensus.cc:740] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.520088 16976 ts_tablet_manager.cc:1434] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:45.520239 16972 raft_consensus.cc:359] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.520354 16973 consensus_queue.cc:260] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.521062 16976 tablet_bootstrap.cc:492] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:45.521155 16972 raft_consensus.cc:385] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.522315 16977 raft_consensus.cc:493] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.522594 16973 ts_tablet_manager.cc:1434] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:08:45.522514 17000 raft_consensus.cc:493] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.522959 16977 raft_consensus.cc:515] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.523650 17000 raft_consensus.cc:515] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.525439 16977 leader_election.cc:290] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.525722 17000 leader_election.cc:290] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.526535 17000 raft_consensus.cc:493] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.527472 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a86c668e3ba4f3fa3b1264e3327600a" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:45.527815 16976 tablet_bootstrap.cc:654] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.528115 16932 raft_consensus.cc:3060] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.528612 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.529266 16782 raft_consensus.cc:2468] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 1.
I20260709 12:08:45.530568 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.532027 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.532851 16859 raft_consensus.cc:2468] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.534179 16858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.535066 16858 raft_consensus.cc:2468] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.535651 16825 leader_election.cc:304] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:45.536607 17004 raft_consensus.cc:2804] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.536691 16932 raft_consensus.cc:2468] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 1.
I20260709 12:08:45.537215 17004 raft_consensus.cc:697] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 1 LEADER]: Becoming Leader. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
W20260709 12:08:45.538009 16899 leader_election.cc:343] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.538228 17004 consensus_queue.cc:237] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
W20260709 12:08:45.538781 16899 leader_election.cc:343] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.527020 17000 raft_consensus.cc:515] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.539449 16899 leader_election.cc:304] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:45.540666 16899 leader_election.cc:304] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:45.542157 17001 raft_consensus.cc:2804] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.542618 17001 raft_consensus.cc:493] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.542904 17000 leader_election.cc:290] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.543474 16977 raft_consensus.cc:2804] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.543995 16977 raft_consensus.cc:493] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.542970 17001 raft_consensus.cc:3060] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.545672 16977 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.551311 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.553188 16858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.553112 16977 raft_consensus.cc:515] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.553983 16858 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.555421 16977 leader_election.cc:290] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.557103 16899 leader_election.cc:304] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:45.557498 16782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:45.557426 16858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:45.558178 16977 raft_consensus.cc:2804] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.521625 16972 raft_consensus.cc:740] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.558408 16858 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:45.559283 16899 leader_election.cc:343] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.559370 16972 consensus_queue.cc:260] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.560343 16783 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.561887 16972 ts_tablet_manager.cc:1434] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 12:08:45.562883 16972 tablet_bootstrap.cc:492] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:45.558575 16977 raft_consensus.cc:493] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.564778 16977 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.573616 16977 raft_consensus.cc:515] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.574958 17001 raft_consensus.cc:515] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.576635 16977 leader_election.cc:290] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.577518 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:45.578254 16783 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.581472 16972 tablet_bootstrap.cc:654] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.584756 16976 tablet_bootstrap.cc:492] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.585369 16976 ts_tablet_manager.cc:1403] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.065s	user 0.031s	sys 0.011s
I20260709 12:08:45.586602 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:45.585942 16680 catalog_manager.cc:5697] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "f2d90bf245754935965fe9bbd57f3af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:45.587365 16859 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.588269 16976 raft_consensus.cc:359] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:45.588966 16976 raft_consensus.cc:385] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.577380 17001 leader_election.cc:290] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.589251 16976 raft_consensus.cc:740] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.590253 16976 consensus_queue.cc:260] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } }
I20260709 12:08:45.592782 16976 ts_tablet_manager.cc:1434] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:45.593863 16976 tablet_bootstrap.cc:492] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7: Bootstrap starting.
I20260709 12:08:45.595913 16859 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 1.
I20260709 12:08:45.581271 16858 raft_consensus.cc:2468] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 1.
I20260709 12:08:45.598059 16782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:45.599594 16976 tablet_bootstrap.cc:654] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.603117 16783 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 1.
I20260709 12:08:45.602944 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:45.606230 16857 raft_consensus.cc:3060] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.607254 16972 tablet_bootstrap.cc:492] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:45.607722 16972 ts_tablet_manager.cc:1403] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.022s
W20260709 12:08:45.607687 16899 leader_election.cc:343] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:45.608685 16899 leader_election.cc:304] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:45.609472 17001 raft_consensus.cc:2804] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.610002 17001 raft_consensus.cc:697] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:45.610188 16899 leader_election.cc:304] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:45.611008 16977 raft_consensus.cc:2804] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.609995 16976 tablet_bootstrap.cc:492] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7: No bootstrap required, opened a new log
I20260709 12:08:45.610929 17001 consensus_queue.cc:237] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.611649 16977 raft_consensus.cc:697] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:45.612116 16976 ts_tablet_manager.cc:1403] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 12:08:45.612560 16977 consensus_queue.cc:237] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.614814 16857 raft_consensus.cc:2468] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 1.
I20260709 12:08:45.614918 16976 raft_consensus.cc:359] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.615612 16976 raft_consensus.cc:385] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.615888 16976 raft_consensus.cc:740] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.616554 16899 leader_election.cc:304] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:45.617395 17000 raft_consensus.cc:2804] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.617280 16972 raft_consensus.cc:359] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.617944 16972 raft_consensus.cc:385] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.618296 16972 raft_consensus.cc:740] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.619240 16972 consensus_queue.cc:260] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.621035 17000 raft_consensus.cc:697] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:45.621971 17000 consensus_queue.cc:237] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.616561 16976 consensus_queue.cc:260] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.625573 16978 raft_consensus.cc:493] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.626124 16978 raft_consensus.cc:515] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.628245 16978 leader_election.cc:290] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:45.630693 16976 ts_tablet_manager.cc:1434] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:08:45.631904 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c" is_pre_election: true
I20260709 12:08:45.633235 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.634020 16857 raft_consensus.cc:2393] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9a757f7aa4749f48d654f66c27b5bad in current term 1: Already voted for candidate 323b92b05053418fbfbe5a62fac3832c in this term.
I20260709 12:08:45.633850 16679 catalog_manager.cc:5697] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 0 to 1, leader changed from <none> to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:45.635432 16972 ts_tablet_manager.cc:1434] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 12:08:45.637540 16750 leader_election.cc:304] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad; no voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7
I20260709 12:08:45.638366 16972 tablet_bootstrap.cc:492] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad: Bootstrap starting.
I20260709 12:08:45.642314 16978 raft_consensus.cc:3060] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.643868 16972 tablet_bootstrap.cc:654] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.655942 17000 raft_consensus.cc:493] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.656484 17000 raft_consensus.cc:515] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.654207 16978 raft_consensus.cc:2749] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:45.658743 17000 leader_election.cc:290] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.659559 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e181957f7e24733aaae2f472c422ce5" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad" is_pre_election: true
I20260709 12:08:45.660220 16783 raft_consensus.cc:2468] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.660408 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e181957f7e24733aaae2f472c422ce5" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.660706 16972 tablet_bootstrap.cc:492] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad: No bootstrap required, opened a new log
I20260709 12:08:45.661418 16899 leader_election.cc:304] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:45.661561 16972 ts_tablet_manager.cc:1403] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 12:08:45.661439 16857 raft_consensus.cc:2468] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 0.
I20260709 12:08:45.662535 17000 raft_consensus.cc:2804] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.661584 16679 catalog_manager.cc:5697] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 0 to 1, leader changed from <none> to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:45.662905 17000 raft_consensus.cc:493] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.663378 17000 raft_consensus.cc:3060] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.664371 16679 catalog_manager.cc:5697] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 0 to 1, leader changed from <none> to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:45.664841 16972 raft_consensus.cc:359] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.665562 16972 raft_consensus.cc:385] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.665824 16972 raft_consensus.cc:740] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.666551 16972 consensus_queue.cc:260] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.668555 16972 ts_tablet_manager.cc:1434] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:08:45.670737 17000 raft_consensus.cc:515] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.672844 17000 leader_election.cc:290] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:45.673566 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e181957f7e24733aaae2f472c422ce5" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:45.674202 16783 raft_consensus.cc:3060] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.674865 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e181957f7e24733aaae2f472c422ce5" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:45.675509 16857 raft_consensus.cc:3060] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.680971 16783 raft_consensus.cc:2468] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 1.
I20260709 12:08:45.682017 16899 leader_election.cc:304] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:45.682078 16857 raft_consensus.cc:2468] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 1.
I20260709 12:08:45.682855 17000 raft_consensus.cc:2804] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.683379 17000 raft_consensus.cc:697] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:45.684175 17000 consensus_queue.cc:237] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.694537 16680 catalog_manager.cc:5697] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 0 to 1, leader changed from <none> to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:45.707928 17000 consensus_queue.cc:1048] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:45.708134 16978 raft_consensus.cc:493] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.708624 16978 raft_consensus.cc:515] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.710498 16978 leader_election.cc:290] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:45.711169 16858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.711776 16858 raft_consensus.cc:2468] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 0.
I20260709 12:08:45.711715 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c" is_pre_election: true
I20260709 12:08:45.712540 16932 raft_consensus.cc:2468] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 0.
I20260709 12:08:45.713227 16750 leader_election.cc:304] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:45.714699 16978 raft_consensus.cc:2804] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:45.715083 16978 raft_consensus.cc:493] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:45.715454 16978 raft_consensus.cc:3060] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.717145 16858 raft_consensus.cc:3060] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.724697 16978 raft_consensus.cc:515] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.726349 17002 consensus_queue.cc:1048] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:45.727109 16978 leader_election.cc:290] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:45.727274 17000 consensus_queue.cc:1048] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:45.729401 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:45.730047 16932 raft_consensus.cc:3060] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.730801 17000 consensus_queue.cc:1048] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:45.732673 16858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:45.733281 16858 raft_consensus.cc:3060] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.739869 16932 raft_consensus.cc:2468] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 1.
I20260709 12:08:45.741407 16750 leader_election.cc:304] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:45.742228 17002 raft_consensus.cc:2804] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.742694 17002 raft_consensus.cc:697] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 1 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:45.743501 17002 consensus_queue.cc:237] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.739869 16858 raft_consensus.cc:2468] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 1.
I20260709 12:08:45.768558 16857 raft_consensus.cc:3060] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.778177 17045 consensus_queue.cc:1048] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:45.779389 17004 consensus_queue.cc:1048] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:45.788285 16977 consensus_queue.cc:1048] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:45.809273 16679 catalog_manager.cc:5697] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 1 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:45.810344 16982 consensus_queue.cc:1048] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:45.864992 16933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e585d997a0734c67aadab4751008ec31"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
mode: GRACEFUL
new_leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:58642
I20260709 12:08:45.865206 17046 raft_consensus.cc:493] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:45.865676 16933 raft_consensus.cc:606] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Received request to transfer leadership to TS d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:45.865691 17046 raft_consensus.cc:515] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:45.867712 17046 leader_election.cc:290] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:45.868448 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2d90bf245754935965fe9bbd57f3af7" is_pre_election: true
I20260709 12:08:45.868681 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "323b92b05053418fbfbe5a62fac3832c" is_pre_election: true
I20260709 12:08:45.869266 16857 raft_consensus.cc:2393] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9a757f7aa4749f48d654f66c27b5bad in current term 1: Already voted for candidate 323b92b05053418fbfbe5a62fac3832c in this term.
I20260709 12:08:45.870572 16750 leader_election.cc:304] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad; no voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7
I20260709 12:08:45.871799 17046 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.879048 17046 raft_consensus.cc:2749] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:45.882392 16857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184"
dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
mode: GRACEFUL
new_leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:47658
I20260709 12:08:45.882934 16857 raft_consensus.cc:606] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 1 LEADER]: Received request to transfer leadership to TS d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:45.889369 16933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
mode: GRACEFUL
new_leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:58642
I20260709 12:08:45.889979 16933 raft_consensus.cc:606] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Received request to transfer leadership to TS d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:45.896853 16933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
mode: GRACEFUL
new_leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:58642
I20260709 12:08:45.897392 16933 raft_consensus.cc:606] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Received request to transfer leadership to TS d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:45.914781 16783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
mode: GRACEFUL
new_leader_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:42956
I20260709 12:08:45.915284 16783 raft_consensus.cc:606] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 1 LEADER]: Received request to transfer leadership to TS f2d90bf245754935965fe9bbd57f3af7
I20260709 12:08:45.921054 16933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
mode: GRACEFUL
new_leader_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:58642
I20260709 12:08:45.921856 16933 raft_consensus.cc:606] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Received request to transfer leadership to TS f2d90bf245754935965fe9bbd57f3af7
I20260709 12:08:45.927699 16933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
mode: GRACEFUL
new_leader_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:58642
I20260709 12:08:45.928226 16933 raft_consensus.cc:606] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Received request to transfer leadership to TS f2d90bf245754935965fe9bbd57f3af7
I20260709 12:08:45.995435 16977 consensus_queue.cc:1048] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.007124 17001 consensus_queue.cc:1048] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.010552 17031 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:46.015450 17001 raft_consensus.cc:993] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c: : Instructing follower f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:08:46.015977 17031 raft_consensus.cc:1081] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Signalling peer f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:08:46.018091 16857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438"
dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:47648
I20260709 12:08:46.018744 16857 raft_consensus.cc:493] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:46.019124 16857 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.020829 17050 consensus_queue.cc:1048] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:46.022063 17001 raft_consensus.cc:993] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c: : Instructing follower d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:46.022580 17001 raft_consensus.cc:1081] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Signalling peer d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:46.025084 16782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:08:46.025740 16782 raft_consensus.cc:493] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:46.026397 16782 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.030856 16857 raft_consensus.cc:515] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.032724 17001 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.032933 16857 leader_election.cc:290] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 2 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:46.033674 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:46.033936 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:46.034297 16784 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.034464 16933 raft_consensus.cc:3055] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:46.034825 16933 raft_consensus.cc:740] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:46.035713 16933 consensus_queue.cc:260] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.037015 16933 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.045065 16933 raft_consensus.cc:2468] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 2.
I20260709 12:08:46.047194 16825 leader_election.cc:304] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:46.048275 16982 raft_consensus.cc:2804] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:46.048754 16982 raft_consensus.cc:697] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Becoming Leader. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:08:46.051095 16982 consensus_queue.cc:237] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.051450 16782 raft_consensus.cc:515] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.052141 17004 consensus_queue.cc:1048] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.057598 16782 leader_election.cc:290] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 2 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:46.059149 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:46.059767 16932 raft_consensus.cc:3055] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:46.060081 16932 raft_consensus.cc:740] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:46.060495 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:46.061131 16857 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.060895 16932 consensus_queue.cc:260] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.062223 16932 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.063139 16784 raft_consensus.cc:2468] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 2.
I20260709 12:08:46.068425 16857 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 2.
I20260709 12:08:46.069834 16750 leader_election.cc:304] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:46.070791 17046 raft_consensus.cc:2804] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:46.071280 17046 raft_consensus.cc:697] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:46.072103 17046 consensus_queue.cc:237] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.075290 17001 consensus_queue.cc:1048] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:46.081435 16682 catalog_manager.cc:5697] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 1 to 2, leader changed from 323b92b05053418fbfbe5a62fac3832c (127.15.191.67) to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 2 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.089954 16932 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 2.
I20260709 12:08:46.096900 17001 consensus_queue.cc:1048] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.098172 16681 catalog_manager.cc:5697] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 reported cstate change: term changed from 1 to 2, leader changed from 323b92b05053418fbfbe5a62fac3832c (127.15.191.67) to f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "f2d90bf245754935965fe9bbd57f3af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.110023 17000 raft_consensus.cc:993] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c: : Instructing follower f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:08:46.110533 17000 raft_consensus.cc:1081] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Signalling peer f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:08:46.112825 16858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35"
dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:47648
I20260709 12:08:46.113401 16858 raft_consensus.cc:493] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:46.113788 16858 raft_consensus.cc:3060] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.119824 16858 raft_consensus.cc:515] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.120774 16857 raft_consensus.cc:1240] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Rejecting Update request from peer 323b92b05053418fbfbe5a62fac3832c for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:46.121722 16858 leader_election.cc:290] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 2 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:46.123208 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:46.123818 16784 raft_consensus.cc:3060] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.123812 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:46.124312 17001 consensus_queue.cc:1059] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.125414 16933 raft_consensus.cc:3055] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:46.125771 16933 raft_consensus.cc:740] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:46.126547 16933 consensus_queue.cc:260] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.127617 16933 raft_consensus.cc:3060] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.129731 16784 raft_consensus.cc:2468] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 2.
I20260709 12:08:46.130896 16825 leader_election.cc:304] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:46.131644 17004 raft_consensus.cc:2804] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:46.132058 17004 raft_consensus.cc:697] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Becoming Leader. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:08:46.132766 17004 consensus_queue.cc:237] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.133817 16933 raft_consensus.cc:2468] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 2.
W20260709 12:08:46.134348 16977 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:08:46.139706 16682 catalog_manager.cc:5697] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 reported cstate change: term changed from 1 to 2, leader changed from 323b92b05053418fbfbe5a62fac3832c (127.15.191.67) to f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "f2d90bf245754935965fe9bbd57f3af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.238303 16977 raft_consensus.cc:993] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c: : Instructing follower d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:46.238929 17031 consensus_queue.cc:1048] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.239392 17001 raft_consensus.cc:1081] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Signalling peer d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:46.242008 16783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:08:46.242645 16783 raft_consensus.cc:493] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:46.243043 16783 raft_consensus.cc:3060] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.243885 16982 raft_consensus.cc:993] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7: : Instructing follower d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:46.244369 16982 raft_consensus.cc:1081] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 1 LEADER]: Signalling peer d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:46.246390 16784 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:42942
I20260709 12:08:46.247076 16784 raft_consensus.cc:493] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:46.247515 16784 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.250326 16783 raft_consensus.cc:515] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.253590 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:46.254231 16857 raft_consensus.cc:3060] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.257400 16784 raft_consensus.cc:515] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.258184 16977 consensus_queue.cc:1048] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.260375 16858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:46.261023 16858 raft_consensus.cc:3055] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:46.261340 16858 raft_consensus.cc:740] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:08:46.261399 16784 leader_election.cc:290] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 2 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:46.262223 16858 consensus_queue.cc:260] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.263513 16858 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.264060 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:46.264652 16932 raft_consensus.cc:3055] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:46.265219 16783 leader_election.cc:290] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 2 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:46.264993 16932 raft_consensus.cc:740] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:46.261734 16857 raft_consensus.cc:2468] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 2.
I20260709 12:08:46.268411 16932 consensus_queue.cc:260] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.269714 16932 raft_consensus.cc:3060] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.270706 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:46.271238 16750 leader_election.cc:304] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:46.271317 16933 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.272246 17046 raft_consensus.cc:2804] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:46.273466 17046 raft_consensus.cc:697] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:46.274349 17046 consensus_queue.cc:237] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.276172 16858 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 2.
I20260709 12:08:46.278401 16750 leader_election.cc:304] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:46.280053 17002 raft_consensus.cc:2804] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:46.280557 17002 raft_consensus.cc:697] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:46.281390 17002 consensus_queue.cc:237] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.282809 16932 raft_consensus.cc:2468] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 2.
I20260709 12:08:46.285221 17046 consensus_queue.cc:1048] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.286576 16682 catalog_manager.cc:5697] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 1 to 2, leader changed from 323b92b05053418fbfbe5a62fac3832c (127.15.191.67) to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 2 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.294871 17046 raft_consensus.cc:993] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad: : Instructing follower f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:08:46.295346 17046 raft_consensus.cc:1081] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 1 LEADER]: Signalling peer f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:08:46.297600 16859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692"
dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:47650
I20260709 12:08:46.298297 16859 raft_consensus.cc:493] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:46.298696 16859 raft_consensus.cc:3060] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.299746 16933 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 2.
I20260709 12:08:46.303978 17046 consensus_queue.cc:1048] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:46.313699 16859 raft_consensus.cc:515] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.314895 16857 raft_consensus.cc:1240] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Rejecting Update request from peer d9a757f7aa4749f48d654f66c27b5bad for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:46.317262 16859 leader_election.cc:290] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 2 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:46.316970 16682 catalog_manager.cc:5697] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 1 to 2, leader changed from f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66) to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 2 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.318440 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:46.318696 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:46.319060 16784 raft_consensus.cc:3055] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:46.319361 16784 raft_consensus.cc:740] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:46.320142 16784 consensus_queue.cc:260] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.321334 16784 raft_consensus.cc:3060] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.326511 17001 raft_consensus.cc:993] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c: : Instructing follower d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:46.327023 16977 raft_consensus.cc:1081] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Signalling peer d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:46.328359 16784 raft_consensus.cc:2468] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 2.
I20260709 12:08:46.328953 16783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e585d997a0734c67aadab4751008ec31"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:08:46.329547 16783 raft_consensus.cc:493] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:46.329586 16825 leader_election.cc:304] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 323b92b05053418fbfbe5a62fac3832c
I20260709 12:08:46.330070 16783 raft_consensus.cc:3060] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.331063 17004 raft_consensus.cc:2804] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:46.331732 17004 raft_consensus.cc:697] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Becoming Leader. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:08:46.332724 17004 consensus_queue.cc:237] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.336733 16783 raft_consensus.cc:515] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.339632 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e585d997a0734c67aadab4751008ec31" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:46.339921 16783 leader_election.cc:290] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 2 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:46.340483 16857 raft_consensus.cc:3060] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.341199 16679 catalog_manager.cc:5697] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 reported cstate change: term changed from 1 to 2, leader changed from d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65) to f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "f2d90bf245754935965fe9bbd57f3af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.341266 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e585d997a0734c67aadab4751008ec31" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:46.342748 16933 raft_consensus.cc:3055] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:46.343111 16933 raft_consensus.cc:740] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:46.343942 16933 consensus_queue.cc:260] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.345264 16933 raft_consensus.cc:3060] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.348966 16857 raft_consensus.cc:2468] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 2.
I20260709 12:08:46.350433 16750 leader_election.cc:304] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:46.351239 17068 raft_consensus.cc:2804] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:46.351874 17068 raft_consensus.cc:697] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:46.352743 17068 consensus_queue.cc:237] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:46.357774 16933 raft_consensus.cc:2468] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 2.
I20260709 12:08:46.359933 16682 catalog_manager.cc:5697] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 1 to 2, leader changed from 323b92b05053418fbfbe5a62fac3832c (127.15.191.67) to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 2 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.467975 16783 raft_consensus.cc:1275] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.469178 17004 consensus_queue.cc:1048] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.476402 16933 raft_consensus.cc:1275] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.478427 17004 consensus_queue.cc:1048] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.552377 16933 raft_consensus.cc:1275] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.553637 17004 consensus_queue.cc:1048] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.561806 16783 raft_consensus.cc:1275] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.564728 17050 consensus_queue.cc:1048] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.590586 16857 raft_consensus.cc:1275] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.591782 17068 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.599334 16933 raft_consensus.cc:1275] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.601696 17068 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.735176 16857 raft_consensus.cc:1275] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.736485 17068 consensus_queue.cc:1048] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.744107 16933 raft_consensus.cc:1275] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.746311 17046 consensus_queue.cc:1048] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.772332 16857 raft_consensus.cc:1275] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.773574 17046 consensus_queue.cc:1048] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.781726 16933 raft_consensus.cc:1275] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.783814 17068 consensus_queue.cc:1048] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.785534 16932 raft_consensus.cc:1275] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.789106 17046 consensus_queue.cc:1048] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.798043 16857 raft_consensus.cc:1275] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.799551 17068 consensus_queue.cc:1048] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.830873 16783 raft_consensus.cc:1275] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.832103 17050 consensus_queue.cc:1048] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.840026 16932 raft_consensus.cc:3060] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:46.846630 16932 raft_consensus.cc:1275] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:46.848141 16982 consensus_queue.cc:1048] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.967360 16125 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:48.968004 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:48.985035 16783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
mode: GRACEFUL
new_leader_uuid: "323b92b05053418fbfbe5a62fac3832c"
 from {username='slave'} at 127.0.0.1:42970
I20260709 12:08:48.985620 16783 raft_consensus.cc:606] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Received request to transfer leadership to TS 323b92b05053418fbfbe5a62fac3832c
I20260709 12:08:48.988034 16783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
mode: GRACEFUL
new_leader_uuid: "323b92b05053418fbfbe5a62fac3832c"
 from {username='slave'} at 127.0.0.1:42970
I20260709 12:08:48.988615 16783 raft_consensus.cc:606] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Received request to transfer leadership to TS 323b92b05053418fbfbe5a62fac3832c
I20260709 12:08:48.989843 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:48.990335 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:49.116931 17068 raft_consensus.cc:993] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad: : Instructing follower 323b92b05053418fbfbe5a62fac3832c to start an election
I20260709 12:08:49.117390 17076 raft_consensus.cc:1081] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Signalling peer 323b92b05053418fbfbe5a62fac3832c to start an election
I20260709 12:08:49.119048 16933 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
 from {username='slave'} at 127.0.0.1:58636
I20260709 12:08:49.119509 16933 raft_consensus.cc:493] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.119774 16933 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:49.124428 16933 raft_consensus.cc:515] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:49.125955 16933 leader_election.cc:290] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 3 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:49.126930 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:49.127179 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:49.127461 16783 raft_consensus.cc:3055] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:49.127689 16857 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:49.127776 16783 raft_consensus.cc:740] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:49.128525 16783 consensus_queue.cc:260] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:49.129453 16783 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:49.132573 16857 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 3.
I20260709 12:08:49.133721 16899 leader_election.cc:304] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:49.134236 16783 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 3.
I20260709 12:08:49.134460 17000 raft_consensus.cc:2804] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:49.135982 17000 raft_consensus.cc:697] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:49.136775 17000 consensus_queue.cc:237] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:49.143397 16682 catalog_manager.cc:5697] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 2 to 3, leader changed from d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65) to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 3 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.400952 17068 raft_consensus.cc:993] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad: : Instructing follower 323b92b05053418fbfbe5a62fac3832c to start an election
I20260709 12:08:49.401440 17076 raft_consensus.cc:1081] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Signalling peer 323b92b05053418fbfbe5a62fac3832c to start an election
I20260709 12:08:49.402796 16933 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
 from {username='slave'} at 127.0.0.1:58636
I20260709 12:08:49.403220 16933 raft_consensus.cc:493] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.403465 16933 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:49.408020 16933 raft_consensus.cc:515] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:49.409657 16933 leader_election.cc:290] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 3 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:08:49.410557 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:08:49.410843 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:49.411164 16783 raft_consensus.cc:3055] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:49.411394 16857 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:49.411490 16783 raft_consensus.cc:740] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:49.412215 16783 consensus_queue.cc:260] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:49.413112 16783 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:49.415829 16857 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 3.
I20260709 12:08:49.416885 16899 leader_election.cc:304] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:49.417687 17000 raft_consensus.cc:2804] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:49.418234 17000 raft_consensus.cc:697] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:49.418464 16783 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 3.
I20260709 12:08:49.419021 17000 consensus_queue.cc:237] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:49.425659 16682 catalog_manager.cc:5697] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 2 to 3, leader changed from d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65) to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 3 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.633586 16857 raft_consensus.cc:1275] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Refusing update from remote peer 323b92b05053418fbfbe5a62fac3832c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:49.634791 17000 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:49.647699 16783 raft_consensus.cc:1275] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Refusing update from remote peer 323b92b05053418fbfbe5a62fac3832c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:49.650192 17086 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:49.957346 16783 raft_consensus.cc:1275] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Refusing update from remote peer 323b92b05053418fbfbe5a62fac3832c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:49.958724 17086 consensus_queue.cc:1048] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:49.970541 16857 raft_consensus.cc:1275] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Refusing update from remote peer 323b92b05053418fbfbe5a62fac3832c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:49.971984 17091 consensus_queue.cc:1048] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:49.991394 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:49.997087 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:49.997534 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:50.998538 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:51.004845 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:51.005415 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:52.006459 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.012064 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:52.012465 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.013655 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.019718 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.020164 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:54.021235 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.026660 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.027078 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.027959 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.034233 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.034626 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.035600 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.041550 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.041961 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.042937 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.049074 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.049500 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.050537 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.056039 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.056455 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.087730 16125 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:08:59.097958 16933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
mode: GRACEFUL
new_leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:58642
I20260709 12:08:59.098683 16933 raft_consensus.cc:606] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Received request to transfer leadership to TS d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:59.106377 16933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
mode: GRACEFUL
new_leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:58642
I20260709 12:08:59.106845 16933 raft_consensus.cc:606] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Received request to transfer leadership to TS d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:59.111846 16859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692"
dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
mode: GRACEFUL
new_leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:47658
I20260709 12:08:59.112390 16859 raft_consensus.cc:606] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Received request to transfer leadership to TS d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:59.117717 16859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35"
dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
mode: GRACEFUL
new_leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:47658
I20260709 12:08:59.118268 16859 raft_consensus.cc:606] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Received request to transfer leadership to TS d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:59.122943 16859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438"
dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
mode: GRACEFUL
new_leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:47658
I20260709 12:08:59.123421 16859 raft_consensus.cc:606] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Received request to transfer leadership to TS d9a757f7aa4749f48d654f66c27b5bad
I20260709 12:08:59.168074 17100 raft_consensus.cc:993] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7: : Instructing follower d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.168589 17101 raft_consensus.cc:1081] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Signalling peer d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.170311 16783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:42942
I20260709 12:08:59.170837 16783 raft_consensus.cc:493] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:59.171274 16783 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:59.176995 16783 raft_consensus.cc:515] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.178747 16783 leader_election.cc:290] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 3 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:59.179648 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:59.179905 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:59.180491 16932 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:59.180486 16859 raft_consensus.cc:3055] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:59.181023 16859 raft_consensus.cc:740] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:08:59.182004 16859 consensus_queue.cc:260] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.183408 16859 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:59.188410 16932 raft_consensus.cc:2468] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 3.
I20260709 12:08:59.189929 16750 leader_election.cc:304] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:59.190514 16859 raft_consensus.cc:2468] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 3.
I20260709 12:08:59.190770 17099 raft_consensus.cc:2804] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:59.191833 17099 raft_consensus.cc:697] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 3 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:59.192850 17099 consensus_queue.cc:237] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.199688 16682 catalog_manager.cc:5697] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 2 to 3, leader changed from f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66) to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 3 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:59.275534 17097 raft_consensus.cc:993] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c: : Instructing follower d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.275938 17097 raft_consensus.cc:1081] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Signalling peer d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.277410 16783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:08:59.277871 16783 raft_consensus.cc:493] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:59.278167 16783 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:59.282639 16783 raft_consensus.cc:515] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.284022 16783 leader_election.cc:290] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 4 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:59.284948 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:59.285326 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:59.285542 16859 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:59.285939 16932 raft_consensus.cc:3055] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:59.286320 16932 raft_consensus.cc:740] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:59.287158 16932 consensus_queue.cc:260] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.288142 16932 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:59.290751 16859 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 4.
I20260709 12:08:59.291826 16750 leader_election.cc:304] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:59.292435 17099 raft_consensus.cc:2804] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:59.292656 16932 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 4.
I20260709 12:08:59.292820 17099 raft_consensus.cc:697] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 4 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:59.293785 17099 consensus_queue.cc:237] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.300519 16682 catalog_manager.cc:5697] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 3 to 4, leader changed from 323b92b05053418fbfbe5a62fac3832c (127.15.191.67) to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 4 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:59.351361 17108 raft_consensus.cc:993] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c: : Instructing follower d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.351824 17097 raft_consensus.cc:1081] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Signalling peer d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.353279 16783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:42950
I20260709 12:08:59.353713 16783 raft_consensus.cc:493] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:59.353957 16783 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:59.358402 16783 raft_consensus.cc:515] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.359834 16783 leader_election.cc:290] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 4 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:59.360735 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:59.361060 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecd6a6ae3c74558a1e97a521912f184" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:59.361452 16859 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:59.361534 16932 raft_consensus.cc:3055] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:59.361961 16932 raft_consensus.cc:740] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:08:59.362828 16932 consensus_queue.cc:260] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.363969 16932 raft_consensus.cc:3060] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:59.368790 16859 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 4.
I20260709 12:08:59.370070 16750 leader_election.cc:304] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:08:59.370306 16932 raft_consensus.cc:2468] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 4.
I20260709 12:08:59.370920 17099 raft_consensus.cc:2804] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:59.371402 17099 raft_consensus.cc:697] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 4 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:59.372177 17099 consensus_queue.cc:237] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.379647 16682 catalog_manager.cc:5697] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 3 to 4, leader changed from 323b92b05053418fbfbe5a62fac3832c (127.15.191.67) to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 4 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:59.470549 17100 raft_consensus.cc:993] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7: : Instructing follower d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.470989 17101 raft_consensus.cc:1081] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Signalling peer d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.472360 16783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:42942
I20260709 12:08:59.472803 16783 raft_consensus.cc:493] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:59.473127 16783 raft_consensus.cc:3060] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:59.477455 16783 raft_consensus.cc:515] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.479103 16783 leader_election.cc:290] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 3 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:59.479838 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:59.480175 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f188f28d7d444c33bf561b1eea8c8692" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:59.480440 16859 raft_consensus.cc:3055] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:59.480662 16932 raft_consensus.cc:3060] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:59.480783 16859 raft_consensus.cc:740] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:08:59.481613 16859 consensus_queue.cc:260] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.482825 16859 raft_consensus.cc:3060] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:59.487138 16932 raft_consensus.cc:2468] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 3.
I20260709 12:08:59.488262 16750 leader_election.cc:304] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:59.489039 17099 raft_consensus.cc:2804] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:59.489447 17099 raft_consensus.cc:697] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 3 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:59.489552 16859 raft_consensus.cc:2468] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 3.
I20260709 12:08:59.490396 17099 consensus_queue.cc:237] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.497720 16682 catalog_manager.cc:5697] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 2 to 3, leader changed from f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66) to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 3 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:59.519151 17100 raft_consensus.cc:993] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7: : Instructing follower d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.519605 17101 raft_consensus.cc:1081] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Signalling peer d9a757f7aa4749f48d654f66c27b5bad to start an election
I20260709 12:08:59.521106 16784 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
 from {username='slave'} at 127.0.0.1:42942
I20260709 12:08:59.521667 16784 raft_consensus.cc:493] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:59.521945 16784 raft_consensus.cc:3060] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:59.526851 16784 raft_consensus.cc:515] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.528452 16784 leader_election.cc:290] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 3 election: Requested vote from peers f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:08:59.529304 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:08:59.529445 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bdbe4717074644ac240a3df1d37b35" candidate_uuid: "d9a757f7aa4749f48d654f66c27b5bad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:08:59.529807 16859 raft_consensus.cc:3055] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:59.529975 16932 raft_consensus.cc:3060] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:59.530148 16859 raft_consensus.cc:740] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:08:59.530920 16859 consensus_queue.cc:260] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.531836 16859 raft_consensus.cc:3060] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:59.534482 16932 raft_consensus.cc:2468] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 3.
I20260709 12:08:59.535409 16750 leader_election.cc:304] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, d9a757f7aa4749f48d654f66c27b5bad; no voters: 
I20260709 12:08:59.536024 17099 raft_consensus.cc:2804] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:59.536396 17099 raft_consensus.cc:697] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 3 LEADER]: Becoming Leader. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:08:59.536707 16859 raft_consensus.cc:2468] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a757f7aa4749f48d654f66c27b5bad in term 3.
I20260709 12:08:59.537199 17099 consensus_queue.cc:237] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:08:59.545045 16682 catalog_manager.cc:5697] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad reported cstate change: term changed from 2 to 3, leader changed from f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66) to d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65). New cstate: current_term: 3 leader_uuid: "d9a757f7aa4749f48d654f66c27b5bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:59.614935 16932 raft_consensus.cc:1275] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:59.616007 17099 consensus_queue.cc:1048] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:59.626762 16859 raft_consensus.cc:1275] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:59.628587 17102 consensus_queue.cc:1048] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:59.743852 16859 raft_consensus.cc:1275] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:59.745072 17099 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:59.754779 16932 raft_consensus.cc:1275] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:59.756317 17102 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:59.810774 16859 raft_consensus.cc:1275] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:59.811964 17102 consensus_queue.cc:1048] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:59.821281 16932 raft_consensus.cc:1275] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:59.822985 17102 consensus_queue.cc:1048] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:59.972898 16859 raft_consensus.cc:1275] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:59.974201 17102 consensus_queue.cc:1048] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:59.982671 16932 raft_consensus.cc:1275] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:59.984884 17099 consensus_queue.cc:1048] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:00.046834 16859 raft_consensus.cc:1275] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:00.048084 17099 consensus_queue.cc:1048] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:00.055348 16932 raft_consensus.cc:1275] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Refusing update from remote peer d9a757f7aa4749f48d654f66c27b5bad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:00.057459 17102 consensus_queue.cc:1048] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.161787 16125 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:02.162487 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:02.170773 16784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
mode: GRACEFUL
new_leader_uuid: "323b92b05053418fbfbe5a62fac3832c"
 from {username='slave'} at 127.0.0.1:42970
I20260709 12:09:02.171329 16784 raft_consensus.cc:606] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Received request to transfer leadership to TS 323b92b05053418fbfbe5a62fac3832c
I20260709 12:09:02.180035 16784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
mode: GRACEFUL
new_leader_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:42970
I20260709 12:09:02.180564 16784 raft_consensus.cc:606] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 3 LEADER]: Received request to transfer leadership to TS f2d90bf245754935965fe9bbd57f3af7
I20260709 12:09:02.183073 16784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e585d997a0734c67aadab4751008ec31"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
mode: GRACEFUL
new_leader_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:42970
I20260709 12:09:02.183607 16784 raft_consensus.cc:606] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Received request to transfer leadership to TS f2d90bf245754935965fe9bbd57f3af7
I20260709 12:09:02.186419 16784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e"
dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
mode: GRACEFUL
new_leader_uuid: "323b92b05053418fbfbe5a62fac3832c"
 from {username='slave'} at 127.0.0.1:42970
I20260709 12:09:02.186932 16784 raft_consensus.cc:606] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 4 LEADER]: Received request to transfer leadership to TS 323b92b05053418fbfbe5a62fac3832c
I20260709 12:09:02.187906 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:02.188380 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:02.235322 17099 raft_consensus.cc:993] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad: : Instructing follower f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:09:02.235796 17127 raft_consensus.cc:1081] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 3 LEADER]: Signalling peer f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:09:02.237257 16859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438"
dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:47650
I20260709 12:09:02.237684 16859 raft_consensus.cc:493] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.238008 16859 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.242462 16859 raft_consensus.cc:515] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.244524 16859 leader_election.cc:290] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 4 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:09:02.245505 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:09:02.245669 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db5812b8c2543b2ae02b84325fce438" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:09:02.246012 16784 raft_consensus.cc:3055] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:02.246181 16932 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.246378 16784 raft_consensus.cc:740] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:09:02.247143 16784 consensus_queue.cc:260] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.248131 16784 raft_consensus.cc:3060] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.250965 16932 raft_consensus.cc:2468] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 4.
I20260709 12:09:02.252197 16825 leader_election.cc:304] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:09:02.252952 17101 raft_consensus.cc:2804] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:02.253887 17101 raft_consensus.cc:697] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 4 LEADER]: Becoming Leader. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:09:02.254587 16784 raft_consensus.cc:2468] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 4.
I20260709 12:09:02.254637 17101 consensus_queue.cc:237] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.260694 17099 raft_consensus.cc:993] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad: : Instructing follower 323b92b05053418fbfbe5a62fac3832c to start an election
I20260709 12:09:02.261122 17127 raft_consensus.cc:1081] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 4 LEADER]: Signalling peer 323b92b05053418fbfbe5a62fac3832c to start an election
I20260709 12:09:02.262495 16932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
 from {username='slave'} at 127.0.0.1:58636
I20260709 12:09:02.262169 16682 catalog_manager.cc:5697] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 reported cstate change: term changed from 3 to 4, leader changed from d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65) to f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "f2d90bf245754935965fe9bbd57f3af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.262936 16932 raft_consensus.cc:493] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.263239 16932 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:02.267822 16932 raft_consensus.cc:515] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.270535 16932 leader_election.cc:290] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 5 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:09:02.271639 16857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:09:02.271237 16784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36775931bb14fee96f0c86f9c77a22e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:09:02.272377 16857 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:02.273865 17099 raft_consensus.cc:993] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad: : Instructing follower f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:09:02.274326 17099 raft_consensus.cc:1081] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Signalling peer f2d90bf245754935965fe9bbd57f3af7 to start an election
I20260709 12:09:02.277076 16859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e585d997a0734c67aadab4751008ec31"
dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
 from {username='slave'} at 127.0.0.1:47650
I20260709 12:09:02.277626 16859 raft_consensus.cc:493] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.277953 16859 raft_consensus.cc:3060] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.279223 16857 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 5.
I20260709 12:09:02.280318 16899 leader_election.cc:304] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:09:02.280963 17097 raft_consensus.cc:2804] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:02.282224 17097 raft_consensus.cc:697] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 5 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:09:02.272524 16784 raft_consensus.cc:3055] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:02.282809 16784 raft_consensus.cc:740] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:09:02.283118 17097 consensus_queue.cc:237] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.283591 16784 consensus_queue.cc:260] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.284603 16784 raft_consensus.cc:3060] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:02.284574 16859 raft_consensus.cc:515] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.287438 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e585d997a0734c67aadab4751008ec31" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:09:02.287984 16783 raft_consensus.cc:3055] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.288004 16859 leader_election.cc:290] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 3 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), 323b92b05053418fbfbe5a62fac3832c (127.15.191.67:35815)
I20260709 12:09:02.288363 16783 raft_consensus.cc:740] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:09:02.289179 16783 consensus_queue.cc:260] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.290441 16932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e585d997a0734c67aadab4751008ec31" candidate_uuid: "f2d90bf245754935965fe9bbd57f3af7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
I20260709 12:09:02.290637 16783 raft_consensus.cc:3060] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.292073 16784 raft_consensus.cc:2468] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 5.
I20260709 12:09:02.292110 16932 raft_consensus.cc:3060] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.291509 16682 catalog_manager.cc:5697] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 4 to 5, leader changed from d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65) to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 5 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:02.296147 16783 raft_consensus.cc:2468] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 3.
I20260709 12:09:02.297264 16825 leader_election.cc:304] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9a757f7aa4749f48d654f66c27b5bad, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:09:02.297992 17101 raft_consensus.cc:2804] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.298491 17101 raft_consensus.cc:697] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 3 LEADER]: Becoming Leader. State: Replica: f2d90bf245754935965fe9bbd57f3af7, State: Running, Role: LEADER
I20260709 12:09:02.299775 16932 raft_consensus.cc:2468] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2d90bf245754935965fe9bbd57f3af7 in term 3.
I20260709 12:09:02.299326 17101 consensus_queue.cc:237] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.307108 16682 catalog_manager.cc:5697] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 reported cstate change: term changed from 2 to 3, leader changed from d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65) to f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66). New cstate: current_term: 3 leader_uuid: "f2d90bf245754935965fe9bbd57f3af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.387718 17099 raft_consensus.cc:993] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad: : Instructing follower 323b92b05053418fbfbe5a62fac3832c to start an election
I20260709 12:09:02.388172 17127 raft_consensus.cc:1081] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Signalling peer 323b92b05053418fbfbe5a62fac3832c to start an election
I20260709 12:09:02.389605 16932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e"
dest_uuid: "323b92b05053418fbfbe5a62fac3832c"
 from {username='slave'} at 127.0.0.1:58636
I20260709 12:09:02.390012 16932 raft_consensus.cc:493] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.390278 16932 raft_consensus.cc:3060] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.394765 16932 raft_consensus.cc:515] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.396441 16932 leader_election.cc:290] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 3 election: Requested vote from peers d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619), f2d90bf245754935965fe9bbd57f3af7 (127.15.191.66:45109)
I20260709 12:09:02.397377 16783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9a757f7aa4749f48d654f66c27b5bad"
I20260709 12:09:02.397588 16859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24eb1aecec09401b809c5788851e1f1e" candidate_uuid: "323b92b05053418fbfbe5a62fac3832c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2d90bf245754935965fe9bbd57f3af7"
I20260709 12:09:02.397857 16783 raft_consensus.cc:3055] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.398061 16859 raft_consensus.cc:3060] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.398190 16783 raft_consensus.cc:740] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9a757f7aa4749f48d654f66c27b5bad, State: Running, Role: LEADER
I20260709 12:09:02.398852 16783 consensus_queue.cc:260] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.400287 16783 raft_consensus.cc:3060] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.403062 16859 raft_consensus.cc:2468] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 3.
I20260709 12:09:02.404247 16899 leader_election.cc:304] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 323b92b05053418fbfbe5a62fac3832c, f2d90bf245754935965fe9bbd57f3af7; no voters: 
I20260709 12:09:02.404910 17097 raft_consensus.cc:2804] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.405306 17097 raft_consensus.cc:697] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Becoming Leader. State: Replica: 323b92b05053418fbfbe5a62fac3832c, State: Running, Role: LEADER
I20260709 12:09:02.405795 16783 raft_consensus.cc:2468] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 323b92b05053418fbfbe5a62fac3832c in term 3.
I20260709 12:09:02.406172 17097 consensus_queue.cc:237] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } }
I20260709 12:09:02.413776 16682 catalog_manager.cc:5697] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c reported cstate change: term changed from 2 to 3, leader changed from d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65) to 323b92b05053418fbfbe5a62fac3832c (127.15.191.67). New cstate: current_term: 3 leader_uuid: "323b92b05053418fbfbe5a62fac3832c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:02.657274 16783 raft_consensus.cc:1275] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.658569 17101 consensus_queue.cc:1048] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.668751 16932 raft_consensus.cc:1275] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.670487 17128 consensus_queue.cc:1048] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:02.676463 16859 raft_consensus.cc:1275] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 5 FOLLOWER]: Refusing update from remote peer 323b92b05053418fbfbe5a62fac3832c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:02.679967 17097 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:02.689814 16783 raft_consensus.cc:1275] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 5 FOLLOWER]: Refusing update from remote peer 323b92b05053418fbfbe5a62fac3832c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:02.691442 17134 consensus_queue.cc:1048] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:02.733987 16783 raft_consensus.cc:1275] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.736227 17128 consensus_queue.cc:1048] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:02.752146 16932 raft_consensus.cc:1275] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Refusing update from remote peer f2d90bf245754935965fe9bbd57f3af7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.754262 17128 consensus_queue.cc:1048] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "323b92b05053418fbfbe5a62fac3832c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.946533 16783 raft_consensus.cc:1275] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Refusing update from remote peer 323b92b05053418fbfbe5a62fac3832c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.947790 17134 consensus_queue.cc:1048] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a757f7aa4749f48d654f66c27b5bad" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:02.957994 16859 raft_consensus.cc:1275] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Refusing update from remote peer 323b92b05053418fbfbe5a62fac3832c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.960484 17134 consensus_queue.cc:1048] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2d90bf245754935965fe9bbd57f3af7" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:03.189610 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:03.195705 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:03.196141 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:04.219451 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:04.225536 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:04.225971 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:09:04.440184 16713 debug-util.cc:398] Leaking SignalData structure 0x7b08000564e0 after lost signal to thread 16128
W20260709 12:09:04.440922 16713 debug-util.cc:398] Leaking SignalData structure 0x7b0800056bc0 after lost signal to thread 16716
W20260709 12:09:04.441702 16713 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3f20 after lost signal to thread 16808
W20260709 12:09:04.442408 16713 debug-util.cc:398] Leaking SignalData structure 0x7b08000b45a0 after lost signal to thread 16883
W20260709 12:09:04.443079 16713 debug-util.cc:398] Leaking SignalData structure 0x7b08000f3540 after lost signal to thread 16957
I20260709 12:09:05.226892 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.233004 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:05.233489 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:06.234661 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.241683 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.242139 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.243150 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.248714 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.249145 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.250051 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.256541 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.257045 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.258002 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.265010 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.265491 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.266503 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.274849 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.275563 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:11.276688 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.283922 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.284418 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.316363 16125 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:12.316865 16125 tablet_server.cc:179] TabletServer@127.15.191.65:0 shutting down...
I20260709 12:09:12.341217 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:12.342010 16125 tablet_replica.cc:333] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
I20260709 12:09:12.342829 16125 raft_consensus.cc:2243] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.343345 16125 raft_consensus.cc:2272] T 8db5812b8c2543b2ae02b84325fce438 P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.345384 16125 tablet_replica.cc:333] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
I20260709 12:09:12.345966 16125 raft_consensus.cc:2243] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.346875 16125 raft_consensus.cc:2272] T 07bdbe4717074644ac240a3df1d37b35 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.348640 16125 tablet_replica.cc:333] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
I20260709 12:09:12.349274 16125 raft_consensus.cc:2243] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.349807 16125 raft_consensus.cc:2272] T f36775931bb14fee96f0c86f9c77a22e P d9a757f7aa4749f48d654f66c27b5bad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.351794 16125 tablet_replica.cc:333] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
I20260709 12:09:12.352353 16125 raft_consensus.cc:2243] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.352939 16125 raft_consensus.cc:2272] T 2a86c668e3ba4f3fa3b1264e3327600a P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.355144 16125 tablet_replica.cc:333] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
I20260709 12:09:12.355705 16125 raft_consensus.cc:2243] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.356734 16125 raft_consensus.cc:2272] T f188f28d7d444c33bf561b1eea8c8692 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.358868 16125 tablet_replica.cc:333] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
I20260709 12:09:12.359424 16125 raft_consensus.cc:2243] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.359881 16125 raft_consensus.cc:2272] T 24eb1aecec09401b809c5788851e1f1e P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.362010 16125 tablet_replica.cc:333] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
W20260709 12:09:12.362744 16899 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 12:09:12.362785 16125 raft_consensus.cc:2243] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.363905 16125 raft_consensus.cc:2272] T aecd6a6ae3c74558a1e97a521912f184 P d9a757f7aa4749f48d654f66c27b5bad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.366138 16125 tablet_replica.cc:333] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
W20260709 12:09:12.366354 16899 consensus_peers.cc:597] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c -> Peer d9a757f7aa4749f48d654f66c27b5bad (127.15.191.65:38619): Couldn't send request to peer d9a757f7aa4749f48d654f66c27b5bad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:12.366719 16125 raft_consensus.cc:2243] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.367172 16125 raft_consensus.cc:2272] T e585d997a0734c67aadab4751008ec31 P d9a757f7aa4749f48d654f66c27b5bad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.368909 16125 tablet_replica.cc:333] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
I20260709 12:09:12.369424 16125 raft_consensus.cc:2243] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.369850 16125 raft_consensus.cc:2272] T 7e181957f7e24733aaae2f472c422ce5 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.371758 16125 tablet_replica.cc:333] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad: stopping tablet replica
I20260709 12:09:12.372390 16125 raft_consensus.cc:2243] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.373200 16125 raft_consensus.cc:2272] T 667690a210f24c44a15d764956705f63 P d9a757f7aa4749f48d654f66c27b5bad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.404613 16125 tablet_server.cc:196] TabletServer@127.15.191.65:0 shutdown complete.
I20260709 12:09:12.427265 16125 tablet_server.cc:179] TabletServer@127.15.191.66:0 shutting down...
I20260709 12:09:12.454703 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:12.455498 16125 tablet_replica.cc:333] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.456382 16125 raft_consensus.cc:2243] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.456866 16125 raft_consensus.cc:2272] T f188f28d7d444c33bf561b1eea8c8692 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.459112 16125 tablet_replica.cc:333] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.459692 16125 raft_consensus.cc:2243] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.460175 16125 raft_consensus.cc:2272] T 07bdbe4717074644ac240a3df1d37b35 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.462035 16125 tablet_replica.cc:333] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.462759 16125 raft_consensus.cc:2243] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.463567 16125 raft_consensus.cc:2272] T e585d997a0734c67aadab4751008ec31 P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.465219 16125 tablet_replica.cc:333] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.465729 16125 raft_consensus.cc:2243] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.466154 16125 raft_consensus.cc:2272] T 667690a210f24c44a15d764956705f63 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.467881 16125 tablet_replica.cc:333] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.468370 16125 raft_consensus.cc:2243] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.468778 16125 raft_consensus.cc:2272] T 7e181957f7e24733aaae2f472c422ce5 P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.470676 16125 tablet_replica.cc:333] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.471258 16125 raft_consensus.cc:2243] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.471812 16125 raft_consensus.cc:2272] T f36775931bb14fee96f0c86f9c77a22e P f2d90bf245754935965fe9bbd57f3af7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.473601 16125 tablet_replica.cc:333] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.474143 16125 raft_consensus.cc:2243] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.474588 16125 raft_consensus.cc:2272] T 24eb1aecec09401b809c5788851e1f1e P f2d90bf245754935965fe9bbd57f3af7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.476292 16125 tablet_replica.cc:333] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.476967 16125 raft_consensus.cc:2243] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.477408 16125 raft_consensus.cc:2272] T aecd6a6ae3c74558a1e97a521912f184 P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.479246 16125 tablet_replica.cc:333] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.479718 16125 raft_consensus.cc:2243] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.480465 16125 raft_consensus.cc:2272] T 8db5812b8c2543b2ae02b84325fce438 P f2d90bf245754935965fe9bbd57f3af7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.482275 16125 tablet_replica.cc:333] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7: stopping tablet replica
I20260709 12:09:12.482722 16125 raft_consensus.cc:2243] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.483536 16125 raft_consensus.cc:2272] T 2a86c668e3ba4f3fa3b1264e3327600a P f2d90bf245754935965fe9bbd57f3af7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.512123 16125 tablet_server.cc:196] TabletServer@127.15.191.66:0 shutdown complete.
I20260709 12:09:12.531682 16125 tablet_server.cc:179] TabletServer@127.15.191.67:0 shutting down...
I20260709 12:09:12.556258 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:12.557081 16125 tablet_replica.cc:333] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.557740 16125 raft_consensus.cc:2243] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.558285 16125 raft_consensus.cc:2272] T 2a86c668e3ba4f3fa3b1264e3327600a P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.560302 16125 tablet_replica.cc:333] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.560916 16125 raft_consensus.cc:2243] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.561352 16125 raft_consensus.cc:2272] T f188f28d7d444c33bf561b1eea8c8692 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.563274 16125 tablet_replica.cc:333] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.563892 16125 raft_consensus.cc:2243] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.564707 16125 raft_consensus.cc:2272] T f36775931bb14fee96f0c86f9c77a22e P 323b92b05053418fbfbe5a62fac3832c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.566730 16125 tablet_replica.cc:333] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.567272 16125 raft_consensus.cc:2243] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.567773 16125 raft_consensus.cc:2272] T 07bdbe4717074644ac240a3df1d37b35 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.569667 16125 tablet_replica.cc:333] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.570359 16125 raft_consensus.cc:2243] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.571326 16125 raft_consensus.cc:2272] T 24eb1aecec09401b809c5788851e1f1e P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.573274 16125 tablet_replica.cc:333] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.573899 16125 raft_consensus.cc:2243] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.574446 16125 raft_consensus.cc:2272] T aecd6a6ae3c74558a1e97a521912f184 P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.576402 16125 tablet_replica.cc:333] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.576952 16125 raft_consensus.cc:2243] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.577749 16125 raft_consensus.cc:2272] T 7e181957f7e24733aaae2f472c422ce5 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.579527 16125 tablet_replica.cc:333] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.580122 16125 raft_consensus.cc:2243] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.580578 16125 raft_consensus.cc:2272] T 667690a210f24c44a15d764956705f63 P 323b92b05053418fbfbe5a62fac3832c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.582371 16125 tablet_replica.cc:333] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.582863 16125 raft_consensus.cc:2243] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.583303 16125 raft_consensus.cc:2272] T 8db5812b8c2543b2ae02b84325fce438 P 323b92b05053418fbfbe5a62fac3832c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.585019 16125 tablet_replica.cc:333] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c: stopping tablet replica
I20260709 12:09:12.585474 16125 raft_consensus.cc:2243] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:12.585906 16125 raft_consensus.cc:2272] T e585d997a0734c67aadab4751008ec31 P 323b92b05053418fbfbe5a62fac3832c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.614766 16125 tablet_server.cc:196] TabletServer@127.15.191.67:0 shutdown complete.
I20260709 12:09:12.634159 16125 master.cc:562] Master@127.15.191.126:41955 shutting down...
I20260709 12:09:12.653925 16125 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:12.654582 16125 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:12.654966 16125 tablet_replica.cc:333] T 00000000000000000000000000000000 P 72f06c3e9b94494c94dcb01eee54bb51: stopping tablet replica
I20260709 12:09:12.691480 16125 master.cc:584] Master@127.15.191.126:41955 shutdown complete.
323b92b05053418fbfbe5a62fac3832c  1
d9a757f7aa4749f48d654f66c27b5bad  5
f2d90bf245754935965fe9bbd57f3af7  4
323b92b05053418fbfbe5a62fac3832c  3
d9a757f7aa4749f48d654f66c27b5bad  3
f2d90bf245754935965fe9bbd57f3af7  4
323b92b05053418fbfbe5a62fac3832c  1
d9a757f7aa4749f48d654f66c27b5bad  8
f2d90bf245754935965fe9bbd57f3af7  1
323b92b05053418fbfbe5a62fac3832c  3
d9a757f7aa4749f48d654f66c27b5bad  4
f2d90bf245754935965fe9bbd57f3af7  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28606 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:12.732219 16125 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.191.126:37225
I20260709 12:09:12.733371 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:12.739037 17165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:12.739161 17164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:12.740372 17167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:12.741720 16125 server_base.cc:1061] running on GCE node
I20260709 12:09:12.743121 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:12.743343 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:12.743515 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598952743498 us; error 0 us; skew 500 ppm
I20260709 12:09:12.752351 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:12.755751 16125 webserver.cc:533] Webserver started at http://127.15.191.126:42433/ using document root <none> and password file <none>
I20260709 12:09:12.756357 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:12.756561 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:12.756865 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:12.758539 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/master-0-root/instance:
uuid: "437023cdfca24d7494e0818062a37383"
format_stamp: "Formatted at 2026-07-09 12:09:12 on dist-test-slave-1sdq"
I20260709 12:09:12.763813 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:09:12.767918 17173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:12.768764 16125 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:09:12.769140 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/master-0-root
uuid: "437023cdfca24d7494e0818062a37383"
format_stamp: "Formatted at 2026-07-09 12:09:12 on dist-test-slave-1sdq"
I20260709 12:09:12.769448 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:12.789386 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:12.790750 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:12.831523 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.126:37225
I20260709 12:09:12.831626 17224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.126:37225 every 8 connection(s)
I20260709 12:09:12.836066 17225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.847681 17225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Bootstrap starting.
I20260709 12:09:12.852869 17225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:12.858798 17225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: No bootstrap required, opened a new log
I20260709 12:09:12.861191 17225 raft_consensus.cc:359] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "437023cdfca24d7494e0818062a37383" member_type: VOTER }
I20260709 12:09:12.861868 17225 raft_consensus.cc:385] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:12.862149 17225 raft_consensus.cc:740] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 437023cdfca24d7494e0818062a37383, State: Initialized, Role: FOLLOWER
I20260709 12:09:12.862813 17225 consensus_queue.cc:260] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "437023cdfca24d7494e0818062a37383" member_type: VOTER }
I20260709 12:09:12.863309 17225 raft_consensus.cc:399] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:12.863523 17225 raft_consensus.cc:493] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:12.863775 17225 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:12.868245 17225 raft_consensus.cc:515] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "437023cdfca24d7494e0818062a37383" member_type: VOTER }
I20260709 12:09:12.868782 17225 leader_election.cc:304] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 437023cdfca24d7494e0818062a37383; no voters: 
I20260709 12:09:12.869915 17225 leader_election.cc:290] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:12.870362 17228 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:12.871819 17228 raft_consensus.cc:697] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 1 LEADER]: Becoming Leader. State: Replica: 437023cdfca24d7494e0818062a37383, State: Running, Role: LEADER
I20260709 12:09:12.872571 17228 consensus_queue.cc:237] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "437023cdfca24d7494e0818062a37383" member_type: VOTER }
I20260709 12:09:12.872975 17225 sys_catalog.cc:565] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:12.879189 17230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 437023cdfca24d7494e0818062a37383. Latest consensus state: current_term: 1 leader_uuid: "437023cdfca24d7494e0818062a37383" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "437023cdfca24d7494e0818062a37383" member_type: VOTER } }
I20260709 12:09:12.879942 17230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:12.880355 17229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "437023cdfca24d7494e0818062a37383" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "437023cdfca24d7494e0818062a37383" member_type: VOTER } }
I20260709 12:09:12.881155 17229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:12.882236 17237 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:12.889696 17237 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:12.890805 16125 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:12.899214 17237 catalog_manager.cc:1383] Generated new cluster ID: 7e57c987655f4743a058f1d2fe67bcdd
I20260709 12:09:12.899493 17237 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:12.916241 17237 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:12.917634 17237 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:12.934603 17237 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Generated new TSK 0
I20260709 12:09:12.935269 17237 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:12.957521 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:12.965341 17246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:12.966130 17247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:12.969476 16125 server_base.cc:1061] running on GCE node
W20260709 12:09:12.969395 17249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:12.970738 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:12.970981 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:12.971171 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598952971153 us; error 0 us; skew 500 ppm
I20260709 12:09:12.971791 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:12.974490 16125 webserver.cc:533] Webserver started at http://127.15.191.65:32773/ using document root <none> and password file <none>
I20260709 12:09:12.975055 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:12.975243 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:12.975543 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:12.976840 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/instance:
uuid: "33539b233c2044afa31017244f6cc0d1"
format_stamp: "Formatted at 2026-07-09 12:09:12 on dist-test-slave-1sdq"
I20260709 12:09:12.981675 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:09:12.985472 17254 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:12.986300 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:09:12.986635 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "33539b233c2044afa31017244f6cc0d1"
format_stamp: "Formatted at 2026-07-09 12:09:12 on dist-test-slave-1sdq"
I20260709 12:09:12.986922 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:12.999316 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:13.000617 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:13.002288 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:13.004808 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:13.005024 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:13.005266 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:13.005434 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:13.048914 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:43395
I20260709 12:09:13.049209 17316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:43395 every 8 connection(s)
I20260709 12:09:13.054152 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:13.061973 17321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:13.062975 17322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:13.066560 17325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:13.066591 16125 server_base.cc:1061] running on GCE node
I20260709 12:09:13.068419 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:13.068670 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:13.068846 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598953068830 us; error 0 us; skew 500 ppm
I20260709 12:09:13.069420 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:13.071906 17317 heartbeater.cc:344] Connected to a master server at 127.15.191.126:37225
I20260709 12:09:13.072405 17317 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:13.072700 16125 webserver.cc:533] Webserver started at http://127.15.191.66:46185/ using document root <none> and password file <none>
I20260709 12:09:13.073346 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:13.073342 17317 heartbeater.cc:507] Master 127.15.191.126:37225 requested a full tablet report, sending...
I20260709 12:09:13.073745 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:13.074085 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:13.075467 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/instance:
uuid: "aaafaad0810b4e95983d2d73ec814346"
format_stamp: "Formatted at 2026-07-09 12:09:13 on dist-test-slave-1sdq"
I20260709 12:09:13.076020 17190 ts_manager.cc:194] Registered new tserver with Master: 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:13.077896 17190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55928
I20260709 12:09:13.080355 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:09:13.083942 17329 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:13.084806 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:09:13.085129 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root
uuid: "aaafaad0810b4e95983d2d73ec814346"
format_stamp: "Formatted at 2026-07-09 12:09:13 on dist-test-slave-1sdq"
I20260709 12:09:13.085403 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:13.112586 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:13.113842 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:13.115408 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:13.117759 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:13.117969 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:13.118253 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:13.118402 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:13.164067 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.66:35675
I20260709 12:09:13.164152 17391 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.66:35675 every 8 connection(s)
I20260709 12:09:13.168835 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:13.177389 17395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:13.178712 17396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:13.180613 16125 server_base.cc:1061] running on GCE node
W20260709 12:09:13.181015 17399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:13.182174 17392 heartbeater.cc:344] Connected to a master server at 127.15.191.126:37225
I20260709 12:09:13.182175 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:13.182629 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:13.182637 17392 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:13.182898 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598953182878 us; error 0 us; skew 500 ppm
I20260709 12:09:13.183557 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:13.183681 17392 heartbeater.cc:507] Master 127.15.191.126:37225 requested a full tablet report, sending...
I20260709 12:09:13.186043 17190 ts_manager.cc:194] Registered new tserver with Master: aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:13.186379 16125 webserver.cc:533] Webserver started at http://127.15.191.67:42543/ using document root <none> and password file <none>
I20260709 12:09:13.187017 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:13.187327 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:13.187647 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:13.187929 17190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55932
I20260709 12:09:13.189204 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/instance:
uuid: "e860f7e876b74ec589f447737822a4f6"
format_stamp: "Formatted at 2026-07-09 12:09:13 on dist-test-slave-1sdq"
I20260709 12:09:13.194192 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:09:13.197788 17403 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:13.198694 16125 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:09:13.198982 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root
uuid: "e860f7e876b74ec589f447737822a4f6"
format_stamp: "Formatted at 2026-07-09 12:09:13 on dist-test-slave-1sdq"
I20260709 12:09:13.199241 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:13.213268 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:13.214761 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:13.216456 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:13.219116 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:13.219343 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:13.219586 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:13.219738 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:13.260953 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.67:34917
I20260709 12:09:13.261157 17465 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.67:34917 every 8 connection(s)
I20260709 12:09:13.280218 17466 heartbeater.cc:344] Connected to a master server at 127.15.191.126:37225
I20260709 12:09:13.280720 17466 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:13.281577 17466 heartbeater.cc:507] Master 127.15.191.126:37225 requested a full tablet report, sending...
I20260709 12:09:13.283784 17190 ts_manager.cc:194] Registered new tserver with Master: e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:13.284010 16125 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019920127s
I20260709 12:09:13.285615 17190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55944
I20260709 12:09:13.311803 17190 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55954:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:13.317971 17190 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:13.543205 17282 tablet_service.cc:1511] Processing CreateTablet for tablet 4466b54543584a9898797997087d10f1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:13.544593 17357 tablet_service.cc:1511] Processing CreateTablet for tablet 4466b54543584a9898797997087d10f1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:13.545943 17356 tablet_service.cc:1511] Processing CreateTablet for tablet 8832d652d7004314892ca1c18bd94f7c (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:13.546154 17279 tablet_service.cc:1511] Processing CreateTablet for tablet eb339cd935184a289cfac7d49d2f74d3 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:13.547067 17353 tablet_service.cc:1511] Processing CreateTablet for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:13.547194 17276 tablet_service.cc:1511] Processing CreateTablet for tablet 3a03a1e696734298850b94830af8a727 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:13.548573 17278 tablet_service.cc:1511] Processing CreateTablet for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:13.549479 17352 tablet_service.cc:1511] Processing CreateTablet for tablet 119706da80854a2680f098d29fac4c43 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:13.549677 17355 tablet_service.cc:1511] Processing CreateTablet for tablet d6c49969609c4c85a0a31036764369c0 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:13.551007 17277 tablet_service.cc:1511] Processing CreateTablet for tablet 119706da80854a2680f098d29fac4c43 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:13.552078 17354 tablet_service.cc:1511] Processing CreateTablet for tablet eb339cd935184a289cfac7d49d2f74d3 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:13.552556 17351 tablet_service.cc:1511] Processing CreateTablet for tablet 3a03a1e696734298850b94830af8a727 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:13.553472 17281 tablet_service.cc:1511] Processing CreateTablet for tablet 8832d652d7004314892ca1c18bd94f7c (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:13.554400 17275 tablet_service.cc:1511] Processing CreateTablet for tablet 4b90fb9f510d4f0abcf7148b6fafae89 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:13.555796 17350 tablet_service.cc:1511] Processing CreateTablet for tablet 4b90fb9f510d4f0abcf7148b6fafae89 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:13.545982 17357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4466b54543584a9898797997087d10f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.557343 17352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119706da80854a2680f098d29fac4c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.558187 17280 tablet_service.cc:1511] Processing CreateTablet for tablet d6c49969609c4c85a0a31036764369c0 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:13.558387 17274 tablet_service.cc:1511] Processing CreateTablet for tablet b9356b25ee58416ca89b944be6f0b562 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:13.560214 17350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b90fb9f510d4f0abcf7148b6fafae89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.561584 17356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8832d652d7004314892ca1c18bd94f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.563328 17349 tablet_service.cc:1511] Processing CreateTablet for tablet b9356b25ee58416ca89b944be6f0b562 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:13.564812 17349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9356b25ee58416ca89b944be6f0b562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.567371 17348 tablet_service.cc:1511] Processing CreateTablet for tablet 4ddf5e2cbdb748f7a7ed880493377874 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:13.568816 17348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddf5e2cbdb748f7a7ed880493377874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.570891 17273 tablet_service.cc:1511] Processing CreateTablet for tablet 4ddf5e2cbdb748f7a7ed880493377874 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:13.573247 17431 tablet_service.cc:1511] Processing CreateTablet for tablet 4466b54543584a9898797997087d10f1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:13.544831 17282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4466b54543584a9898797997087d10f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.574054 17351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a03a1e696734298850b94830af8a727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.575145 17430 tablet_service.cc:1511] Processing CreateTablet for tablet 8832d652d7004314892ca1c18bd94f7c (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:13.575798 17353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.576534 17430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8832d652d7004314892ca1c18bd94f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.578485 17354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb339cd935184a289cfac7d49d2f74d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.579130 17278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.579262 17429 tablet_service.cc:1511] Processing CreateTablet for tablet d6c49969609c4c85a0a31036764369c0 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:13.580668 17429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c49969609c4c85a0a31036764369c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.582442 17355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c49969609c4c85a0a31036764369c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.583320 17428 tablet_service.cc:1511] Processing CreateTablet for tablet eb339cd935184a289cfac7d49d2f74d3 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:13.584694 17428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb339cd935184a289cfac7d49d2f74d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.587304 17427 tablet_service.cc:1511] Processing CreateTablet for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:13.588783 17427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.591326 17426 tablet_service.cc:1511] Processing CreateTablet for tablet 119706da80854a2680f098d29fac4c43 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:13.592762 17426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119706da80854a2680f098d29fac4c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.588770 17276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a03a1e696734298850b94830af8a727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.594838 17279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb339cd935184a289cfac7d49d2f74d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.595284 17425 tablet_service.cc:1511] Processing CreateTablet for tablet 3a03a1e696734298850b94830af8a727 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:13.596688 17425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a03a1e696734298850b94830af8a727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.596726 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddf5e2cbdb748f7a7ed880493377874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.599597 17424 tablet_service.cc:1511] Processing CreateTablet for tablet 4b90fb9f510d4f0abcf7148b6fafae89 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:13.600888 17280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c49969609c4c85a0a31036764369c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.603942 17423 tablet_service.cc:1511] Processing CreateTablet for tablet b9356b25ee58416ca89b944be6f0b562 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:13.606925 17422 tablet_service.cc:1511] Processing CreateTablet for tablet 4ddf5e2cbdb748f7a7ed880493377874 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:13.608193 17424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b90fb9f510d4f0abcf7148b6fafae89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.610388 17422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddf5e2cbdb748f7a7ed880493377874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.610749 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9356b25ee58416ca89b944be6f0b562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.612650 17431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4466b54543584a9898797997087d10f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.614480 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b90fb9f510d4f0abcf7148b6fafae89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.616521 17423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9356b25ee58416ca89b944be6f0b562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.618508 17277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119706da80854a2680f098d29fac4c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.626758 17281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8832d652d7004314892ca1c18bd94f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.707755 17273 tablet_service.cc:1511] Processing CreateTablet for tablet 623409527b5e49f3a95ae127569da2b0 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:13.709106 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623409527b5e49f3a95ae127569da2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.710431 17354 tablet_service.cc:1511] Processing CreateTablet for tablet 3673757d03f243668794c10285c7d1ff (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:13.711724 17354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3673757d03f243668794c10285c7d1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.713428 17280 tablet_service.cc:1511] Processing CreateTablet for tablet 3673757d03f243668794c10285c7d1ff (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:13.709686 17353 tablet_service.cc:1511] Processing CreateTablet for tablet 623409527b5e49f3a95ae127569da2b0 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:13.715004 17353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623409527b5e49f3a95ae127569da2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.720597 17430 tablet_service.cc:1511] Processing CreateTablet for tablet c44e7f48dd474ca1a12a7ac7251f4c6f (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:13.721915 17430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44e7f48dd474ca1a12a7ac7251f4c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.726263 17357 tablet_service.cc:1511] Processing CreateTablet for tablet c44e7f48dd474ca1a12a7ac7251f4c6f (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:13.727741 17357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44e7f48dd474ca1a12a7ac7251f4c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.728343 17280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3673757d03f243668794c10285c7d1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.730964 17277 tablet_service.cc:1511] Processing CreateTablet for tablet c44e7f48dd474ca1a12a7ac7251f4c6f (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:13.732271 17277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44e7f48dd474ca1a12a7ac7251f4c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.734058 17273 tablet_service.cc:1511] Processing CreateTablet for tablet 51f32408cb854e64a70dc3560f27b02e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:13.735373 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f32408cb854e64a70dc3560f27b02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.750129 17352 tablet_service.cc:1511] Processing CreateTablet for tablet 51f32408cb854e64a70dc3560f27b02e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:13.751669 17352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f32408cb854e64a70dc3560f27b02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.697628 17425 tablet_service.cc:1511] Processing CreateTablet for tablet 623409527b5e49f3a95ae127569da2b0 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:13.751708 17422 tablet_service.cc:1511] Processing CreateTablet for tablet e31ef54befbd4be3b1626005e275d427 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:13.754347 17425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623409527b5e49f3a95ae127569da2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.750211 17274 tablet_service.cc:1511] Processing CreateTablet for tablet e31ef54befbd4be3b1626005e275d427 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:13.758968 17422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31ef54befbd4be3b1626005e275d427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.759467 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31ef54befbd4be3b1626005e275d427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.761435 17349 tablet_service.cc:1511] Processing CreateTablet for tablet e31ef54befbd4be3b1626005e275d427 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:13.762749 17349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31ef54befbd4be3b1626005e275d427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.772629 17348 tablet_service.cc:1511] Processing CreateTablet for tablet b55e72b6c888480d92e455681414fbb0 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:13.804565 17348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55e72b6c888480d92e455681414fbb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.772830 17276 tablet_service.cc:1511] Processing CreateTablet for tablet b55e72b6c888480d92e455681414fbb0 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:13.806488 17273 tablet_service.cc:1511] Processing CreateTablet for tablet c6728648e29b471c950575a72ecf0454 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:13.766076 17281 tablet_service.cc:1511] Processing CreateTablet for tablet 51babcffb8ce4ac99ebd5354a7c7d898 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:13.807525 17276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55e72b6c888480d92e455681414fbb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.770787 17483 tablet_bootstrap.cc:492] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:13.781599 17356 tablet_service.cc:1511] Processing CreateTablet for tablet 539116186b9c4b269f16afb90a4654f4 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:13.769634 17351 tablet_service.cc:1511] Processing CreateTablet for tablet 51babcffb8ce4ac99ebd5354a7c7d898 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:13.862937 17351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51babcffb8ce4ac99ebd5354a7c7d898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.770455 17428 tablet_service.cc:1511] Processing CreateTablet for tablet 3673757d03f243668794c10285c7d1ff (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:13.842651 17429 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:13.868484 17352 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbcd6d92bbd4175a2f8233eb40726ad (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:13.869302 17429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.842935 17355 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:13.829469 17431 tablet_service.cc:1511] Processing CreateTablet for tablet 539116186b9c4b269f16afb90a4654f4 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:13.871024 17431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539116186b9c4b269f16afb90a4654f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.844326 17353 tablet_service.cc:1511] Processing CreateTablet for tablet c6728648e29b471c950575a72ecf0454 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:13.826021 17430 tablet_service.cc:1511] Processing CreateTablet for tablet b55e72b6c888480d92e455681414fbb0 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:13.875603 17430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55e72b6c888480d92e455681414fbb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.850235 17424 tablet_service.cc:1511] Processing CreateTablet for tablet c6728648e29b471c950575a72ecf0454 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:13.836061 17280 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:13.878719 17424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6728648e29b471c950575a72ecf0454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.880205 17275 tablet_service.cc:1511] Processing CreateTablet for tablet 539116186b9c4b269f16afb90a4654f4 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:13.882123 17481 tablet_bootstrap.cc:492] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
W20260709 12:09:13.884414 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:13.877808 17348 tablet_service.cc:1511] Processing CreateTablet for tablet 9367e72dd7c24f7e8aa4d479a069ed0e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:13.889076 17280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.890424 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6728648e29b471c950575a72ecf0454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.891232 17278 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbcd6d92bbd4175a2f8233eb40726ad (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:13.892549 17278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbcd6d92bbd4175a2f8233eb40726ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.899488 17423 tablet_service.cc:1511] Processing CreateTablet for tablet fe9b4ec086384e2b800cbd4d98e9fe33 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:13.900883 17423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9b4ec086384e2b800cbd4d98e9fe33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.902804 17281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51babcffb8ce4ac99ebd5354a7c7d898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.851382 17357 tablet_service.cc:1511] Processing CreateTablet for tablet 12b75d8684e5472b87d6b3acb0ef9d2e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:13.853037 17350 tablet_service.cc:1511] Processing CreateTablet for tablet fe9b4ec086384e2b800cbd4d98e9fe33 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:13.903921 17428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3673757d03f243668794c10285c7d1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.854768 17274 tablet_service.cc:1511] Processing CreateTablet for tablet 12b75d8684e5472b87d6b3acb0ef9d2e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:13.905313 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b75d8684e5472b87d6b3acb0ef9d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.849493 17422 tablet_service.cc:1511] Processing CreateTablet for tablet 12b75d8684e5472b87d6b3acb0ef9d2e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:13.906977 17422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b75d8684e5472b87d6b3acb0ef9d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.907421 17277 tablet_service.cc:1511] Processing CreateTablet for tablet f462146b97ed46f2821bee27630d0218 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:13.767271 17482 tablet_bootstrap.cc:492] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:13.772976 17426 tablet_service.cc:1511] Processing CreateTablet for tablet 51f32408cb854e64a70dc3560f27b02e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:13.790611 17427 tablet_service.cc:1511] Processing CreateTablet for tablet 51babcffb8ce4ac99ebd5354a7c7d898 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:13.908918 17277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f462146b97ed46f2821bee27630d0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.909858 17427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51babcffb8ce4ac99ebd5354a7c7d898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.867424 17282 tablet_service.cc:1511] Processing CreateTablet for tablet fe9b4ec086384e2b800cbd4d98e9fe33 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:13.912292 17282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9b4ec086384e2b800cbd4d98e9fe33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.867410 17356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539116186b9c4b269f16afb90a4654f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.915817 17426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f32408cb854e64a70dc3560f27b02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.918655 17279 tablet_service.cc:1511] Processing CreateTablet for tablet 9367e72dd7c24f7e8aa4d479a069ed0e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:13.920310 17279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9367e72dd7c24f7e8aa4d479a069ed0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.930658 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539116186b9c4b269f16afb90a4654f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.936743 17353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6728648e29b471c950575a72ecf0454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.937446 17355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.938650 17352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbcd6d92bbd4175a2f8233eb40726ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.940312 17350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9b4ec086384e2b800cbd4d98e9fe33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.942713 17348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9367e72dd7c24f7e8aa4d479a069ed0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.949337 17357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b75d8684e5472b87d6b3acb0ef9d2e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:13.954744 17176 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 47841.1us
I20260709 12:09:13.960719 17481 tablet_bootstrap.cc:654] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.964751 17482 tablet_bootstrap.cc:654] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.988906 17483 tablet_bootstrap.cc:654] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.991993 17354 tablet_service.cc:1511] Processing CreateTablet for tablet f462146b97ed46f2821bee27630d0218 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:13.988184 17425 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbcd6d92bbd4175a2f8233eb40726ad (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:14.019059 17354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f462146b97ed46f2821bee27630d0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.025210 17349 tablet_service.cc:1511] Processing CreateTablet for tablet 4198acb44a394602a442737d55022d72 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:13.989915 17429 tablet_service.cc:1511] Processing CreateTablet for tablet 9367e72dd7c24f7e8aa4d479a069ed0e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:14.054003 17425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbcd6d92bbd4175a2f8233eb40726ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.066196 17349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4198acb44a394602a442737d55022d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.075263 17430 tablet_service.cc:1511] Processing CreateTablet for tablet 4198acb44a394602a442737d55022d72 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:14.080608 17317 heartbeater.cc:499] Master 127.15.191.126:37225 was elected leader, sending a full tablet report...
I20260709 12:09:14.082144 17424 tablet_service.cc:1511] Processing CreateTablet for tablet f462146b97ed46f2821bee27630d0218 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:14.084455 17428 tablet_service.cc:1511] Processing CreateTablet for tablet 814b69784b0f4c3d8b07d13d54ae4b47 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:14.084714 17273 tablet_service.cc:1511] Processing CreateTablet for tablet 4198acb44a394602a442737d55022d72 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:14.085942 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4198acb44a394602a442737d55022d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.087781 17278 tablet_service.cc:1511] Processing CreateTablet for tablet d582e1abf9be42689682da4cee6206c8 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:14.093356 17357 tablet_service.cc:1511] Processing CreateTablet for tablet a9955d24ad7243689a5a438424f992e9 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:14.101213 17353 tablet_service.cc:1511] Processing CreateTablet for tablet 8386bc0b5fc7467d87ca1ca69464e42e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:14.086462 17350 tablet_service.cc:1511] Processing CreateTablet for tablet d582e1abf9be42689682da4cee6206c8 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:14.108130 17351 tablet_service.cc:1511] Processing CreateTablet for tablet 814b69784b0f4c3d8b07d13d54ae4b47 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:14.118435 17483 tablet_bootstrap.cc:492] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:14.119011 17483 ts_tablet_manager.cc:1403] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.349s	user 0.014s	sys 0.029s
I20260709 12:09:14.119932 17481 tablet_bootstrap.cc:492] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:14.120389 17481 ts_tablet_manager.cc:1403] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.239s	user 0.012s	sys 0.013s
I20260709 12:09:14.121408 17278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d582e1abf9be42689682da4cee6206c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.121905 17483 raft_consensus.cc:359] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.122439 17353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8386bc0b5fc7467d87ca1ca69464e42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.123409 17357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9955d24ad7243689a5a438424f992e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.124871 17355 tablet_service.cc:1511] Processing CreateTablet for tablet 94fb1d5d8c204d70a68af6043f3ba9dd (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:14.125867 17429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9367e72dd7c24f7e8aa4d479a069ed0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.126274 17483 raft_consensus.cc:385] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.144582 17483 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.145416 17483 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.129170 17422 tablet_service.cc:1511] Processing CreateTablet for tablet a9955d24ad7243689a5a438424f992e9 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:14.146016 17280 tablet_service.cc:1511] Processing CreateTablet for tablet 8386bc0b5fc7467d87ca1ca69464e42e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:14.146991 17422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9955d24ad7243689a5a438424f992e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.147357 17280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8386bc0b5fc7467d87ca1ca69464e42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.143358 17423 tablet_service.cc:1511] Processing CreateTablet for tablet 8386bc0b5fc7467d87ca1ca69464e42e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:14.148787 17423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8386bc0b5fc7467d87ca1ca69464e42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.129170 17431 tablet_service.cc:1511] Processing CreateTablet for tablet d582e1abf9be42689682da4cee6206c8 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:14.150521 17431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d582e1abf9be42689682da4cee6206c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.151824 17276 tablet_service.cc:1511] Processing CreateTablet for tablet 94fb1d5d8c204d70a68af6043f3ba9dd (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:14.153147 17276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94fb1d5d8c204d70a68af6043f3ba9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.124871 17277 tablet_service.cc:1511] Processing CreateTablet for tablet a9955d24ad7243689a5a438424f992e9 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:14.131347 17481 raft_consensus.cc:359] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.132462 17350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d582e1abf9be42689682da4cee6206c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.156093 17481 raft_consensus.cc:385] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.156461 17481 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.157208 17481 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.157105 17428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814b69784b0f4c3d8b07d13d54ae4b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.133213 17274 tablet_service.cc:1511] Processing CreateTablet for tablet 814b69784b0f4c3d8b07d13d54ae4b47 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:14.162460 17430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4198acb44a394602a442737d55022d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.162861 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814b69784b0f4c3d8b07d13d54ae4b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.164217 17352 tablet_service.cc:1511] Processing CreateTablet for tablet f7c3705a9e0e457898a7061b4170a8a1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:14.166465 17424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f462146b97ed46f2821bee27630d0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.166070 17348 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4d0995911b4beb98abd9a7a508cddc (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:14.188202 17351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814b69784b0f4c3d8b07d13d54ae4b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.206557 17355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94fb1d5d8c204d70a68af6043f3ba9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.207211 17425 tablet_service.cc:1511] Processing CreateTablet for tablet 94fb1d5d8c204d70a68af6043f3ba9dd (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:14.208577 17425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94fb1d5d8c204d70a68af6043f3ba9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.162460 17282 tablet_service.cc:1511] Processing CreateTablet for tablet f7c3705a9e0e457898a7061b4170a8a1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:14.210440 17352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7c3705a9e0e457898a7061b4170a8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.211225 17348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4d0995911b4beb98abd9a7a508cddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.217012 17277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9955d24ad7243689a5a438424f992e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.222903 17282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7c3705a9e0e457898a7061b4170a8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.223747 17275 tablet_service.cc:1511] Processing CreateTablet for tablet e8f15a1b060b43ca9ea130feba217bcf (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:14.225066 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f15a1b060b43ca9ea130feba217bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.229450 17423 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4d0995911b4beb98abd9a7a508cddc (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:14.196584 17281 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4d0995911b4beb98abd9a7a508cddc (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:14.238832 17426 tablet_service.cc:1511] Processing CreateTablet for tablet f7c3705a9e0e457898a7061b4170a8a1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:14.239979 17281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4d0995911b4beb98abd9a7a508cddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.195338 17392 heartbeater.cc:499] Master 127.15.191.126:37225 was elected leader, sending a full tablet report...
I20260709 12:09:14.230844 17466 heartbeater.cc:499] Master 127.15.191.126:37225 was elected leader, sending a full tablet report...
I20260709 12:09:14.195561 17483 ts_tablet_manager.cc:1434] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.013s
I20260709 12:09:14.241503 17483 tablet_bootstrap.cc:492] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:14.232210 17482 tablet_bootstrap.cc:492] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:14.234881 17276 tablet_service.cc:1511] Processing CreateTablet for tablet f7130b980d9147f2b3915212d4028e03 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:14.246528 17482 ts_tablet_manager.cc:1403] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.480s	user 0.012s	sys 0.013s
I20260709 12:09:14.236100 17279 tablet_service.cc:1511] Processing CreateTablet for tablet ee22d4e5e05e423097297625d6158f21 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:14.237236 17481 ts_tablet_manager.cc:1434] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.117s	user 0.013s	sys 0.013s
I20260709 12:09:14.252496 17481 tablet_bootstrap.cc:492] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:14.240118 17426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7c3705a9e0e457898a7061b4170a8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.250893 17276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7130b980d9147f2b3915212d4028e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.251251 17487 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.253955 17487 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.249576 17482 raft_consensus.cc:359] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.258838 17482 raft_consensus.cc:385] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.259268 17482 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.260288 17279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee22d4e5e05e423097297625d6158f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.260067 17482 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.233974 17273 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:14.262368 17352 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:14.281479 17352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.284276 17349 tablet_service.cc:1511] Processing CreateTablet for tablet ee22d4e5e05e423097297625d6158f21 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:14.285615 17349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee22d4e5e05e423097297625d6158f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.263484 17487 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:14.299170 17483 tablet_bootstrap.cc:654] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.320251 17427 tablet_service.cc:1511] Processing CreateTablet for tablet e8f15a1b060b43ca9ea130feba217bcf (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:14.329885 17356 tablet_service.cc:1511] Processing CreateTablet for tablet 1c41ebef06654a43a98e69d0c065bba4 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:14.330938 17429 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:14.331585 17356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c41ebef06654a43a98e69d0c065bba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.241452 17353 tablet_service.cc:1511] Processing CreateTablet for tablet e8f15a1b060b43ca9ea130feba217bcf (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:14.338759 17353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f15a1b060b43ca9ea130feba217bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.348766 17355 tablet_service.cc:1511] Processing CreateTablet for tablet f7130b980d9147f2b3915212d4028e03 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:14.353391 17355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7130b980d9147f2b3915212d4028e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.349709 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.333956 17350 tablet_service.cc:1511] Processing CreateTablet for tablet 18a366d5769a4ed9bb2b1e32afb26cd3 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:14.360674 17423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4d0995911b4beb98abd9a7a508cddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.361178 17350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a366d5769a4ed9bb2b1e32afb26cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.361431 17429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.363924 17427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f15a1b060b43ca9ea130feba217bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.380612 17274 tablet_service.cc:1511] Processing CreateTablet for tablet 1c41ebef06654a43a98e69d0c065bba4 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:14.382063 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c41ebef06654a43a98e69d0c065bba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.401708 17431 tablet_service.cc:1511] Processing CreateTablet for tablet f7130b980d9147f2b3915212d4028e03 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:14.408299 17488 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.420898 17488 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.421953 17482 ts_tablet_manager.cc:1434] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.175s	user 0.048s	sys 0.061s
I20260709 12:09:14.423085 17482 tablet_bootstrap.cc:492] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:14.426681 17488 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:14.450357 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:14.451210 17367 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:14.452183 17430 tablet_service.cc:1511] Processing CreateTablet for tablet 1c41ebef06654a43a98e69d0c065bba4 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:14.452780 17255 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:14.453644 17487 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:14.453999 17487 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:14.454356 17487 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.456270 17429 tablet_service.cc:1511] Processing CreateTablet for tablet 18a366d5769a4ed9bb2b1e32afb26cd3 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:14.459306 17424 tablet_service.cc:1511] Processing CreateTablet for tablet ff2e0aa678a447dcab13573f3577208e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:14.450443 17428 tablet_service.cc:1511] Processing CreateTablet for tablet ee22d4e5e05e423097297625d6158f21 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:14.461532 17487 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.464409 17481 tablet_bootstrap.cc:654] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.464560 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:14.465219 17367 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.478560 17348 tablet_service.cc:1511] Processing CreateTablet for tablet ff2e0aa678a447dcab13573f3577208e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:14.479813 17431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7130b980d9147f2b3915212d4028e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.483675 17280 tablet_service.cc:1511] Processing CreateTablet for tablet 18a366d5769a4ed9bb2b1e32afb26cd3 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:14.484951 17348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e0aa678a447dcab13573f3577208e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.484947 17280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a366d5769a4ed9bb2b1e32afb26cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.496373 17430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c41ebef06654a43a98e69d0c065bba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.498260 17428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee22d4e5e05e423097297625d6158f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.499306 17354 tablet_service.cc:1511] Processing CreateTablet for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:14.503924 17424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e0aa678a447dcab13573f3577208e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.505927 17354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.529801 17277 tablet_service.cc:1511] Processing CreateTablet for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:14.531208 17277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.521938 17429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a366d5769a4ed9bb2b1e32afb26cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.533838 17278 tablet_service.cc:1511] Processing CreateTablet for tablet 8789c06ba7714e709d794ce12c4141d1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:14.535178 17278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8789c06ba7714e709d794ce12c4141d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.538632 17352 tablet_service.cc:1511] Processing CreateTablet for tablet 8789c06ba7714e709d794ce12c4141d1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:14.539996 17352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8789c06ba7714e709d794ce12c4141d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.525933 17281 tablet_service.cc:1511] Processing CreateTablet for tablet ff2e0aa678a447dcab13573f3577208e (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:14.543093 17281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e0aa678a447dcab13573f3577208e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.515749 17487 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:14.548061 17351 tablet_service.cc:1511] Processing CreateTablet for tablet 6685bf7292cc44e09a9965668c0345cc (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:14.551044 17483 tablet_bootstrap.cc:492] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:14.556205 17279 tablet_service.cc:1511] Processing CreateTablet for tablet faefcc2755734398b9b0b1a778da9a50 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:14.581985 17279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faefcc2755734398b9b0b1a778da9a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.584664 17357 tablet_service.cc:1511] Processing CreateTablet for tablet a77855d79ba04cf1bf33cc20e8236abc (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:14.588217 17425 tablet_service.cc:1511] Processing CreateTablet for tablet a77855d79ba04cf1bf33cc20e8236abc (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:14.589521 17280 tablet_service.cc:1511] Processing CreateTablet for tablet ff74c08559a64593bfe9cdc08a3b96d1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:14.591032 17280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff74c08559a64593bfe9cdc08a3b96d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.559996 17482 tablet_bootstrap.cc:654] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.553751 17367 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:14.564248 17483 ts_tablet_manager.cc:1403] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.323s	user 0.010s	sys 0.016s
I20260709 12:09:14.599253 17483 raft_consensus.cc:359] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.600149 17483 raft_consensus.cc:385] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.600469 17483 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.601698 17483 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.564615 17351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6685bf7292cc44e09a9965668c0345cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.566406 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:14.571283 17430 tablet_service.cc:1511] Processing CreateTablet for tablet 6685bf7292cc44e09a9965668c0345cc (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:14.566883 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:14.561856 17427 tablet_service.cc:1511] Processing CreateTablet for tablet 8789c06ba7714e709d794ce12c4141d1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:14.609011 17483 ts_tablet_manager.cc:1434] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:09:14.579777 17278 tablet_service.cc:1511] Processing CreateTablet for tablet b3657462e03f42ac95c71bed480ca6a6 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:14.562064 17275 tablet_service.cc:1511] Processing CreateTablet for tablet a77855d79ba04cf1bf33cc20e8236abc (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:14.594784 17255 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:14.589984 17425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77855d79ba04cf1bf33cc20e8236abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.567026 17423 tablet_service.cc:1511] Processing CreateTablet for tablet faefcc2755734398b9b0b1a778da9a50 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:14.554733 17422 tablet_service.cc:1511] Processing CreateTablet for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:14.575624 17276 tablet_service.cc:1511] Processing CreateTablet for tablet d7f622d20c7b40a296d381dcc9b82704 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:14.558040 17355 tablet_service.cc:1511] Processing CreateTablet for tablet faefcc2755734398b9b0b1a778da9a50 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:14.617348 17282 tablet_service.cc:1511] Processing CreateTablet for tablet 6685bf7292cc44e09a9965668c0345cc (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 12:09:14.622493 17258 leader_election.cc:343] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:14.623535 17258 leader_election.cc:343] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.626330 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:09:14.628245 17404 leader_election.cc:343] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.623445 17278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3657462e03f42ac95c71bed480ca6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.632607 17426 tablet_service.cc:1511] Processing CreateTablet for tablet b3657462e03f42ac95c71bed480ca6a6 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:14.637204 17354 tablet_service.cc:1511] Processing CreateTablet for tablet b3657462e03f42ac95c71bed480ca6a6 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:14.637671 17424 tablet_service.cc:1511] Processing CreateTablet for tablet d7f622d20c7b40a296d381dcc9b82704 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:14.630055 17350 tablet_service.cc:1511] Processing CreateTablet for tablet d7f622d20c7b40a296d381dcc9b82704 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:14.641242 17427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8789c06ba7714e709d794ce12c4141d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.642393 17483 tablet_bootstrap.cc:492] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:14.644471 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77855d79ba04cf1bf33cc20e8236abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.630529 17487 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:14.646415 17487 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:14.647303 17487 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.648762 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:14.652251 17423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faefcc2755734398b9b0b1a778da9a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.652948 17422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:14.655391 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 60707.9us
I20260709 12:09:14.656381 17282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6685bf7292cc44e09a9965668c0345cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.657052 17481 tablet_bootstrap.cc:492] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:14.657564 17481 ts_tablet_manager.cc:1403] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.405s	user 0.024s	sys 0.010s
I20260709 12:09:14.658535 17430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6685bf7292cc44e09a9965668c0345cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.664649 17481 raft_consensus.cc:359] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.649960 17357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77855d79ba04cf1bf33cc20e8236abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.666129 17481 raft_consensus.cc:385] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.666673 17481 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.667683 17355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faefcc2755734398b9b0b1a778da9a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.670459 17354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3657462e03f42ac95c71bed480ca6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.671244 17349 tablet_service.cc:1511] Processing CreateTablet for tablet ff74c08559a64593bfe9cdc08a3b96d1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:09:14.674815 17406 leader_election.cc:343] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.675103 17481 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.675346 17406 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:14.671851 17424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f622d20c7b40a296d381dcc9b82704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.679214 17276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f622d20c7b40a296d381dcc9b82704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.680505 17349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff74c08559a64593bfe9cdc08a3b96d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.680989 17428 tablet_service.cc:1511] Processing CreateTablet for tablet ff74c08559a64593bfe9cdc08a3b96d1 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:14.675338 17353 tablet_service.cc:1511] Processing CreateTablet for tablet b72f5fa94fdd4fedb64a0e5db13dc3a5 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:14.686249 17428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff74c08559a64593bfe9cdc08a3b96d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.658021 17273 tablet_service.cc:1511] Processing CreateTablet for tablet b72f5fa94fdd4fedb64a0e5db13dc3a5 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:14.687250 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72f5fa94fdd4fedb64a0e5db13dc3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.687796 17488 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:14.702412 17426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3657462e03f42ac95c71bed480ca6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.704974 17429 tablet_service.cc:1511] Processing CreateTablet for tablet b72f5fa94fdd4fedb64a0e5db13dc3a5 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:14.706532 17429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72f5fa94fdd4fedb64a0e5db13dc3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.710542 17278 tablet_service.cc:1511] Processing CreateTablet for tablet 62f5a9a5a773414fa979e4e68b31bb5d (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:14.712073 17278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f5a9a5a773414fa979e4e68b31bb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.713136 17431 tablet_service.cc:1511] Processing CreateTablet for tablet 97e731eb30ed4f36ab13505e2cad7085 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:14.714577 17431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e731eb30ed4f36ab13505e2cad7085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.715165 17481 ts_tablet_manager.cc:1434] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.004s
I20260709 12:09:14.716348 17481 tablet_bootstrap.cc:492] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:14.720800 17483 tablet_bootstrap.cc:654] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.725648 17429 tablet_service.cc:1511] Processing CreateTablet for tablet 62f5a9a5a773414fa979e4e68b31bb5d (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:14.727031 17351 tablet_service.cc:1511] Processing CreateTablet for tablet 97e731eb30ed4f36ab13505e2cad7085 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:14.750036 17279 tablet_service.cc:1511] Processing CreateTablet for tablet 93c0e960dcac478bbf09add686ea3b3c (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:14.743954 17356 tablet_service.cc:1511] Processing CreateTablet for tablet 62f5a9a5a773414fa979e4e68b31bb5d (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:14.751494 17279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c0e960dcac478bbf09add686ea3b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.677912 17274 tablet_service.cc:1511] Processing CreateTablet for tablet 97e731eb30ed4f36ab13505e2cad7085 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:14.760603 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e731eb30ed4f36ab13505e2cad7085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.731246 17350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f622d20c7b40a296d381dcc9b82704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.765862 17351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e731eb30ed4f36ab13505e2cad7085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.770498 17353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72f5fa94fdd4fedb64a0e5db13dc3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.784700 17481 tablet_bootstrap.cc:654] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.792836 17282 tablet_service.cc:1511] Processing CreateTablet for tablet 5d769dc29730489bb1bc366ea38bf391 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:14.773461 17275 tablet_service.cc:1511] Processing CreateTablet for tablet ccfe00a9196e4e49a4ad7e72acd36c08 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:14.803488 17482 tablet_bootstrap.cc:492] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:14.807312 17482 ts_tablet_manager.cc:1403] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.385s	user 0.038s	sys 0.033s
I20260709 12:09:14.807183 17424 tablet_service.cc:1511] Processing CreateTablet for tablet 93c0e960dcac478bbf09add686ea3b3c (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:14.809448 17352 tablet_service.cc:1511] Processing CreateTablet for tablet 93c0e960dcac478bbf09add686ea3b3c (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:14.810647 17277 tablet_service.cc:1511] Processing CreateTablet for tablet 7912262477ba4fc0a074c658eed0d241 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:14.805002 17280 tablet_service.cc:1511] Processing CreateTablet for tablet 12759295b3a947cca3d2c7fc3c815e59 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:14.806422 17356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f5a9a5a773414fa979e4e68b31bb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.815097 17352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c0e960dcac478bbf09add686ea3b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.815552 17281 tablet_service.cc:1511] Processing CreateTablet for tablet 8f950276bbbb4642872e9280fad2a766 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:14.827198 17481 tablet_bootstrap.cc:492] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:14.827804 17481 ts_tablet_manager.cc:1403] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.005s
I20260709 12:09:14.830587 17429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f5a9a5a773414fa979e4e68b31bb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.831751 17427 tablet_service.cc:1511] Processing CreateTablet for tablet 12759295b3a947cca3d2c7fc3c815e59 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:14.831977 17481 raft_consensus.cc:359] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.832873 17481 raft_consensus.cc:385] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.833094 17427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12759295b3a947cca3d2c7fc3c815e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.833436 17481 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.834445 17482 raft_consensus.cc:359] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.835270 17482 raft_consensus.cc:385] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.835616 17482 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.836414 17482 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.838891 17482 ts_tablet_manager.cc:1434] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 12:09:14.840816 17430 tablet_service.cc:1511] Processing CreateTablet for tablet ccfe00a9196e4e49a4ad7e72acd36c08 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:14.847231 17422 tablet_service.cc:1511] Processing CreateTablet for tablet 7912262477ba4fc0a074c658eed0d241 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:14.840816 17482 tablet_bootstrap.cc:492] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:14.834437 17481 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.859530 17424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c0e960dcac478bbf09add686ea3b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.862244 17482 tablet_bootstrap.cc:654] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.824656 17355 tablet_service.cc:1511] Processing CreateTablet for tablet 12759295b3a947cca3d2c7fc3c815e59 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:14.867642 17282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d769dc29730489bb1bc366ea38bf391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.868330 17280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12759295b3a947cca3d2c7fc3c815e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.870138 17281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f950276bbbb4642872e9280fad2a766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.870513 17487 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.871058 17487 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.873261 17487 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:14.874545 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:14.876246 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:14.877779 17258 leader_election.cc:343] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.877998 17278 tablet_service.cc:1511] Processing CreateTablet for tablet d9108b2dade34abca8d8b1d985d2dc05 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:14.879145 17277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7912262477ba4fc0a074c658eed0d241. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:14.879673 17255 leader_election.cc:343] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.882247 17430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccfe00a9196e4e49a4ad7e72acd36c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.882021 17255 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:14.883352 17487 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:14.884506 17278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9108b2dade34abca8d8b1d985d2dc05. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:14.886847 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:14.879299 17481 ts_tablet_manager.cc:1434] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.002s
I20260709 12:09:14.887614 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccfe00a9196e4e49a4ad7e72acd36c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.889395 17355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12759295b3a947cca3d2c7fc3c815e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.890121 17425 tablet_service.cc:1511] Processing CreateTablet for tablet 5d769dc29730489bb1bc366ea38bf391 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:14.891467 17425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d769dc29730489bb1bc366ea38bf391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.894829 17481 tablet_bootstrap.cc:492] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:14.898412 17422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7912262477ba4fc0a074c658eed0d241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.856946 17189 catalog_manager.cc:5697] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:14.881789 17423 tablet_service.cc:1511] Processing CreateTablet for tablet 8f950276bbbb4642872e9280fad2a766 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:14.905869 17423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f950276bbbb4642872e9280fad2a766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.918579 17357 tablet_service.cc:1511] Processing CreateTablet for tablet 7912262477ba4fc0a074c658eed0d241 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:14.919998 17357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7912262477ba4fc0a074c658eed0d241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.920885 17348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 39) took 1034 ms. Trace:
I20260709 12:09:14.904042 17428 tablet_service.cc:1511] Processing CreateTablet for tablet dfb3d142442b4e3aada6416cb667a95b (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:14.932209 17428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb3d142442b4e3aada6416cb667a95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.937822 17281 tablet_service.cc:1511] Processing CreateTablet for tablet dfb3d142442b4e3aada6416cb667a95b (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:14.939352 17281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb3d142442b4e3aada6416cb667a95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.924479 17426 tablet_service.cc:1511] Processing CreateTablet for tablet d9108b2dade34abca8d8b1d985d2dc05 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:14.923580 17348 rpcz_store.cc:276] 0709 12:09:13.886504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.477554 (+591050us) service_pool.cc:224] Handling call
0709 12:09:14.484501 (+  6947us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.484594 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.743073 (+258479us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:14.920356 (+177283us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:14.920820 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:14.950278 17426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9108b2dade34abca8d8b1d985d2dc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.955561 17348 tablet_service.cc:1511] Processing CreateTablet for tablet 8f950276bbbb4642872e9280fad2a766 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:14.958382 17348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f950276bbbb4642872e9280fad2a766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.964972 17483 tablet_bootstrap.cc:492] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:14.966230 17502 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.966745 17502 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:14.969008 17502 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:14.971243 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:14.972121 17367 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 1: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:09:14.971983 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:14.974414 17404 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:14.975878 17502 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.979218 17351 tablet_service.cc:1511] Processing CreateTablet for tablet 5d769dc29730489bb1bc366ea38bf391 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:14.980602 17351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d769dc29730489bb1bc366ea38bf391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.987216 17356 tablet_service.cc:1511] Processing CreateTablet for tablet d9108b2dade34abca8d8b1d985d2dc05 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:14.988930 17356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9108b2dade34abca8d8b1d985d2dc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.897902 17349 tablet_service.cc:1511] Processing CreateTablet for tablet ccfe00a9196e4e49a4ad7e72acd36c08 (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:14.991140 17349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccfe00a9196e4e49a4ad7e72acd36c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.995813 17350 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 45) took 1014 ms. Trace:
I20260709 12:09:14.996249 17350 rpcz_store.cc:276] 0709 12:09:13.981693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.629027 (+647334us) service_pool.cc:224] Handling call
0709 12:09:14.639394 (+ 10367us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.639496 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.917900 (+278404us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:14.995267 (+ 77367us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:14.995742 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:14.998836 17354 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 46) took 1008 ms. Trace:
I20260709 12:09:14.999274 17354 rpcz_store.cc:276] 0709 12:09:13.989985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.636248 (+646263us) service_pool.cc:224] Handling call
0709 12:09:14.638209 (+  1961us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.638397 (+   188us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.763081 (+124684us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:14.944823 (+181742us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:14.998766 (+ 53943us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47640}
I20260709 12:09:15.000470 17488 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.000996 17488 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.002421 17493 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.003249 17488 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.002941 17493 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.004941 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:15.006731 17406 leader_election.cc:343] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.007870 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.008564 17367 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:15.009295 17482 tablet_bootstrap.cc:492] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.009892 17482 ts_tablet_manager.cc:1403] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.169s	user 0.026s	sys 0.006s
I20260709 12:09:15.010491 17350 tablet_service.cc:1511] Processing CreateTablet for tablet dfb3d142442b4e3aada6416cb667a95b (DEFAULT_TABLE table=test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:15.011072 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:15.011831 17350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb3d142442b4e3aada6416cb667a95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.012252 17488 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.012725 17493 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.012642 17488 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.013633 17488 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.965633 17483 ts_tablet_manager.cc:1403] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.346s	user 0.010s	sys 0.010s
I20260709 12:09:15.012630 17353 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 48) took 1002 ms. Trace:
I20260709 12:09:15.024266 17481 tablet_bootstrap.cc:654] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.040570 17483 raft_consensus.cc:359] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.041340 17483 raft_consensus.cc:385] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.041755 17483 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.041381 17482 raft_consensus.cc:359] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.042197 17482 raft_consensus.cc:385] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.042482 17482 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.043470 17482 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.044276 17493 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.044739 17493 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.048918 17493 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.050894 17482 ts_tablet_manager.cc:1434] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:09:15.027221 17353 rpcz_store.cc:276] 0709 12:09:14.010682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.674293 (+663611us) service_pool.cc:224] Handling call
0709 12:09:14.694224 (+ 19931us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.706378 (+ 12154us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.915728 (+209350us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.012110 (+ 96382us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.012561 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.070580 17429 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33810 (request call id 50) took 1017 ms. Trace:
I20260709 12:09:15.073063 17429 rpcz_store.cc:276] 0709 12:09:14.052951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.724573 (+671622us) service_pool.cc:224] Handling call
0709 12:09:14.796910 (+ 72337us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.803846 (+  6936us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.974861 (+171015us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.034363 (+ 59502us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.070488 (+ 36125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.072769 17424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33810 (request call id 51) took 1013 ms. Trace:
I20260709 12:09:15.101709 17482 tablet_bootstrap.cc:492] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.115084 17277 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53668 (request call id 54) took 1015 ms. Trace:
I20260709 12:09:15.115520 17277 rpcz_store.cc:276] 0709 12:09:14.100091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.780477 (+680386us) service_pool.cc:224] Handling call
0709 12:09:14.840361 (+ 59884us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b58000b0498. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab4f831 00007f122ab2cac3 00007f122aadb400 00007f1223f60af4 00007f1223f60a82 00007f1223f609b1
0709 12:09:14.840504 (+   143us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.840593 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.946887 (+106294us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.114500 (+167613us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.115015 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65492224}
I20260709 12:09:15.121639 17428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33810 (request call id 58) took 1003 ms. Trace:
I20260709 12:09:15.122211 17428 rpcz_store.cc:276] 0709 12:09:14.118413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.903108 (+784695us) service_pool.cc:224] Handling call
0709 12:09:14.931732 (+ 28624us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.931828 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.113532 (+181704us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.121074 (+  7542us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.121567 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.123062 17502 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.124924 17273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53668 (request call id 48) took 1119 ms. Trace:
I20260709 12:09:15.125356 17273 rpcz_store.cc:276] 0709 12:09:14.005775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.657086 (+651311us) service_pool.cc:224] Handling call
0709 12:09:14.686795 (+ 29709us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.686887 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.876184 (+189297us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.124341 (+248157us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.124852 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.102846 17483 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.126952 17487 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.127409 17487 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.128341 17483 ts_tablet_manager.cc:1434] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.105s	user 0.010s	sys 0.000s
I20260709 12:09:15.130743 17500 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.135991 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.137253 17483 tablet_bootstrap.cc:492] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.121649 17348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 55) took 1016 ms. Trace:
I20260709 12:09:15.138652 17348 rpcz_store.cc:276] 0709 12:09:14.105466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.953009 (+847543us) service_pool.cc:224] Handling call
0709 12:09:14.957762 (+  4753us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.957894 (+   132us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.976256 (+ 18362us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.121119 (+144863us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.121584 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.140033 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:15.138967 17255 leader_election.cc:343] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.142867 17487 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:15.143610 17258 leader_election.cc:343] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.144626 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:15.147493 17487 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.152856 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.154662 17351 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 56) took 1045 ms. Trace:
I20260709 12:09:15.155125 17351 rpcz_store.cc:276] 0709 12:09:14.109530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.978213 (+868683us) service_pool.cc:224] Handling call
0709 12:09:14.980122 (+  1909us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.980222 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.032754 (+ 52532us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.154093 (+121339us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.154598 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.156344 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.157708 17355 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 52) took 1083 ms. Trace:
I20260709 12:09:15.170360 17422 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33810 (request call id 54) took 1067 ms. Trace:
I20260709 12:09:15.170867 17422 rpcz_store.cc:276] 0709 12:09:14.103202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.846278 (+743076us) service_pool.cc:224] Handling call
0709 12:09:14.848084 (+  1806us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.848178 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.032158 (+183980us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.169788 (+137630us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.170292 (+   504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.172343 17483 tablet_bootstrap.cc:654] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.147274 17488 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.175953 17281 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53668 (request call id 58) took 1059 ms. Trace:
I20260709 12:09:15.176363 17281 rpcz_store.cc:276] 0709 12:09:14.116223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.936759 (+820536us) service_pool.cc:224] Handling call
0709 12:09:14.938809 (+  2050us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.938919 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.005505 (+ 66586us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.175420 (+169915us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.175886 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.177199 17488 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:15.177543 17332 leader_election.cc:343] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.177769 17357 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 54) took 1068 ms. Trace:
I20260709 12:09:15.178313 17423 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33810 (request call id 55) took 1071 ms. Trace:
I20260709 12:09:15.178817 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:09:15.180760 17406 leader_election.cc:343] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.181790 17482 tablet_bootstrap.cc:654] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.183749 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:15.184401 17367 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.178210 17357 rpcz_store.cc:276] 0709 12:09:14.101950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.917507 (+815557us) service_pool.cc:224] Handling call
0709 12:09:14.919506 (+  1999us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.919604 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.135065 (+215461us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.170253 (+ 35188us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.170691 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.185851 17282 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53668 (request call id 56) took 1078 ms. Trace:
I20260709 12:09:15.186313 17350 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 58) took 1063 ms. Trace:
I20260709 12:09:15.186687 17350 rpcz_store.cc:276] 0709 12:09:14.123028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.997236 (+874208us) service_pool.cc:224] Handling call
0709 12:09:15.011337 (+ 14101us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:15.011445 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.170605 (+159160us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.185685 (+ 15080us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.186247 (+   562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.186482 17282 rpcz_store.cc:276] 0709 12:09:14.107904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.791877 (+683973us) service_pool.cc:224] Handling call
0709 12:09:14.793692 (+  1815us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.795237 (+  1545us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.943986 (+148749us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.185319 (+241333us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.185786 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.187959 17423 rpcz_store.cc:276] 0709 12:09:14.106729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.880808 (+774079us) service_pool.cc:224] Handling call
0709 12:09:14.905380 (+ 24572us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.905471 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.945643 (+ 40172us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.177737 (+232094us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.178252 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.190604 17349 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 53) took 1094 ms. Trace:
I20260709 12:09:15.192588 17356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48976 (request call id 57) took 1079 ms. Trace:
I20260709 12:09:15.193032 17356 rpcz_store.cc:276] 0709 12:09:14.113060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.986158 (+873098us) service_pool.cc:224] Handling call
0709 12:09:14.988191 (+  2033us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.988502 (+   311us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.116067 (+127565us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.191982 (+ 75915us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.192499 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.102643 17424 rpcz_store.cc:276] 0709 12:09:14.059138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.802915 (+743777us) service_pool.cc:224] Handling call
0709 12:09:14.808124 (+  5209us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.808228 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.907346 (+ 99118us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.054491 (+147145us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.072687 (+ 18196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:15.181686 17332 leader_election.cc:343] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.191051 17349 rpcz_store.cc:276] 0709 12:09:14.096521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.896919 (+800398us) service_pool.cc:224] Handling call
0709 12:09:14.990647 (+ 93728us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.990748 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.170029 (+179281us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.189999 (+ 19970us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.190535 (+   536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.162720 17355 rpcz_store.cc:276] 0709 12:09:14.073385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.823666 (+750281us) service_pool.cc:224] Handling call
0709 12:09:14.888905 (+ 65239us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.889014 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.119515 (+230501us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.156368 (+ 36853us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.156919 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.198884 17481 tablet_bootstrap.cc:492] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.199409 17481 ts_tablet_manager.cc:1403] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.305s	user 0.027s	sys 0.036s
I20260709 12:09:15.201013 17430 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33810 (request call id 53) took 1102 ms. Trace:
I20260709 12:09:15.202663 17481 raft_consensus.cc:359] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.203392 17481 raft_consensus.cc:385] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.203682 17481 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.204592 17481 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.210961 17367 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:15.212905 17481 ts_tablet_manager.cc:1434] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:09:15.214224 17481 tablet_bootstrap.cc:492] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.201494 17430 rpcz_store.cc:276] 0709 12:09:14.098874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.839844 (+740970us) service_pool.cc:224] Handling call
0709 12:09:14.841693 (+  1849us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.841783 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.005493 (+163710us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.200504 (+195011us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.200950 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:15.218356 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:15.219511 17441 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:15.219295 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:15.220800 17333 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:15.220944 17426 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33810 (request call id 57) took 1106 ms. Trace:
I20260709 12:09:15.221551 17493 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.221554 17426 rpcz_store.cc:276] 0709 12:09:14.114325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.897478 (+783153us) service_pool.cc:224] Handling call
0709 12:09:14.949763 (+ 52285us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.949861 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:15.143308 (+193447us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:15.220401 (+ 77093us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:15.220879 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:15.222141 17333 leader_election.cc:343] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.222817 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:15.223719 17493 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.221105 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:15.226148 17488 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.226847 17488 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:15.228417 17488 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.237260 17482 tablet_bootstrap.cc:492] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.237950 17482 ts_tablet_manager.cc:1403] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.016s
I20260709 12:09:15.238081 17483 tablet_bootstrap.cc:492] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:15.238809 17483 ts_tablet_manager.cc:1403] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.102s	user 0.023s	sys 0.013s
I20260709 12:09:15.242509 17483 raft_consensus.cc:359] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.243453 17483 raft_consensus.cc:385] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.243819 17483 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.244952 17483 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.241467 17482 raft_consensus.cc:359] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.249140 17483 ts_tablet_manager.cc:1434] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:15.250946 17481 tablet_bootstrap.cc:654] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.249522 17482 raft_consensus.cc:385] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.255439 17482 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.256410 17482 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.253772 17483 tablet_bootstrap.cc:492] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.263475 17482 ts_tablet_manager.cc:1434] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 12:09:15.263679 17500 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.264645 17482 tablet_bootstrap.cc:492] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.285833 17482 tablet_bootstrap.cc:654] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.285696 17189 catalog_manager.cc:5697] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:15.291134 17483 tablet_bootstrap.cc:654] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.306555 17481 tablet_bootstrap.cc:492] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.307304 17481 ts_tablet_manager.cc:1403] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.003s
I20260709 12:09:15.311357 17481 raft_consensus.cc:359] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.312350 17481 raft_consensus.cc:385] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.312745 17481 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.317968 17483 tablet_bootstrap.cc:492] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:15.321374 17483 ts_tablet_manager.cc:1403] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.000s
I20260709 12:09:15.321884 17481 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.327337 17483 raft_consensus.cc:359] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.328166 17483 raft_consensus.cc:385] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.328475 17483 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.329376 17483 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.331691 17481 ts_tablet_manager.cc:1434] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.006s
I20260709 12:09:15.332051 17483 ts_tablet_manager.cc:1434] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 12:09:15.333792 17493 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.335366 17481 tablet_bootstrap.cc:492] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.334967 17493 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.337621 17487 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.338532 17493 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.338353 17487 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.340019 17483 tablet_bootstrap.cc:492] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.342679 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:15.343019 17481 tablet_bootstrap.cc:654] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:15.346062 17258 leader_election.cc:343] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.347841 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:15.348666 17440 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:15.350143 17333 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:15.350354 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.351207 17493 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.351637 17493 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.352044 17493 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:15.352180 17255 leader_election.cc:343] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.352771 17255 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:15.353145 17483 tablet_bootstrap.cc:654] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.354202 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:15.356118 17332 leader_election.cc:343] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.357892 17487 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.364257 17487 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.364563 17482 tablet_bootstrap.cc:492] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.365109 17482 ts_tablet_manager.cc:1403] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.101s	user 0.035s	sys 0.036s
I20260709 12:09:15.368311 17482 raft_consensus.cc:359] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:15.369204 17482 raft_consensus.cc:385] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.369583 17482 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.373238 17493 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.376255 17481 tablet_bootstrap.cc:492] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.376577 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:15.376933 17481 ts_tablet_manager.cc:1403] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.021s
I20260709 12:09:15.376866 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:15.377393 17483 tablet_bootstrap.cc:492] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:15.377681 17440 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.377899 17483 ts_tablet_manager.cc:1403] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.015s
W20260709 12:09:15.378196 17332 leader_election.cc:343] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.380250 17481 raft_consensus.cc:359] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.380992 17481 raft_consensus.cc:385] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.381356 17481 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.380892 17483 raft_consensus.cc:359] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.381734 17483 raft_consensus.cc:385] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.382069 17483 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.382130 17481 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.382830 17482 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:15.383082 17483 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.382237 17493 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.385813 17440 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:15.387225 17333 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:15.388458 17493 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.389222 17488 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.389782 17488 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.392051 17488 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.393141 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.393743 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.393980 17292 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
W20260709 12:09:15.395529 17404 leader_election.cc:343] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.396222 17406 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:15.397478 17488 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.397818 17481 ts_tablet_manager.cc:1434] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 12:09:15.398360 17493 raft_consensus.cc:697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:15.399294 17493 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.399927 17481 tablet_bootstrap.cc:492] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.397898 17488 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.401397 17488 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.401854 17483 ts_tablet_manager.cc:1434] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 12:09:15.407862 17481 tablet_bootstrap.cc:654] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.411096 17483 tablet_bootstrap.cc:492] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.410729 17488 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.416363 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:15.417301 17482 ts_tablet_manager.cc:1434] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.052s	user 0.028s	sys 0.011s
I20260709 12:09:15.417075 17292 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.418243 17483 tablet_bootstrap.cc:654] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.420673 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:09:15.422359 17404 leader_election.cc:343] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.423225 17488 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.427476 17482 tablet_bootstrap.cc:492] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.425931 17292 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:15.429050 17406 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:15.429397 17483 tablet_bootstrap.cc:492] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:15.430038 17483 ts_tablet_manager.cc:1403] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:09:15.430591 17488 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.431135 17488 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:15.432183 17488 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.431056 17187 catalog_manager.cc:5697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:15.434194 17483 raft_consensus.cc:359] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.434907 17483 raft_consensus.cc:385] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.435227 17483 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.435405 17482 tablet_bootstrap.cc:654] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.436094 17483 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.438004 17481 tablet_bootstrap.cc:492] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.442628 17481 ts_tablet_manager.cc:1403] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.004s
W20260709 12:09:15.442955 17393 tablet.cc:2406] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:15.444263 17482 tablet_bootstrap.cc:492] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.444813 17482 ts_tablet_manager.cc:1403] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 12:09:15.445710 17481 raft_consensus.cc:359] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.446509 17481 raft_consensus.cc:385] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.446805 17481 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.447608 17481 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.447928 17482 raft_consensus.cc:359] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.448709 17482 raft_consensus.cc:385] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.449016 17482 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.448544 17187 catalog_manager.cc:5697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:15.450371 17481 ts_tablet_manager.cc:1434] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:09:15.449829 17482 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.451498 17481 tablet_bootstrap.cc:492] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.452705 17482 ts_tablet_manager.cc:1434] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:15.454059 17482 tablet_bootstrap.cc:492] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.458626 17481 tablet_bootstrap.cc:654] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.458612 17483 ts_tablet_manager.cc:1434] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:09:15.461126 17482 tablet_bootstrap.cc:654] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.475072 17483 tablet_bootstrap.cc:492] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.481330 17487 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.482050 17487 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.485844 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.487365 17483 tablet_bootstrap.cc:654] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:15.488034 17255 leader_election.cc:343] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.490552 17482 tablet_bootstrap.cc:492] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.491139 17482 ts_tablet_manager.cc:1403] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.019s
I20260709 12:09:15.491611 17481 tablet_bootstrap.cc:492] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.492131 17481 ts_tablet_manager.cc:1403] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.022s
I20260709 12:09:15.493474 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:15.494218 17440 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:15.494325 17482 raft_consensus.cc:359] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.495057 17482 raft_consensus.cc:385] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.495378 17482 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.495139 17481 raft_consensus.cc:359] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.495672 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:15.495942 17481 raft_consensus.cc:385] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.496304 17481 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.496622 17500 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.496194 17482 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.497061 17500 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.497239 17481 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.499104 17482 ts_tablet_manager.cc:1434] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:15.500417 17482 tablet_bootstrap.cc:492] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.505564 17481 ts_tablet_manager.cc:1434] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:09:15.506875 17481 tablet_bootstrap.cc:492] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.507382 17482 tablet_bootstrap.cc:654] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.513700 17488 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.514331 17488 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.519107 17482 tablet_bootstrap.cc:492] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.519224 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.519692 17482 ts_tablet_manager.cc:1403] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:09:15.520010 17292 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:15.521265 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.522675 17482 raft_consensus.cc:359] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.522900 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:15.523427 17482 raft_consensus.cc:385] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.523782 17482 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.524116 17502 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.524555 17502 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.524943 17502 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.524641 17482 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.525401 17500 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.527210 17482 ts_tablet_manager.cc:1434] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:15.528278 17482 tablet_bootstrap.cc:492] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
W20260709 12:09:15.528887 17404 leader_election.cc:343] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.529661 17488 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.530035 17487 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.534133 17482 tablet_bootstrap.cc:654] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.535024 17500 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.536432 17502 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.513432 17481 tablet_bootstrap.cc:654] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.538883 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:15.539791 17367 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.547410 17482 tablet_bootstrap.cc:492] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.547994 17482 ts_tablet_manager.cc:1403] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:09:15.548839 17500 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.550536 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:15.550822 17482 raft_consensus.cc:359] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.551214 17440 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.551442 17482 raft_consensus.cc:385] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.551828 17482 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.552465 17482 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.552773 17367 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:15.554200 17255 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:15.554482 17482 ts_tablet_manager.cc:1434] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:15.555145 17500 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.555658 17500 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:15.556517 17500 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.557037 17482 tablet_bootstrap.cc:492] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.559966 17440 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:15.562449 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:15.563126 17292 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.563012 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:09:15.564710 17404 leader_election.cc:343] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.564885 17482 tablet_bootstrap.cc:654] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.565683 17502 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.571378 17292 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:15.572885 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:15.573936 17483 tablet_bootstrap.cc:492] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:15.574291 17481 tablet_bootstrap.cc:492] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.574291 17502 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.575603 17502 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:15.576839 17482 tablet_bootstrap.cc:492] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.574815 17481 ts_tablet_manager.cc:1403] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.005s
I20260709 12:09:15.577301 17482 ts_tablet_manager.cc:1403] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:09:15.574762 17483 ts_tablet_manager.cc:1403] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.100s	user 0.026s	sys 0.042s
I20260709 12:09:15.579885 17481 raft_consensus.cc:359] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.580991 17481 raft_consensus.cc:385] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.581308 17481 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.581444 17483 raft_consensus.cc:359] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.580053 17482 raft_consensus.cc:359] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.576594 17502 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.582074 17483 raft_consensus.cc:385] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.582027 17481 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.582487 17483 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.583405 17483 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.583426 17187 catalog_manager.cc:5697] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:15.584573 17481 ts_tablet_manager.cc:1434] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:15.585472 17483 ts_tablet_manager.cc:1434] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.005s
I20260709 12:09:15.585606 17481 tablet_bootstrap.cc:492] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.585889 17482 raft_consensus.cc:385] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.586282 17482 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.586717 17483 tablet_bootstrap.cc:492] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.587230 17482 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.589632 17482 ts_tablet_manager.cc:1434] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:15.591504 17482 tablet_bootstrap.cc:492] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.592360 17481 tablet_bootstrap.cc:654] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.593076 17483 tablet_bootstrap.cc:654] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.600534 17482 tablet_bootstrap.cc:654] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.609633 17190 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:15.614413 17482 tablet_bootstrap.cc:492] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.615034 17482 ts_tablet_manager.cc:1403] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 12:09:15.621218 17527 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.621985 17527 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:15.626080 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:15.628239 17333 leader_election.cc:343] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.631201 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.632459 17527 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
W20260709 12:09:15.633080 17332 leader_election.cc:343] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.633572 17332 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:15.634758 17527 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.634833 17482 raft_consensus.cc:359] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.635576 17482 raft_consensus.cc:385] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.635898 17482 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.637169 17482 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.639861 17482 ts_tablet_manager.cc:1434] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:09:15.646185 17482 tablet_bootstrap.cc:492] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.654666 17482 tablet_bootstrap.cc:654] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.660605 17483 tablet_bootstrap.cc:492] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:15.661212 17483 ts_tablet_manager.cc:1403] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.075s	user 0.033s	sys 0.032s
I20260709 12:09:15.662041 17481 tablet_bootstrap.cc:492] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.662572 17481 ts_tablet_manager.cc:1403] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.077s	user 0.035s	sys 0.039s
I20260709 12:09:15.664157 17483 raft_consensus.cc:359] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.664788 17482 tablet_bootstrap.cc:492] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.664963 17483 raft_consensus.cc:385] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.665271 17482 ts_tablet_manager.cc:1403] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:09:15.665349 17483 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.665607 17481 raft_consensus.cc:359] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:15.666215 17481 raft_consensus.cc:385] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.666419 17481 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.666363 17483 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.667212 17481 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:15.668124 17482 raft_consensus.cc:359] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.668790 17482 raft_consensus.cc:385] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.669063 17482 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.669270 17483 ts_tablet_manager.cc:1434] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:15.669848 17482 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.670365 17483 tablet_bootstrap.cc:492] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.672560 17481 ts_tablet_manager.cc:1434] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.005s
I20260709 12:09:15.672676 17482 ts_tablet_manager.cc:1434] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:15.673640 17481 tablet_bootstrap.cc:492] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.673712 17482 tablet_bootstrap.cc:492] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.676949 17483 tablet_bootstrap.cc:654] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.680644 17481 tablet_bootstrap.cc:654] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.683580 17482 tablet_bootstrap.cc:654] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.691746 17483 tablet_bootstrap.cc:492] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:15.692270 17483 ts_tablet_manager.cc:1403] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:09:15.695133 17500 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.695993 17500 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.696419 17502 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.696080 17483 raft_consensus.cc:359] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:15.697474 17483 raft_consensus.cc:385] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.697222 17502 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.697782 17483 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.699645 17502 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.700752 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.700861 17483 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:15.701347 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.701519 17500 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.701560 17292 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:15.702011 17367 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:15.703125 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.703696 17483 ts_tablet_manager.cc:1434] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:15.703806 17366 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:15.705350 17404 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:15.705458 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:15.706128 17483 tablet_bootstrap.cc:492] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.706318 17440 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:15.707408 17255 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:15.707592 17502 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.707947 17502 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.708281 17502 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.708513 17487 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.709113 17487 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.709491 17487 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.711701 17483 tablet_bootstrap.cc:654] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.714991 17488 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.717483 17481 tablet_bootstrap.cc:492] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.717979 17481 ts_tablet_manager.cc:1403] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.004s
I20260709 12:09:15.717702 17488 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.720227 17488 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.720984 17481 raft_consensus.cc:359] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.721650 17481 raft_consensus.cc:385] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.721931 17481 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.722606 17481 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.723541 17502 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.723824 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:15.725709 17406 leader_election.cc:343] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.726969 17481 ts_tablet_manager.cc:1434] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:15.727770 17481 tablet_bootstrap.cc:492] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.729923 17502 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.731405 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:15.732120 17292 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.732685 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:15.733275 17367 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.732306 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.735423 17366 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:15.735733 17481 tablet_bootstrap.cc:654] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.737176 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:15.738152 17502 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.738560 17502 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.738936 17502 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.741842 17292 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:15.743561 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:15.745077 17488 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.742543 17483 tablet_bootstrap.cc:492] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:15.748063 17483 ts_tablet_manager.cc:1403] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.006s
I20260709 12:09:15.748736 17502 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.752369 17483 raft_consensus.cc:359] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.756193 17483 raft_consensus.cc:385] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.757052 17483 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.758546 17483 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.761545 17483 ts_tablet_manager.cc:1434] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:09:15.763434 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:15.759397 17502 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:15.764889 17406 leader_election.cc:343] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.765024 17502 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.765311 17482 tablet_bootstrap.cc:492] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:15.765936 17482 ts_tablet_manager.cc:1403] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.009s
I20260709 12:09:15.765731 17502 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.767989 17367 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:15.768769 17483 tablet_bootstrap.cc:492] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.769392 17482 raft_consensus.cc:359] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.770259 17488 raft_consensus.cc:697] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:15.766016 17487 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.770263 17482 raft_consensus.cc:385] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.771204 17488 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.772286 17482 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.773084 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:15.772400 17502 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.773025 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.773875 17367 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:15.775835 17406 leader_election.cc:343] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.778064 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:15.778766 17440 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.786552 17483 tablet_bootstrap.cc:654] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.787174 17440 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:15.787708 17487 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.773164 17482 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.791209 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:15.794133 17487 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:15.795655 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.796619 17487 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:15.802445 17482 ts_tablet_manager.cc:1434] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 12:09:15.801862 17487 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.803012 17527 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.803581 17527 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.806707 17367 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:15.807004 17527 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.808876 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.811057 17292 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:15.811679 17481 tablet_bootstrap.cc:492] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.812245 17481 ts_tablet_manager.cc:1403] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.023s
I20260709 12:09:15.812363 17332 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:15.814677 17527 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.815129 17481 raft_consensus.cc:359] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.815932 17481 raft_consensus.cc:385] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.816237 17481 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.815245 17527 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.817083 17481 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.819162 17481 ts_tablet_manager.cc:1434] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:15.820274 17481 tablet_bootstrap.cc:492] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.817101 17527 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.823998 17487 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.824963 17487 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.826537 17481 tablet_bootstrap.cc:654] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.829033 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.832896 17487 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.833889 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:15.834995 17440 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 1: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:15.836620 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:15.837996 17487 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.839704 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:15.840178 17481 tablet_bootstrap.cc:492] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.840606 17367 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.840710 17481 ts_tablet_manager.cc:1403] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:09:15.844219 17481 raft_consensus.cc:359] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.844972 17481 raft_consensus.cc:385] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.845252 17481 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.845916 17481 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.847656 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.848479 17366 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:15.848786 17481 ts_tablet_manager.cc:1434] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:09:15.849987 17481 tablet_bootstrap.cc:492] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.845911 17487 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.857548 17481 tablet_bootstrap.cc:654] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.859051 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:15.859925 17440 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:15.864801 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:15.866183 17553 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.866649 17553 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.867440 17553 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.869777 17493 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.870535 17493 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.872463 17481 tablet_bootstrap.cc:492] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.873113 17481 ts_tablet_manager.cc:1403] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 12:09:15.877545 17481 raft_consensus.cc:359] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.878388 17481 raft_consensus.cc:385] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.878698 17481 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.879776 17481 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.881606 17493 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.882376 17481 ts_tablet_manager.cc:1434] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 12:09:15.883627 17481 tablet_bootstrap.cc:492] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.885365 17553 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:15.889503 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:15.890465 17481 tablet_bootstrap.cc:654] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.890834 17482 tablet_bootstrap.cc:492] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:15.903381 17481 tablet_bootstrap.cc:492] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.904068 17481 ts_tablet_manager.cc:1403] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 12:09:15.906687 17493 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:15.907182 17481 raft_consensus.cc:359] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.908007 17481 raft_consensus.cc:385] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.908310 17481 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.908494 17187 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:15.909459 17481 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.903517 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.911990 17291 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:15.912086 17481 ts_tablet_manager.cc:1434] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:15.913456 17481 tablet_bootstrap.cc:492] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
W20260709 12:09:15.912024 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47362.4us
I20260709 12:09:15.918946 17502 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.919654 17502 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:15.919808 17493 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.921893 17487 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.922562 17487 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.922694 17502 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:15.924445 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:15.925545 17481 tablet_bootstrap.cc:654] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.926390 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.926903 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:15.928519 17255 leader_election.cc:343] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:15.928640 17406 leader_election.cc:343] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.924960 17487 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.923390 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.931417 17291 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
W20260709 12:09:15.929199 17258 leader_election.cc:343] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.923323 17553 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:15.933209 17258 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:15.936002 17367 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:15.937263 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:15.941483 17553 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.942011 17553 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.938045 17487 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.938541 17483 tablet_bootstrap.cc:492] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:15.964080 17553 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.964536 17483 ts_tablet_manager.cc:1403] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.196s	user 0.039s	sys 0.062s
I20260709 12:09:15.939301 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:15.970348 17493 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.971031 17493 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.974179 17493 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:15.974488 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:15.937263 17527 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.956245 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:15.975245 17291 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:15.975627 17366 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:15.962387 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:15.976713 17365 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.976934 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:15.962507 17502 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:15.978278 17493 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.978684 17493 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.979067 17493 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.985806 17365 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:15.988528 17483 raft_consensus.cc:359] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.989424 17483 raft_consensus.cc:385] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.989748 17483 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.989867 17481 tablet_bootstrap.cc:492] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:15.990442 17481 ts_tablet_manager.cc:1403] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.011s
I20260709 12:09:15.990636 17483 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.990301 17493 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.993305 17481 raft_consensus.cc:359] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.994122 17481 raft_consensus.cc:385] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.994403 17481 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.995138 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:15.995191 17481 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.996320 17290 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.997563 17483 ts_tablet_manager.cc:1434] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:09:15.997702 17481 ts_tablet_manager.cc:1434] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:09:15.998608 17483 tablet_bootstrap.cc:492] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:15.998797 17481 tablet_bootstrap.cc:492] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:15.994354 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:16.002372 17482 tablet_bootstrap.cc:654] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.001878 17291 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.005908 17483 tablet_bootstrap.cc:654] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.963446 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:16.011238 17527 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:16.010936 17487 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.015149 17290 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:16.016713 17502 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.016794 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:16.017325 17502 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:16.017853 17527 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.018297 17502 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:15.993237 17493 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:16.016896 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 53563.9us
I20260709 12:09:16.098937 17291 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:16.086858 17493 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.100162 17493 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.091125 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:16.086841 17527 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:16.123994 17332 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:16.124207 17487 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.124487 17553 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:16.124759 17487 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.127080 17553 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:16.128154 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:09:16.129804 17255 leader_election.cc:343] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.121047 17493 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:16.131172 17493 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.132560 17488 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.133133 17487 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:16.133180 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:16.133869 17291 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.149693 17481 tablet_bootstrap.cc:654] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.151818 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:16.152688 17292 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:16.162744 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:16.163038 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:16.163398 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:16.164043 17441 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.165144 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:16.165287 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:16.168727 17502 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.169476 17502 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:16.170363 17502 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.161470 17527 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.174275 17564 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.176144 17482 tablet_bootstrap.cc:492] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:16.176818 17482 ts_tablet_manager.cc:1403] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.290s	user 0.018s	sys 0.012s
I20260709 12:09:16.160588 17488 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:09:16.189862 17552 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.196717 17568 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.197299 17568 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.197579 17441 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:16.199561 17568 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:16.200623 17483 tablet_bootstrap.cc:492] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:16.201103 17483 ts_tablet_manager.cc:1403] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.203s	user 0.013s	sys 0.007s
I20260709 12:09:16.203162 17483 raft_consensus.cc:359] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.203662 17483 raft_consensus.cc:385] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.203855 17483 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.204327 17483 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.205538 17483 ts_tablet_manager.cc:1434] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.000s
I20260709 12:09:16.192746 17552 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.208362 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:16.209784 17552 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:16.210806 17482 raft_consensus.cc:359] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.211535 17482 raft_consensus.cc:385] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.211792 17482 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.212708 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:16.194062 17493 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.213964 17482 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.206879 17483 tablet_bootstrap.cc:492] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:16.225378 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:16.226092 17364 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:16.226209 17406 leader_election.cc:343] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.228739 17482 ts_tablet_manager.cc:1434] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:09:16.235154 17488 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.235744 17488 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.237937 17488 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:16.239503 17404 leader_election.cc:343] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.240067 17404 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:16.241621 17488 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.244498 17190 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.253737 17482 tablet_bootstrap.cc:492] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:16.223361 17564 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:16.269058 17564 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.263453 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:16.270727 17440 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
W20260709 12:09:16.223465 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 59974.6us
I20260709 12:09:16.262890 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:16.280277 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:16.279107 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:16.292631 17288 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:16.299711 17481 tablet_bootstrap.cc:492] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:16.300866 17481 ts_tablet_manager.cc:1403] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.302s	user 0.019s	sys 0.006s
I20260709 12:09:16.303067 17187 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:16.309115 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:16.311113 17488 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:16.302126 17333 leader_election.cc:343] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.311685 17488 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.338163 17364 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
W20260709 12:09:16.339192 17574 log.cc:927] Time spent T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:09:16.311756 17291 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:16.354784 17363 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.314361 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:09:16.355487 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 55971.5us
W20260709 12:09:16.361945 17333 leader_election.cc:343] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.363024 17333 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:16.363569 17481 raft_consensus.cc:359] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.364327 17481 raft_consensus.cc:385] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.364637 17481 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.369401 17581 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.370216 17488 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:16.369958 17581 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:16.374677 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 72036.5us
I20260709 12:09:16.375283 17581 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:16.374994 17580 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.376363 17550 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.376487 17580 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.377112 17580 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.377676 17500 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.379719 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:16.384644 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:16.392143 17577 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.088s	user 0.003s	sys 0.002s
I20260709 12:09:16.393352 17367 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:09:16.395823 17579 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 12:09:16.396706 17481 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.398872 17481 ts_tablet_manager.cc:1434] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.002s
I20260709 12:09:16.401101 17481 tablet_bootstrap.cc:492] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:16.404860 17482 tablet_bootstrap.cc:654] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:16.408416 17404 leader_election.cc:343] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.410072 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:09:16.411092 17406 leader_election.cc:343] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.411578 17406 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:16.412390 17502 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.412803 17502 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.413157 17502 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:16.415354 17404 leader_election.cc:343] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.417208 17488 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.418063 17483 tablet_bootstrap.cc:654] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.411092 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:16.419579 17500 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.420861 17404 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:16.422745 17552 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.423313 17488 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.424523 17552 raft_consensus.cc:697] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:16.426002 17481 tablet_bootstrap.cc:654] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.426131 17552 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } }
I20260709 12:09:16.440919 17488 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.439865 17258 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:09:16.452800 17404 leader_election.cc:343] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.481724 17500 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.493729 17500 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.494691 17580 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.518800 17552 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.465426 17502 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.521299 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:16.521873 17502 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:16.508167 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 80205.5us
W20260709 12:09:16.511348 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 88708.7us
I20260709 12:09:16.522815 17580 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:16.524452 17568 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.526293 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:16.527289 17255 leader_election.cc:343] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.513268 17564 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.516294 17187 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.517562 17482 tablet_bootstrap.cc:492] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:16.528432 17482 ts_tablet_manager.cc:1403] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.275s	user 0.021s	sys 0.027s
I20260709 12:09:16.528607 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:16.529479 17440 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:16.527323 17292 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:16.532007 17488 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.532320 17482 raft_consensus.cc:359] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.532490 17488 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.533007 17482 raft_consensus.cc:385] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.533289 17482 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.534075 17482 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.534619 17488 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:16.536160 17482 ts_tablet_manager.cc:1434] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:09:16.537065 17482 tablet_bootstrap.cc:492] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:16.541219 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:16.542212 17289 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 1: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:09:16.544023 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:16.548326 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:16.551255 17362 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:16.551151 17568 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.552621 17483 tablet_bootstrap.cc:492] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:16.553135 17483 ts_tablet_manager.cc:1403] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.347s	user 0.007s	sys 0.015s
I20260709 12:09:16.554627 17500 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.557689 17481 tablet_bootstrap.cc:492] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:16.558210 17481 ts_tablet_manager.cc:1403] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.157s	user 0.013s	sys 0.000s
I20260709 12:09:16.556705 17189 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:16.560671 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:16.561417 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:16.562543 17570 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.562990 17570 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.563357 17570 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.549476 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:16.561084 17189 catalog_manager.cc:5697] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:16.568573 17483 raft_consensus.cc:359] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.569324 17483 raft_consensus.cc:385] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.569603 17483 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
W20260709 12:09:16.569530 17404 leader_election.cc:343] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.570191 17404 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:16.571043 17568 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.571691 17483 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.573730 17481 raft_consensus.cc:359] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.574980 17481 raft_consensus.cc:385] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.575682 17481 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.575346 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:16.580447 17553 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.580865 17553 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.570320 17189 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.581198 17553 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.588825 17483 ts_tablet_manager.cc:1434] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
W20260709 12:09:16.594370 17406 leader_election.cc:343] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.595999 17570 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.597954 17553 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.599630 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:16.600606 17363 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.605921 17481 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.606834 17483 tablet_bootstrap.cc:492] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:16.608163 17564 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.613602 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:16.618618 17481 ts_tablet_manager.cc:1434] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:09:16.620525 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:09:16.620879 17406 leader_election.cc:343] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.622624 17481 tablet_bootstrap.cc:492] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:16.621258 17290 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.623804 17488 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.629031 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:16.629778 17361 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.611603 17570 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:16.637657 17483 tablet_bootstrap.cc:654] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.622524 17553 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:16.647830 17333 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:16.652931 17290 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:16.665544 17363 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:16.666505 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:16.683758 17502 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.684340 17502 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:16.685240 17502 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.689049 17482 tablet_bootstrap.cc:654] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.701706 17483 tablet_bootstrap.cc:492] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:16.702309 17483 ts_tablet_manager.cc:1403] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.003s
I20260709 12:09:16.708982 17527 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.709061 17483 raft_consensus.cc:359] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.706416 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:16.709964 17483 raft_consensus.cc:385] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.711676 17552 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.711887 17483 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.712201 17552 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:16.712642 17483 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.713065 17552 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.727582 17483 ts_tablet_manager.cc:1434] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:09:16.727771 17570 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.728291 17570 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.729297 17527 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.731666 17483 tablet_bootstrap.cc:492] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:16.740585 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:16.748329 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:16.749501 17406 leader_election.cc:343] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.750581 17568 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.754010 17570 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:16.787614 17361 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:16.801174 17481 tablet_bootstrap.cc:654] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.788518 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:09:16.818056 17404 leader_election.cc:343] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.818594 17404 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:16.836611 17502 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:16.852125 17602 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:09:16.853863 17482 tablet_bootstrap.cc:492] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:16.854697 17482 ts_tablet_manager.cc:1403] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.318s	user 0.037s	sys 0.007s
I20260709 12:09:16.859884 17482 raft_consensus.cc:359] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.860742 17482 raft_consensus.cc:385] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.861032 17482 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.862000 17482 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.863209 17481 tablet_bootstrap.cc:492] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:16.863734 17481 ts_tablet_manager.cc:1403] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.244s	user 0.008s	sys 0.005s
I20260709 12:09:16.867523 17483 tablet_bootstrap.cc:654] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.868346 17482 ts_tablet_manager.cc:1434] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:09:16.869333 17482 tablet_bootstrap.cc:492] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:16.875267 17190 catalog_manager.cc:5697] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:16.876766 17190 catalog_manager.cc:5697] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:16.880734 17481 raft_consensus.cc:359] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.881640 17481 raft_consensus.cc:385] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.881942 17481 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.882660 17481 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.884701 17481 ts_tablet_manager.cc:1434] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 12:09:16.885629 17481 tablet_bootstrap.cc:492] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:16.892050 17482 tablet_bootstrap.cc:654] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.892665 17552 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.896134 17483 tablet_bootstrap.cc:492] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:16.896644 17483 ts_tablet_manager.cc:1403] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.008s
I20260709 12:09:16.896675 17487 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.897194 17487 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.898790 17481 tablet_bootstrap.cc:654] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.899295 17487 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:16.900183 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:16.902801 17483 raft_consensus.cc:359] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.903321 17502 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.903682 17483 raft_consensus.cc:385] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.904027 17483 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.904979 17483 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.907609 17483 ts_tablet_manager.cc:1434] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:16.903044 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:16.910768 17483 tablet_bootstrap.cc:492] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:16.911474 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:16.918763 17487 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.922067 17483 tablet_bootstrap.cc:654] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.925676 17481 tablet_bootstrap.cc:492] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:16.930141 17481 ts_tablet_manager.cc:1403] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.004s
W20260709 12:09:16.930744 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:16.933142 17481 raft_consensus.cc:359] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.933876 17481 raft_consensus.cc:385] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.935432 17481 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.936128 17481 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.938004 17482 tablet_bootstrap.cc:492] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:16.938609 17482 ts_tablet_manager.cc:1403] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.006s
I20260709 12:09:16.939005 17481 ts_tablet_manager.cc:1434] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:16.941763 17483 tablet_bootstrap.cc:492] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:16.941453 17482 raft_consensus.cc:359] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.942199 17483 ts_tablet_manager.cc:1403] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.004s
I20260709 12:09:16.942214 17482 raft_consensus.cc:385] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.942708 17482 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.943281 17567 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.943475 17482 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.943837 17567 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.945691 17482 ts_tablet_manager.cc:1434] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:16.945310 17483 raft_consensus.cc:359] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.946223 17483 raft_consensus.cc:385] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.946204 17567 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:16.946738 17482 tablet_bootstrap.cc:492] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:16.946889 17483 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.947741 17483 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.949081 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:16.949982 17288 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:09:16.950322 17483 ts_tablet_manager.cc:1434] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:16.951303 17483 tablet_bootstrap.cc:492] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:16.951740 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:16.952683 17441 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:16.954016 17482 tablet_bootstrap.cc:654] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.954177 17333 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:16.955452 17567 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.957700 17483 tablet_bootstrap.cc:654] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.966972 17481 tablet_bootstrap.cc:492] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:16.965831 17567 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.976054 17481 tablet_bootstrap.cc:654] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.991369 17483 tablet_bootstrap.cc:492] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:16.991873 17483 ts_tablet_manager.cc:1403] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.018s
I20260709 12:09:16.994225 17487 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.994520 17483 raft_consensus.cc:359] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.994710 17487 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:16.996919 17487 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:16.997500 17482 tablet_bootstrap.cc:492] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:16.997947 17482 ts_tablet_manager.cc:1403] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.051s	user 0.033s	sys 0.007s
I20260709 12:09:16.995193 17483 raft_consensus.cc:385] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.998286 17483 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.998991 17483 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.000075 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.000540 17482 raft_consensus.cc:359] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.001098 17483 ts_tablet_manager.cc:1434] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:09:17.001176 17482 raft_consensus.cc:385] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.001503 17482 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.002244 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:17.002161 17482 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.003633 17483 tablet_bootstrap.cc:492] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:17.004248 17482 ts_tablet_manager.cc:1434] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:17.005605 17482 tablet_bootstrap.cc:492] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:17.004212 17258 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:17.009896 17500 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.010505 17483 tablet_bootstrap.cc:654] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.011224 17288 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.011590 17482 tablet_bootstrap.cc:654] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.024179 17481 tablet_bootstrap.cc:492] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.024930 17481 ts_tablet_manager.cc:1403] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.004s
I20260709 12:09:17.027911 17481 raft_consensus.cc:359] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.034850 17481 raft_consensus.cc:385] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.035178 17481 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.035802 17483 tablet_bootstrap.cc:492] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:17.036264 17482 tablet_bootstrap.cc:492] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:17.035853 17481 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.036427 17483 ts_tablet_manager.cc:1403] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.009s
I20260709 12:09:17.036717 17482 ts_tablet_manager.cc:1403] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.017s
I20260709 12:09:17.038053 17481 ts_tablet_manager.cc:1434] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.001s
I20260709 12:09:17.039075 17483 raft_consensus.cc:359] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.039577 17483 raft_consensus.cc:385] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.039812 17483 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.039448 17482 raft_consensus.cc:359] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.040212 17482 raft_consensus.cc:385] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.040485 17482 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.040422 17483 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.041217 17482 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.042819 17483 ts_tablet_manager.cc:1434] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:09:17.043332 17482 ts_tablet_manager.cc:1434] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:17.043778 17483 tablet_bootstrap.cc:492] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:17.044010 17567 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.044569 17482 tablet_bootstrap.cc:492] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:17.044447 17567 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.046594 17567 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.049752 17483 tablet_bootstrap.cc:654] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.050607 17482 tablet_bootstrap.cc:654] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.051594 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.052307 17552 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.055758 17552 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.059623 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.060402 17292 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:17.061931 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:17.063134 17502 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.063515 17502 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.063858 17502 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.070694 17552 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.072672 17481 tablet_bootstrap.cc:492] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
W20260709 12:09:17.079028 17332 leader_election.cc:343] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.074016 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:17.074854 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.080127 17366 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:17.076848 17570 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.081060 17502 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.081995 17570 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.083246 17502 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.083562 17481 tablet_bootstrap.cc:654] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.083920 17441 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:17.083972 17570 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.087657 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.087548 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:09:17.089200 17406 leader_election.cc:343] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.089339 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.089659 17288 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.090005 17367 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:17.077204 17483 tablet_bootstrap.cc:492] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:17.090998 17483 ts_tablet_manager.cc:1403] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.021s
I20260709 12:09:17.091310 17404 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:17.089239 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:17.092952 17366 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.093736 17483 raft_consensus.cc:359] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.094339 17483 raft_consensus.cc:385] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.094637 17483 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.095360 17570 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.095284 17483 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.095830 17570 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.096594 17292 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.099085 17570 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.099977 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.100634 17289 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:17.101648 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.102018 17570 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.100566 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:17.102593 17570 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.101964 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:09:17.103505 17404 leader_election.cc:343] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.102977 17570 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.096840 17483 ts_tablet_manager.cc:1434] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:09:17.106300 17567 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.106688 17567 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.107000 17567 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.104264 17552 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.108685 17552 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.109023 17552 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.112260 17570 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.107105 17483 tablet_bootstrap.cc:492] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:17.113168 17288 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:17.114928 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:17.116468 17502 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.118089 17502 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:17.113538 17567 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.119007 17502 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.121562 17567 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.122655 17481 tablet_bootstrap.cc:492] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.123176 17481 ts_tablet_manager.cc:1403] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.003s
I20260709 12:09:17.124028 17483 tablet_bootstrap.cc:654] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.124606 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:17.125269 17552 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.127055 17552 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.127892 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:17.128376 17366 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:17.128479 17289 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.129069 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:17.130493 17482 tablet_bootstrap.cc:492] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:17.131014 17482 ts_tablet_manager.cc:1403] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.020s
I20260709 12:09:17.131834 17441 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:09:17.133482 17404 leader_election.cc:343] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.136668 17570 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.134115 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:17.141036 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:17.142329 17363 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 1: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:17.143193 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:09:17.144815 17406 leader_election.cc:343] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.145874 17482 raft_consensus.cc:359] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.146684 17482 raft_consensus.cc:385] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.146986 17482 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.147647 17404 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:17.147672 17482 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.148885 17502 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:09:17.150560 17332 leader_election.cc:343] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.154464 17332 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:17.156889 17567 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.152839 17481 raft_consensus.cc:359] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.158010 17481 raft_consensus.cc:385] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.158743 17289 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:17.159353 17481 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.159099 17188 catalog_manager.cc:5697] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.161427 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:17.162288 17502 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.162796 17502 raft_consensus.cc:697] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:17.162984 17481 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.163769 17502 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.164894 17482 ts_tablet_manager.cc:1434] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:09:17.165364 17481 ts_tablet_manager.cc:1434] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:09:17.166710 17481 tablet_bootstrap.cc:492] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:17.169256 17482 tablet_bootstrap.cc:492] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:17.181233 17482 tablet_bootstrap.cc:654] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.187242 17483 tablet_bootstrap.cc:492] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:17.187791 17483 ts_tablet_manager.cc:1403] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.001s
I20260709 12:09:17.189739 17481 tablet_bootstrap.cc:654] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.191433 17483 raft_consensus.cc:359] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.192234 17483 raft_consensus.cc:385] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.192572 17483 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.192449 17188 catalog_manager.cc:5697] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.193437 17483 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.198335 17483 ts_tablet_manager.cc:1434] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:09:17.198464 17567 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.199301 17483 tablet_bootstrap.cc:492] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:17.198992 17567 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.203161 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.203975 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:17.205920 17332 leader_election.cc:343] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.207438 17333 leader_election.cc:343] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.207849 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:17.209527 17575 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.213267 17502 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.213800 17567 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.221688 17483 tablet_bootstrap.cc:654] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.224537 17481 tablet_bootstrap.cc:492] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.225095 17481 ts_tablet_manager.cc:1403] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.019s
I20260709 12:09:17.226228 17482 tablet_bootstrap.cc:492] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:17.226756 17482 ts_tablet_manager.cc:1403] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.026s
I20260709 12:09:17.226756 17567 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.227473 17567 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.231839 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.232549 17292 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:17.232952 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:17.234582 17482 raft_consensus.cc:359] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.235137 17567 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.235375 17482 raft_consensus.cc:385] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.235666 17482 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.236485 17482 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.238803 17482 ts_tablet_manager.cc:1434] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:17.237205 17481 raft_consensus.cc:359] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.239533 17332 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:17.240360 17567 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.240718 17567 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.240785 17288 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.241151 17567 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.241726 17502 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.233577 17441 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:17.244400 17482 tablet_bootstrap.cc:492] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:17.249290 17567 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.251812 17482 tablet_bootstrap.cc:654] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.252501 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:17.253263 17292 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.253515 17441 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.239948 17481 raft_consensus.cc:385] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.261722 17487 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.261759 17292 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:17.262454 17487 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.263238 17332 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:17.263868 17500 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.264127 17575 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.264629 17575 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:17.264361 17500 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.264932 17487 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.263232 17502 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:17.268206 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.268869 17367 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:17.261921 17481 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.270359 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:17.270313 17255 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:17.265544 17575 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.266772 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.270622 17481 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.268774 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:17.276970 17255 leader_election.cc:343] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.277910 17481 ts_tablet_manager.cc:1434] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:09:17.277734 17439 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:17.279165 17481 tablet_bootstrap.cc:492] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:17.269541 17567 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:17.281405 17258 leader_election.cc:343] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.282272 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:17.282873 17439 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.282306 17580 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.283633 17580 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.283950 17580 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.281883 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:17.286576 17481 tablet_bootstrap.cc:654] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.291059 17482 tablet_bootstrap.cc:492] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:17.291656 17482 ts_tablet_manager.cc:1403] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.004s
I20260709 12:09:17.266652 17500 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.293733 17500 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.295661 17502 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.299268 17481 tablet_bootstrap.cc:492] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.301622 17481 ts_tablet_manager.cc:1403] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 12:09:17.303558 17482 raft_consensus.cc:359] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.308151 17482 raft_consensus.cc:385] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.308476 17482 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.313972 17439 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:17.306288 17481 raft_consensus.cc:359] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.305930 17580 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.324250 17481 raft_consensus.cc:385] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.324712 17481 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.325438 17481 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.326632 17580 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.370577 17481 ts_tablet_manager.cc:1434] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.069s	user 0.017s	sys 0.013s
I20260709 12:09:17.371167 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:17.371726 17481 tablet_bootstrap.cc:492] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:17.371786 17363 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.374051 17482 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.373347 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:17.379067 17483 tablet_bootstrap.cc:492] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:17.376426 17440 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.379716 17483 ts_tablet_manager.cc:1403] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.007s
I20260709 12:09:17.388585 17482 ts_tablet_manager.cc:1434] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.003s
I20260709 12:09:17.389413 17482 tablet_bootstrap.cc:492] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:17.419085 17440 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:17.420401 17187 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.422221 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:17.431243 17483 raft_consensus.cc:359] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.431949 17580 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.433216 17580 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:17.433612 17483 raft_consensus.cc:385] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.434307 17483 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.435078 17483 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.434072 17580 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.437088 17483 ts_tablet_manager.cc:1434] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.057s	user 0.001s	sys 0.009s
I20260709 12:09:17.437966 17483 tablet_bootstrap.cc:492] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:17.440024 17552 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.440577 17552 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.443384 17481 tablet_bootstrap.cc:654] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.446975 17552 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.448413 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.448518 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:09:17.449960 17406 leader_election.cc:343] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.450563 17404 leader_election.cc:343] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.454578 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:17.455343 17552 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.456104 17363 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:17.461207 17482 tablet_bootstrap.cc:654] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.460714 17187 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.465794 17483 tablet_bootstrap.cc:654] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.470340 17482 tablet_bootstrap.cc:492] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:17.470737 17482 ts_tablet_manager.cc:1403] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.081s	user 0.004s	sys 0.006s
I20260709 12:09:17.471339 17481 tablet_bootstrap.cc:492] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.471819 17481 ts_tablet_manager.cc:1403] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.002s
I20260709 12:09:17.472793 17482 raft_consensus.cc:359] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.473518 17482 raft_consensus.cc:385] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.473793 17482 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.474306 17481 raft_consensus.cc:359] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.474988 17481 raft_consensus.cc:385] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.475206 17481 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.475839 17481 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.475826 17482 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.476871 17483 tablet_bootstrap.cc:492] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:17.477376 17483 ts_tablet_manager.cc:1403] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.001s
I20260709 12:09:17.478376 17481 ts_tablet_manager.cc:1434] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:17.479722 17481 tablet_bootstrap.cc:492] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:17.480098 17483 raft_consensus.cc:359] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.480777 17483 raft_consensus.cc:385] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.481148 17483 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.481889 17483 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.486208 17481 tablet_bootstrap.cc:654] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.487485 17483 ts_tablet_manager.cc:1434] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:17.488487 17483 tablet_bootstrap.cc:492] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:17.491416 17481 tablet_bootstrap.cc:492] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.491863 17481 ts_tablet_manager.cc:1403] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:09:17.494783 17481 raft_consensus.cc:359] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.495453 17483 tablet_bootstrap.cc:654] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.495469 17481 raft_consensus.cc:385] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.496606 17481 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.497267 17481 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.499264 17481 ts_tablet_manager.cc:1434] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:09:17.500468 17481 tablet_bootstrap.cc:492] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:17.505913 17481 tablet_bootstrap.cc:654] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.515381 17482 ts_tablet_manager.cc:1434] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:09:17.518708 17567 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.519253 17567 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.521353 17567 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.522210 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.516628 17482 tablet_bootstrap.cc:492] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:17.523272 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:17.523059 17288 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:17.528613 17333 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:17.529861 17567 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.530404 17482 tablet_bootstrap.cc:654] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.516647 17481 tablet_bootstrap.cc:492] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.533818 17481 ts_tablet_manager.cc:1403] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.008s
I20260709 12:09:17.536005 17567 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.536758 17481 raft_consensus.cc:359] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.537464 17481 raft_consensus.cc:385] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.537688 17481 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.538429 17481 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.539258 17483 tablet_bootstrap.cc:492] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:17.539733 17483 ts_tablet_manager.cc:1403] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.022s
I20260709 12:09:17.539769 17482 tablet_bootstrap.cc:492] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:17.540405 17482 ts_tablet_manager.cc:1403] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.024s	user 0.002s	sys 0.010s
I20260709 12:09:17.541712 17552 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.542212 17552 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.543037 17483 raft_consensus.cc:359] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.543692 17483 raft_consensus.cc:385] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.543952 17483 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.544284 17552 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.544016 17482 raft_consensus.cc:359] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.544653 17483 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.544996 17482 raft_consensus.cc:385] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.545433 17482 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.546092 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.546206 17482 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.546769 17363 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:17.548813 17482 ts_tablet_manager.cc:1434] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:17.550310 17482 tablet_bootstrap.cc:492] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:17.552320 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.552982 17288 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:17.553848 17483 ts_tablet_manager.cc:1434] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:09:17.554428 17404 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:17.554843 17483 tablet_bootstrap.cc:492] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:17.556334 17482 tablet_bootstrap.cc:654] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.556845 17552 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.557264 17552 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.557610 17552 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.561375 17483 tablet_bootstrap.cc:654] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.564865 17568 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.587409 17570 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.592665 17580 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.593271 17580 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.595491 17580 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.596483 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.597295 17363 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 1: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:17.597985 17502 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.598480 17502 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.600519 17502 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.602708 17482 tablet_bootstrap.cc:492] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:17.603215 17482 ts_tablet_manager.cc:1403] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.017s
I20260709 12:09:17.604406 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:17.605201 17440 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:17.605943 17482 raft_consensus.cc:359] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.606905 17637 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.607483 17637 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.607554 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.608800 17363 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:17.607519 17258 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:17.609781 17637 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.610380 17637 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.611356 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:17.611668 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.612003 17440 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:17.613541 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:17.614428 17568 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.614773 17568 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.615118 17568 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.610534 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.614338 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:17.617792 17487 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.618173 17487 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.618502 17487 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:17.619550 17255 leader_election.cc:343] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.622766 17481 ts_tablet_manager.cc:1434] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.000s
I20260709 12:09:17.606906 17482 raft_consensus.cc:385] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.623495 17482 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.624249 17482 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:17.625340 17406 leader_election.cc:343] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.627323 17487 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.628044 17568 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.633754 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:17.634418 17487 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.634786 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:17.635205 17440 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:17.646808 17255 leader_election.cc:343] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.629082 17481 tablet_bootstrap.cc:492] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:17.637378 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:17.637877 17568 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.638765 17482 ts_tablet_manager.cc:1434] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:09:17.652235 17367 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.653252 17482 tablet_bootstrap.cc:492] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:17.653644 17440 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:17.639124 17552 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.656154 17552 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.640235 17637 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.642935 17483 tablet_bootstrap.cc:492] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:17.643469 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:17.657325 17483 ts_tablet_manager.cc:1403] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.103s	user 0.030s	sys 0.054s
I20260709 12:09:17.658138 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:17.658733 17363 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.658879 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:17.659674 17637 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.660135 17637 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:17.660317 17483 raft_consensus.cc:359] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.661063 17483 raft_consensus.cc:385] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.661343 17483 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.662129 17483 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.664125 17483 ts_tablet_manager.cc:1434] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:09:17.665050 17483 tablet_bootstrap.cc:492] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:17.666208 17637 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.652202 17481 tablet_bootstrap.cc:654] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.670892 17483 tablet_bootstrap.cc:654] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.674091 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:17.674774 17288 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.679293 17568 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.684923 17363 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:17.685420 17568 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.686647 17404 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:17.687800 17568 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.687839 17552 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.689224 17552 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:17.689603 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.690307 17552 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:17.694672 17406 leader_election.cc:343] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.694741 17404 leader_election.cc:343] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.696358 17482 tablet_bootstrap.cc:654] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.697515 17367 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:17.699061 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:17.700233 17568 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.700956 17568 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:17.701944 17568 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.703176 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.705129 17288 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:17.705056 17553 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.706269 17481 tablet_bootstrap.cc:492] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.706879 17481 ts_tablet_manager.cc:1403] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.011s
I20260709 12:09:17.713712 17187 catalog_manager.cc:5697] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:17.717624 17406 leader_election.cc:343] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.718739 17406 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:17.719625 17553 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.724988 17189 catalog_manager.cc:5697] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.727322 17481 raft_consensus.cc:359] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.738785 17481 raft_consensus.cc:385] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.739243 17481 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.740033 17481 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.742384 17481 ts_tablet_manager.cc:1434] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 12:09:17.742208 17567 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.743619 17481 tablet_bootstrap.cc:492] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:17.749423 17552 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.751422 17481 tablet_bootstrap.cc:654] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.763165 17481 tablet_bootstrap.cc:492] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.770696 17481 ts_tablet_manager.cc:1403] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.001s
I20260709 12:09:17.774315 17481 raft_consensus.cc:359] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.775228 17481 raft_consensus.cc:385] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.775592 17481 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.776918 17482 tablet_bootstrap.cc:492] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:17.776526 17481 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.777477 17482 ts_tablet_manager.cc:1403] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.124s	user 0.005s	sys 0.006s
I20260709 12:09:17.787653 17481 ts_tablet_manager.cc:1434] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:17.788658 17481 tablet_bootstrap.cc:492] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:17.796650 17189 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.802441 17567 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.803169 17483 tablet_bootstrap.cc:492] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:17.803634 17483 ts_tablet_manager.cc:1403] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.139s	user 0.045s	sys 0.037s
I20260709 12:09:17.814661 17483 raft_consensus.cc:359] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.815158 17482 raft_consensus.cc:359] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.816092 17483 raft_consensus.cc:385] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.816334 17482 raft_consensus.cc:385] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.816380 17483 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.816682 17482 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.817137 17483 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.817828 17482 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.819169 17483 ts_tablet_manager.cc:1434] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:17.820147 17483 tablet_bootstrap.cc:492] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:17.820633 17481 tablet_bootstrap.cc:654] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.822973 17482 ts_tablet_manager.cc:1434] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.004s
I20260709 12:09:17.824036 17482 tablet_bootstrap.cc:492] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:17.822518 17502 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.835037 17502 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.837240 17502 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.839501 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.840583 17575 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.841063 17575 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.844925 17575 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.845559 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.846274 17292 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:17.841755 17289 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:17.850263 17332 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:17.850847 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:17.851143 17406 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:17.851145 17575 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.852247 17575 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.852591 17575 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.854282 17568 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.854648 17568 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:17.854835 17333 leader_election.cc:343] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.854986 17568 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.850143 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.857241 17482 tablet_bootstrap.cc:654] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:17.857736 17404 leader_election.cc:343] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.853647 17637 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.857873 17483 tablet_bootstrap.cc:654] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.860327 17575 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.867580 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:17.868286 17289 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.867486 17568 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.872931 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:17.873673 17292 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.881286 17292 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:17.882741 17406 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:17.883671 17502 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.885004 17502 raft_consensus.cc:697] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:17.886040 17502 consensus_queue.cc:237] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.888362 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:09:17.891007 17333 leader_election.cc:343] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.891958 17575 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.892689 17575 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.893272 17575 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.896437 17289 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:17.899686 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.900339 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:17.901656 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:17.902168 17332 leader_election.cc:343] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.902432 17440 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
W20260709 12:09:17.903910 17404 leader_election.cc:343] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.903848 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:17.905110 17568 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.886034 17481 tablet_bootstrap.cc:492] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:17.907145 17481 ts_tablet_manager.cc:1403] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.119s	user 0.004s	sys 0.008s
I20260709 12:09:17.906540 17332 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:17.935086 17570 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.923784 17189 catalog_manager.cc:5697] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.949009 17570 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.910069 17481 raft_consensus.cc:359] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.951704 17481 raft_consensus.cc:385] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.951987 17481 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.952666 17481 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.953552 17637 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.945663 17568 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.958838 17481 ts_tablet_manager.cc:1434] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.051s	user 0.001s	sys 0.006s
I20260709 12:09:17.957814 17671 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.964902 17671 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:17.965811 17671 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:17.940124 17575 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:17.964211 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:17.959332 17570 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:17.970674 17404 leader_election.cc:343] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.957363 17672 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.975975 17481 tablet_bootstrap.cc:492] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
W20260709 12:09:17.955492 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 51763.3us
I20260709 12:09:17.977331 17482 tablet_bootstrap.cc:492] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:17.977948 17482 ts_tablet_manager.cc:1403] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.154s	user 0.017s	sys 0.020s
I20260709 12:09:17.972743 17568 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:17.972954 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 66561.5us
I20260709 12:09:17.981283 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.982074 17289 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:17.984416 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:17.974362 17672 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.985623 17570 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.986066 17570 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.986439 17570 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.986747 17568 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:17.987406 17672 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.991149 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:17.992720 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:09:17.994544 17406 leader_election.cc:343] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.997870 17570 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.005398 17570 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:18.004047 17404 leader_election.cc:343] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.007525 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.007721 17404 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.008407 17570 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.010082 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:18.011262 17482 raft_consensus.cc:359] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:18.011539 17404 leader_election.cc:343] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.011600 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:18.012283 17482 raft_consensus.cc:385] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.012756 17482 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.012313 17292 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.013672 17482 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.020465 17292 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:18.021844 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.021961 17672 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.023118 17502 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.023612 17502 raft_consensus.cc:697] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:18.024473 17502 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.025375 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:18.025969 17440 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.027043 17483 tablet_bootstrap.cc:492] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.027552 17483 ts_tablet_manager.cc:1403] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.208s	user 0.042s	sys 0.059s
I20260709 12:09:18.027563 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:18.030350 17483 raft_consensus.cc:359] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.031150 17483 raft_consensus.cc:385] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.031426 17483 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.032054 17483 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:18.030746 17332 leader_election.cc:343] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.036170 17483 ts_tablet_manager.cc:1434] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:18.037353 17483 tablet_bootstrap.cc:492] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.040925 17482 ts_tablet_manager.cc:1434] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.004s
I20260709 12:09:18.042218 17482 tablet_bootstrap.cc:492] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:18.038723 17672 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.053318 17440 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:18.056926 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:09:18.057652 17255 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.057739 17187 catalog_manager.cc:5697] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.058722 17672 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.060031 17672 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:18.060154 17188 catalog_manager.cc:5697] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.061026 17672 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.072690 17481 tablet_bootstrap.cc:654] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.072826 17482 tablet_bootstrap.cc:654] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.078531 17483 tablet_bootstrap.cc:654] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.090551 17481 tablet_bootstrap.cc:492] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:18.091137 17481 ts_tablet_manager.cc:1403] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.004s
I20260709 12:09:18.094221 17483 tablet_bootstrap.cc:492] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.094290 17482 tablet_bootstrap.cc:492] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:18.094895 17483 ts_tablet_manager.cc:1403] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.003s
I20260709 12:09:18.094970 17482 ts_tablet_manager.cc:1403] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.021s
I20260709 12:09:18.095191 17187 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.097663 17483 raft_consensus.cc:359] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.097790 17482 raft_consensus.cc:359] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.098435 17483 raft_consensus.cc:385] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.098593 17482 raft_consensus.cc:385] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.098753 17483 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.098986 17482 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.099460 17483 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.099869 17482 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.102350 17482 ts_tablet_manager.cc:1434] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:18.102398 17483 ts_tablet_manager.cc:1434] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:18.103487 17483 tablet_bootstrap.cc:492] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.103485 17482 tablet_bootstrap.cc:492] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:18.104797 17481 raft_consensus.cc:359] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.105530 17481 raft_consensus.cc:385] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.105789 17481 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.106559 17481 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.109951 17481 ts_tablet_manager.cc:1434] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:09:18.111203 17672 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.111728 17672 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.112731 17502 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.113267 17483 tablet_bootstrap.cc:654] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.117583 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.120178 17482 tablet_bootstrap.cc:654] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.120736 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.121277 17481 tablet_bootstrap.cc:492] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:18.121371 17441 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:18.122290 17567 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.122757 17567 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.125113 17567 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.127305 17481 tablet_bootstrap.cc:654] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.128913 17332 leader_election.cc:343] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.135380 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.137943 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.139526 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:18.141098 17671 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.141506 17671 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.141855 17671 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.144224 17332 leader_election.cc:343] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.148747 17289 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.149075 17483 tablet_bootstrap.cc:492] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.149536 17483 ts_tablet_manager.cc:1403] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.002s
I20260709 12:09:18.152217 17483 raft_consensus.cc:359] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.152890 17483 raft_consensus.cc:385] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.153158 17483 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.153919 17483 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.157893 17483 ts_tablet_manager.cc:1434] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:09:18.158313 17568 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:18.164336 17333 leader_election.cc:343] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.165308 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:18.165904 17672 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.172434 17553 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.172582 17487 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.173735 17483 tablet_bootstrap.cc:492] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.174595 17567 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.180550 17483 tablet_bootstrap.cc:654] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.190691 17482 tablet_bootstrap.cc:492] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:18.191185 17482 ts_tablet_manager.cc:1403] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.004s
I20260709 12:09:18.192170 17483 tablet_bootstrap.cc:492] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.192696 17483 ts_tablet_manager.cc:1403] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:09:18.195640 17483 raft_consensus.cc:359] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.196348 17483 raft_consensus.cc:385] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.196606 17483 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.197400 17483 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.199594 17483 ts_tablet_manager.cc:1434] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:18.200670 17483 tablet_bootstrap.cc:492] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.204309 17482 raft_consensus.cc:359] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.205053 17482 raft_consensus.cc:385] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.206746 17483 tablet_bootstrap.cc:654] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.220297 17671 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.205335 17482 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.222251 17483 tablet_bootstrap.cc:492] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.225963 17483 ts_tablet_manager.cc:1403] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 12:09:18.225888 17482 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.228104 17482 ts_tablet_manager.cc:1434] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:09:18.228994 17482 tablet_bootstrap.cc:492] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:18.228632 17483 raft_consensus.cc:359] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.229316 17483 raft_consensus.cc:385] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.229583 17483 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.230679 17487 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.231242 17487 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.232373 17483 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.233561 17487 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.234840 17483 ts_tablet_manager.cc:1434] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:18.234997 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.235603 17441 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:18.235622 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.236770 17363 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:18.237428 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:18.242416 17487 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:18.243058 17487 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.243510 17487 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:18.244663 17482 tablet_bootstrap.cc:654] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.262281 17483 tablet_bootstrap.cc:492] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.267933 17570 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:18.275324 17487 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.291625 17487 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.292439 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:18.292953 17671 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.293058 17367 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:18.294001 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:18.295542 17441 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:18.294462 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:18.296223 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:18.296535 17439 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.296780 17292 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.304662 17482 tablet_bootstrap.cc:492] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:18.305217 17482 ts_tablet_manager.cc:1403] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.014s
I20260709 12:09:18.310699 17580 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.311223 17580 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.311642 17482 raft_consensus.cc:359] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.312286 17482 raft_consensus.cc:385] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.312544 17482 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.313460 17580 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.315559 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.316004 17481 tablet_bootstrap.cc:492] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:18.316465 17481 ts_tablet_manager.cc:1403] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.195s	user 0.054s	sys 0.080s
I20260709 12:09:18.313205 17482 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:18.318280 17255 leader_election.cc:343] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.320055 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.320995 17481 raft_consensus.cc:359] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.321538 17481 raft_consensus.cc:385] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.321738 17481 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.322500 17481 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.313871 17292 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
W20260709 12:09:18.323567 17258 leader_election.cc:343] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.332556 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:18.333253 17580 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.333792 17482 ts_tablet_manager.cc:1434] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:09:18.326521 17441 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:18.333856 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:18.328128 17483 tablet_bootstrap.cc:654] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.334898 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:18.335611 17637 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:18.335728 17671 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.336087 17637 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:18.336225 17671 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:18.331791 17367 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:18.333670 17502 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.337018 17671 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.336963 17637 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.337467 17502 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.339314 17482 tablet_bootstrap.cc:492] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:18.339416 17502 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.325126 17481 ts_tablet_manager.cc:1434] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:18.326509 17439 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:18.345815 17481 tablet_bootstrap.cc:492] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:18.348093 17482 tablet_bootstrap.cc:654] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.351029 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.351486 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:18.352385 17404 leader_election.cc:343] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.352839 17406 leader_election.cc:343] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.353358 17406 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.356710 17502 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.359594 17482 tablet_bootstrap.cc:492] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:18.360196 17482 ts_tablet_manager.cc:1403] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 12:09:18.362249 17672 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.362743 17483 tablet_bootstrap.cc:492] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.362766 17672 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.363452 17483 ts_tablet_manager.cc:1403] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.111s	user 0.006s	sys 0.008s
I20260709 12:09:18.366613 17672 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.368153 17483 raft_consensus.cc:359] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.368674 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.368990 17483 raft_consensus.cc:385] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.369293 17483 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.370442 17188 catalog_manager.cc:5697] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 2, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.372611 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.373428 17292 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:18.370024 17483 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.373770 17482 raft_consensus.cc:359] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.376152 17481 tablet_bootstrap.cc:654] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.377059 17332 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:18.388594 17483 ts_tablet_manager.cc:1434] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:09:18.391808 17483 tablet_bootstrap.cc:492] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.390463 17672 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.394470 17482 raft_consensus.cc:385] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.394831 17482 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.395733 17482 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.397792 17482 ts_tablet_manager.cc:1434] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.000s
I20260709 12:09:18.398909 17482 tablet_bootstrap.cc:492] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:18.407490 17672 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.413369 17482 tablet_bootstrap.cc:654] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.413380 17483 tablet_bootstrap.cc:654] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.415683 17580 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.416244 17580 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.418118 17580 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.418888 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.422246 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.428675 17363 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.429275 17439 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:18.430601 17258 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:18.426183 17482 tablet_bootstrap.cc:492] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:18.431288 17481 tablet_bootstrap.cc:492] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:18.431314 17580 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.431921 17580 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.432052 17481 ts_tablet_manager.cc:1403] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.006s
I20260709 12:09:18.428329 17187 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.432319 17580 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.434991 17481 raft_consensus.cc:359] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.435714 17481 raft_consensus.cc:385] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.436026 17481 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
W20260709 12:09:18.436064 17255 leader_election.cc:343] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.437986 17481 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.439066 17580 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.441017 17483 tablet_bootstrap.cc:492] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.441287 17482 ts_tablet_manager.cc:1403] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.010s
I20260709 12:09:18.441607 17483 ts_tablet_manager.cc:1403] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.006s
I20260709 12:09:18.442222 17570 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.442709 17570 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.444630 17570 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.445385 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.447242 17672 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.447489 17481 ts_tablet_manager.cc:1434] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:09:18.447767 17672 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.448434 17481 tablet_bootstrap.cc:492] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:18.449920 17672 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.451145 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.451959 17289 raft_consensus.cc:2393] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:18.451768 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.452056 17361 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.454713 17481 tablet_bootstrap.cc:654] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.454480 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.456239 17482 raft_consensus.cc:359] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.459358 17482 raft_consensus.cc:385] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.459642 17482 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.460325 17482 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.462615 17482 ts_tablet_manager.cc:1434] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:09:18.463382 17482 tablet_bootstrap.cc:492] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:18.467861 17483 raft_consensus.cc:359] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.468556 17482 tablet_bootstrap.cc:654] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.468730 17483 raft_consensus.cc:385] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.469079 17483 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.469508 17580 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.470849 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:18.471578 17439 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.448030 17406 leader_election.cc:343] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.478327 17404 leader_election.cc:343] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.479240 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:18.480389 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.482646 17502 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.483950 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:18.485133 17672 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.485257 17553 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.486231 17672 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:18.487160 17255 leader_election.cc:343] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.487972 17482 tablet_bootstrap.cc:492] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:18.488471 17482 ts_tablet_manager.cc:1403] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 12:09:18.491255 17482 raft_consensus.cc:359] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.491938 17482 raft_consensus.cc:385] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.492218 17482 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.492844 17482 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.495618 17482 ts_tablet_manager.cc:1434] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:18.495667 17553 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.496667 17482 tablet_bootstrap.cc:492] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
W20260709 12:09:18.506176 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 58184.4us
I20260709 12:09:18.509922 17289 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.510782 17439 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:18.512251 17258 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.513193 17580 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.513734 17580 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:18.513584 17553 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.514694 17580 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.521076 17666 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.522528 17483 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.525094 17483 ts_tablet_manager.cc:1434] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.083s	user 0.000s	sys 0.008s
I20260709 12:09:18.521339 17553 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.541590 17553 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.543948 17483 tablet_bootstrap.cc:492] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.544246 17188 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.551676 17481 tablet_bootstrap.cc:492] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:18.552238 17481 ts_tablet_manager.cc:1403] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.104s	user 0.042s	sys 0.046s
I20260709 12:09:18.553464 17553 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.554280 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.554999 17481 raft_consensus.cc:359] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.555672 17481 raft_consensus.cc:385] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.555856 17482 tablet_bootstrap.cc:654] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.555927 17404 leader_election.cc:343] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.557330 17483 tablet_bootstrap.cc:654] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.555963 17481 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.561151 17481 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.562556 17481 ts_tablet_manager.cc:1434] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:09:18.564489 17481 tablet_bootstrap.cc:492] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:18.565778 17483 tablet_bootstrap.cc:492] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.566383 17483 ts_tablet_manager.cc:1403] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.003s
I20260709 12:09:18.567610 17553 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.568145 17553 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.570515 17483 raft_consensus.cc:359] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.571485 17483 raft_consensus.cc:385] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.571870 17483 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.572389 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.572672 17483 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:18.574088 17404 leader_election.cc:343] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.570904 17553 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.574684 17483 ts_tablet_manager.cc:1434] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:18.574709 17481 tablet_bootstrap.cc:654] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.630321 17567 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:18.632202 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 43870.6us
W20260709 12:09:18.636706 17333 consensus_peers.cc:597] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.637655 17483 tablet_bootstrap.cc:492] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.647758 17481 tablet_bootstrap.cc:492] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:18.648530 17481 ts_tablet_manager.cc:1403] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.085s	user 0.032s	sys 0.004s
I20260709 12:09:18.651638 17481 raft_consensus.cc:359] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.652418 17481 raft_consensus.cc:385] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.652762 17481 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.654762 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.653616 17481 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.657444 17481 ts_tablet_manager.cc:1434] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:09:18.658648 17481 tablet_bootstrap.cc:492] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
W20260709 12:09:18.666023 17704 log.cc:927] Time spent T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:09:18.667724 17481 tablet_bootstrap.cc:654] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.668095 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.668807 17288 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:18.686517 17481 tablet_bootstrap.cc:492] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:18.687139 17481 ts_tablet_manager.cc:1403] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.008s
I20260709 12:09:18.689906 17481 raft_consensus.cc:359] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:18.691744 17406 leader_election.cc:343] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.694252 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.696311 17406 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.696918 17553 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.697757 17568 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.692415 17580 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.698885 17580 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.701277 17580 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.702144 17502 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.702554 17502 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.702849 17502 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.704026 17567 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.704496 17567 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.701987 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.707322 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.707597 17567 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.709045 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.709940 17441 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:09:18.714334 17502 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.717262 17481 raft_consensus.cc:385] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.717614 17481 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.718008 17258 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:18.719628 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:09:18.721563 17404 leader_election.cc:343] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.721658 17502 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.721572 17481 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.723552 17672 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.724102 17481 ts_tablet_manager.cc:1434] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.000s
I20260709 12:09:18.724059 17672 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.725109 17481 tablet_bootstrap.cc:492] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:18.726217 17672 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.726735 17483 tablet_bootstrap.cc:654] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.727952 17580 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:18.728482 17487 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.728473 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.729038 17487 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.729321 17441 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:18.731209 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.731258 17487 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.733014 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:18.733268 17333 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:18.733609 17290 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.734295 17672 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.734731 17672 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.735139 17672 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.739331 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.743328 17290 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:18.743836 17487 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.743561 17481 tablet_bootstrap.cc:654] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.744292 17487 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.746459 17487 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.747244 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.747891 17363 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:18.749114 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.749557 17482 tablet_bootstrap.cc:492] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:18.750075 17482 ts_tablet_manager.cc:1403] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.254s	user 0.048s	sys 0.057s
I20260709 12:09:18.750891 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.749183 17255 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:18.752310 17487 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.752682 17487 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.753022 17487 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.753743 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.754403 17292 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
W20260709 12:09:18.756526 17258 leader_election.cc:343] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.752867 17482 raft_consensus.cc:359] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.758970 17482 raft_consensus.cc:385] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.759253 17482 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.759987 17482 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.751515 17441 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:18.760239 17406 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.761744 17332 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:18.763181 17570 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.763651 17570 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:18.764688 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:18.764452 17570 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.766300 17580 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.766724 17580 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.767066 17580 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.772202 17552 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.772737 17552 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.774652 17567 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.774432 17580 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.776772 17580 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.778158 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:18.779836 17482 ts_tablet_manager.cc:1434] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:09:18.781016 17482 tablet_bootstrap.cc:492] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:18.781312 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:18.785107 17487 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.782023 17441 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.789971 17487 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.791632 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:18.765785 17672 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.796092 17366 raft_consensus.cc:2393] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 1: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:18.795928 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:18.796660 17363 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.796181 17482 tablet_bootstrap.cc:654] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.787416 17552 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.805203 17672 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.806759 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.807552 17366 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:18.781337 17567 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.812647 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:18.815006 17483 tablet_bootstrap.cc:492] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.815517 17483 ts_tablet_manager.cc:1403] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.178s	user 0.032s	sys 0.028s
I20260709 12:09:18.817032 17404 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:18.817829 17568 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:18.818269 17568 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.818608 17568 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:18.818619 17483 raft_consensus.cc:359] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.819732 17481 tablet_bootstrap.cc:492] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:18.820264 17481 ts_tablet_manager.cc:1403] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.004s
I20260709 12:09:18.819878 17483 raft_consensus.cc:385] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.821071 17483 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.821724 17483 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.822963 17481 raft_consensus.cc:359] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.823632 17481 raft_consensus.cc:385] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.823899 17481 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.819732 17482 tablet_bootstrap.cc:492] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:18.824841 17482 ts_tablet_manager.cc:1403] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 12:09:18.824533 17481 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.826660 17481 ts_tablet_manager.cc:1434] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:18.827742 17481 tablet_bootstrap.cc:492] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:18.828300 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:18.829098 17292 raft_consensus.cc:2393] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:09:18.830461 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.831179 17292 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:18.833503 17481 tablet_bootstrap.cc:654] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.834789 17567 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.840606 17567 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.843483 17481 tablet_bootstrap.cc:492] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:18.843990 17481 ts_tablet_manager.cc:1403] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:09:18.844262 17567 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:18.835997 17258 leader_election.cc:343] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.838011 17483 ts_tablet_manager.cc:1434] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.005s
I20260709 12:09:18.839634 17482 raft_consensus.cc:359] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.845717 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:18.846406 17482 raft_consensus.cc:385] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.846603 17440 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:18.846756 17482 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.846885 17332 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:18.847463 17482 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.847749 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:18.848261 17568 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.848572 17666 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.849685 17482 ts_tablet_manager.cc:1434] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 12:09:18.849422 17671 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.850348 17568 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.850646 17482 tablet_bootstrap.cc:492] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:18.849378 17666 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.850859 17568 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.851030 17666 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.851415 17666 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.854522 17441 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:18.858914 17363 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:18.859474 17483 tablet_bootstrap.cc:492] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.860092 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.860306 17255 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:18.861570 17487 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.861989 17487 raft_consensus.cc:697] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:18.862043 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:18.862651 17290 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:18.866385 17483 tablet_bootstrap.cc:654] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.867012 17666 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.862792 17487 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.870149 17290 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:09:18.871122 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.869707 17666 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.871906 17482 tablet_bootstrap.cc:654] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.873471 17332 leader_election.cc:343] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.874185 17637 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.874688 17637 raft_consensus.cc:697] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:18.875483 17637 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.881649 17481 raft_consensus.cc:359] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.882429 17481 raft_consensus.cc:385] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.882741 17481 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.883613 17406 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:18.883437 17481 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.884454 17552 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:18.885002 17481 ts_tablet_manager.cc:1434] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 12:09:18.884953 17552 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:18.886037 17481 tablet_bootstrap.cc:492] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:18.886297 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:18.885991 17552 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.851344 17568 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.888839 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:18.889482 17439 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.896514 17189 catalog_manager.cc:5697] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.897413 17439 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:18.898653 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:18.899523 17666 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.900022 17666 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:18.900907 17666 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.898949 17188 catalog_manager.cc:5697] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.904198 17568 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.905700 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:09:18.908514 17404 leader_election.cc:343] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.913810 17483 tablet_bootstrap.cc:492] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:18.914831 17483 ts_tablet_manager.cc:1403] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.004s
I20260709 12:09:18.915675 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:18.916296 17363 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:18.916688 17481 tablet_bootstrap.cc:654] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.918170 17483 raft_consensus.cc:359] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.919035 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.919205 17483 raft_consensus.cc:385] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.919682 17483 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.921463 17483 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:18.924496 17406 leader_election.cc:343] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.924981 17406 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.926019 17502 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.911156 17567 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:18.926596 17332 leader_election.cc:343] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.928309 17567 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.930306 17483 ts_tablet_manager.cc:1434] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:09:18.931421 17483 tablet_bootstrap.cc:492] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:18.937386 17672 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.940217 17363 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:09:18.942298 17487 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.944705 17567 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:18.945797 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:18.947278 17333 leader_election.cc:343] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.949880 17366 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:18.951468 17482 tablet_bootstrap.cc:492] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:18.952001 17482 ts_tablet_manager.cc:1403] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.102s	user 0.008s	sys 0.008s
I20260709 12:09:18.950347 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.955149 17482 raft_consensus.cc:359] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.955971 17482 raft_consensus.cc:385] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.956254 17482 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.957134 17482 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.960464 17637 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.958904 17552 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.962586 17552 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.965121 17552 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.966271 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:18.967062 17361 raft_consensus.cc:2393] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 1: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:09:18.969440 17440 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:18.970541 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:18.955143 17290 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:18.972754 17406 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:18.970341 17189 catalog_manager.cc:5697] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.973317 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:18.974115 17570 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.974246 17666 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.974668 17666 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.975114 17666 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.978292 17567 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.979332 17567 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.984267 17502 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.984875 17502 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:18.987175 17502 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:18.989264 17482 ts_tablet_manager.cc:1434] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:09:18.990527 17482 tablet_bootstrap.cc:492] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:18.993319 17188 catalog_manager.cc:5697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.007277 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:19.007184 17666 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:19.011878 17404 leader_election.cc:343] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.018219 17666 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:19.020378 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:19.021073 17288 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.996102 17637 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:09:19.009958 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:19.024029 17290 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:19.027560 17570 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.029609 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:19.029825 17406 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:19.032773 17553 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.033262 17553 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.033692 17553 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.033195 17333 leader_election.cc:343] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.040372 17288 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:19.059108 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:19.060457 17672 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.063097 17672 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:19.065621 17482 tablet_bootstrap.cc:654] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.044907 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:19.053153 17553 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.045925 17187 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 2, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.056591 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:19.063225 17481 tablet_bootstrap.cc:492] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:19.043280 17567 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:19.081686 17481 ts_tablet_manager.cc:1403] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.196s	user 0.056s	sys 0.056s
I20260709 12:09:19.066751 17672 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.093340 17481 raft_consensus.cc:359] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.094488 17481 raft_consensus.cc:385] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.094888 17481 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.095690 17481 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:19.093423 17332 leader_election.cc:343] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.098832 17481 ts_tablet_manager.cc:1434] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:09:19.100551 17483 tablet_bootstrap.cc:654] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.101291 17487 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.103122 17481 tablet_bootstrap.cc:492] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:19.103749 17553 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:19.104763 17333 leader_election.cc:343] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.108774 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:19.117117 17567 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.120654 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:09:19.126600 17404 leader_election.cc:343] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.128069 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:19.149726 17290 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.199563 17552 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.200141 17552 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.206461 17361 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.210511 17483 tablet_bootstrap.cc:492] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:19.211366 17483 ts_tablet_manager.cc:1403] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.280s	user 0.029s	sys 0.051s
I20260709 12:09:19.210551 17552 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:19.218844 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:19.226295 17481 tablet_bootstrap.cc:654] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.233306 17483 raft_consensus.cc:359] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.234089 17483 raft_consensus.cc:385] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.238500 17483 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
W20260709 12:09:19.255815 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 81244.9us
I20260709 12:09:19.238317 17290 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:19.276026 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:19.276185 17483 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.276932 17441 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.278070 17482 tablet_bootstrap.cc:492] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:19.278647 17482 ts_tablet_manager.cc:1403] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.288s	user 0.017s	sys 0.006s
I20260709 12:09:19.286258 17552 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.286991 17552 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.287292 17671 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.287827 17483 ts_tablet_manager.cc:1434] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.001s
I20260709 12:09:19.288136 17671 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.289114 17483 tablet_bootstrap.cc:492] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:19.290464 17502 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.296332 17671 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:19.298840 17406 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:19.299106 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:19.300297 17502 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.300740 17502 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:19.301496 17502 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.303897 17552 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:19.306074 17482 raft_consensus.cc:359] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.306692 17406 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:19.307024 17482 raft_consensus.cc:385] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.307449 17482 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.308367 17482 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.293989 17188 catalog_manager.cc:5697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.319412 17482 ts_tablet_manager.cc:1434] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:09:19.321244 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:19.322001 17292 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:19.328740 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:19.330811 17481 tablet_bootstrap.cc:492] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:19.330638 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:19.331383 17481 ts_tablet_manager.cc:1403] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.229s	user 0.022s	sys 0.014s
I20260709 12:09:19.331476 17367 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:19.330526 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:19.341662 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.359972 17482 tablet_bootstrap.cc:492] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:19.363260 17567 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:19.365085 17567 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:19.365527 17567 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.370218 17552 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.375306 17567 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:19.378154 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 52715us
I20260709 12:09:19.378571 17483 tablet_bootstrap.cc:654] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.381551 17406 leader_election.cc:343] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.386618 17740 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.393200 17740 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.405534 17404 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:19.411628 17740 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:19.412789 17567 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:19.413056 17332 consensus_peers.cc:597] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:19.412955 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:19.415184 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:19.419560 17481 raft_consensus.cc:359] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.423935 17481 raft_consensus.cc:385] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.424253 17481 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.424937 17481 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.423009 17290 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:19.429278 17255 leader_election.cc:343] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.433300 17737 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:09:19.444941 17481 ts_tablet_manager.cc:1434] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.113s	user 0.002s	sys 0.006s
I20260709 12:09:19.453486 17290 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:19.427968 17568 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.455060 17481 tablet_bootstrap.cc:492] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:19.455295 17482 tablet_bootstrap.cc:654] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.455029 17568 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.458031 17568 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.458237 17672 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.458734 17672 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.459112 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:19.469640 17487 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.472703 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:09:19.477520 17741 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:09:19.477996 17672 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:19.478336 17666 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:19.478966 17666 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:19.479828 17666 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.466301 17671 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:09:19.482870 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:19.485149 17333 leader_election.cc:343] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.477397 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:19.486075 17637 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.486300 17437 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:19.487844 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:19.481819 17187 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.490448 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:19.491262 17487 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.491588 17487 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.491878 17487 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.494037 17332 leader_election.cc:343] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.494757 17332 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:19.495986 17567 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.481748 17290 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:09:19.503202 17487 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.512966 17483 tablet_bootstrap.cc:492] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:19.513509 17483 ts_tablet_manager.cc:1403] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.225s	user 0.012s	sys 0.019s
I20260709 12:09:19.524645 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:19.559291 17487 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:19.563549 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:19.564388 17439 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.567832 17568 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.569100 17481 tablet_bootstrap.cc:654] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.541698 17737 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.573721 17288 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:19.595083 17568 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:19.595575 17361 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:09:19.584760 17255 leader_election.cc:343] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.600781 17482 tablet_bootstrap.cc:492] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:19.575469 17737 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.602197 17482 ts_tablet_manager.cc:1403] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.242s	user 0.021s	sys 0.029s
I20260709 12:09:19.598945 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:19.608028 17483 raft_consensus.cc:359] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.609191 17483 raft_consensus.cc:385] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.609424 17483 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.610524 17363 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:19.612569 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:19.613261 17362 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.614729 17487 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.622794 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:19.623345 17737 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:19.623710 17288 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 1: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:19.594511 17746 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 12:09:19.638806 17751 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:09:19.642074 17637 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.642599 17637 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.644685 17637 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:19.642459 17553 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:19.653503 17553 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:19.655551 17439 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:19.657065 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:19.659173 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:19.659730 17188 catalog_manager.cc:5697] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.654469 17553 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.662546 17487 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:19.663362 17258 leader_election.cc:343] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.676597 17487 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:19.677380 17487 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.678634 17482 raft_consensus.cc:359] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.679328 17482 raft_consensus.cc:385] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.679646 17482 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.680339 17482 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.692451 17483 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.695300 17290 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.698043 17482 ts_tablet_manager.cc:1434] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.000s
I20260709 12:09:19.699038 17483 ts_tablet_manager.cc:1434] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.185s	user 0.005s	sys 0.005s
I20260709 12:09:19.701890 17483 tablet_bootstrap.cc:492] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:19.705358 17482 tablet_bootstrap.cc:492] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:19.698812 17553 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.716288 17745 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.083s
I20260709 12:09:19.743762 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:19.745843 17737 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.750269 17481 tablet_bootstrap.cc:492] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:19.750811 17481 ts_tablet_manager.cc:1403] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.305s	user 0.024s	sys 0.018s
I20260709 12:09:19.751436 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:19.768365 17666 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:19.773655 17290 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:19.784394 17360 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.788455 17255 leader_election.cc:343] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.835474 17439 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.839236 17362 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:19.832033 17255 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:09:19.843691 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 57145.8us
I20260709 12:09:19.843813 17481 raft_consensus.cc:359] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.844635 17481 raft_consensus.cc:385] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.844945 17481 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.845678 17751 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.845682 17481 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.876742 17438 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:19.886008 17481 ts_tablet_manager.cc:1434] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.135s	user 0.006s	sys 0.002s
I20260709 12:09:19.887429 17481 tablet_bootstrap.cc:492] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:19.888053 17765 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:19.904394 17671 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.905092 17671 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.907524 17671 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:19.966563 17482 tablet_bootstrap.cc:654] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.969169 17483 tablet_bootstrap.cc:654] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.974866 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:19.975777 17737 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.976368 17737 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:19.974347 17745 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:19.977205 17737 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:19.981200 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:19.990031 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:19.990831 17287 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:19.990967 17760 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.992929 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:19.984613 17567 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:20.000423 17733 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:20.000880 17733 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.001238 17733 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.991530 17760 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.022174 17481 tablet_bootstrap.cc:654] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.033409 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:20.034340 17760 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:20.034955 17760 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.038466 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:20.038590 17187 catalog_manager.cc:5697] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:20.040004 17406 leader_election.cc:343] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.054206 17482 tablet_bootstrap.cc:492] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:20.054908 17482 ts_tablet_manager.cc:1403] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.350s	user 0.019s	sys 0.005s
I20260709 12:09:20.057912 17482 raft_consensus.cc:359] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.059628 17482 raft_consensus.cc:385] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.059912 17482 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.064299 17482 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.066284 17552 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:20.073976 17482 ts_tablet_manager.cc:1434] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:09:20.077042 17482 tablet_bootstrap.cc:492] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:20.086354 17291 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:20.089677 17567 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:20.097142 17189 catalog_manager.cc:5697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.110963 17483 tablet_bootstrap.cc:492] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:20.111487 17483 ts_tablet_manager.cc:1403] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.410s	user 0.047s	sys 0.072s
I20260709 12:09:20.111594 17481 tablet_bootstrap.cc:492] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:20.112185 17481 ts_tablet_manager.cc:1403] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.225s	user 0.023s	sys 0.020s
I20260709 12:09:20.116411 17483 raft_consensus.cc:359] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.117369 17483 raft_consensus.cc:385] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.117652 17483 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.119313 17483 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.121418 17483 ts_tablet_manager.cc:1434] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:09:20.122458 17483 tablet_bootstrap.cc:492] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:20.093019 17733 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.129277 17481 raft_consensus.cc:359] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.129915 17481 raft_consensus.cc:385] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.130172 17481 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.138631 17481 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.140813 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:20.141628 17481 ts_tablet_manager.cc:1434] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.006s
I20260709 12:09:20.142580 17481 tablet_bootstrap.cc:492] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:20.144070 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:20.145892 17333 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:20.150988 17733 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:20.152730 17482 tablet_bootstrap.cc:654] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.146853 17567 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:20.153710 17363 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.177134 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:20.187363 17482 tablet_bootstrap.cc:492] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:20.187988 17482 ts_tablet_manager.cc:1403] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.000s
I20260709 12:09:20.189918 17363 raft_consensus.cc:1240] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:09:20.190975 17481 tablet_bootstrap.cc:654] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.189981 17483 tablet_bootstrap.cc:654] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.199589 17637 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.208319 17482 raft_consensus.cc:359] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.209120 17482 raft_consensus.cc:385] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.209427 17482 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.201447 17637 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.211176 17751 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:20.218725 17404 leader_election.cc:343] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.219264 17404 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:20.210139 17482 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.222312 17481 tablet_bootstrap.cc:492] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:20.222821 17481 ts_tablet_manager.cc:1403] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.013s
I20260709 12:09:20.225816 17487 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.229525 17482 ts_tablet_manager.cc:1434] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:09:20.227664 17744 consensus_queue.cc:1059] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:20.231174 17482 tablet_bootstrap.cc:492] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:20.228240 17760 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.231194 17744 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:20.238479 17744 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:20.239050 17637 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:20.239404 17744 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.246807 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:20.250224 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:20.245512 17744 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:20.246755 17286 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.260730 17258 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:20.266556 17483 tablet_bootstrap.cc:492] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:20.267205 17483 ts_tablet_manager.cc:1403] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.022s
I20260709 12:09:20.286907 17483 raft_consensus.cc:359] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.287665 17483 raft_consensus.cc:385] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.289562 17483 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.290899 17483 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.302681 17483 ts_tablet_manager.cc:1434] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 12:09:20.303900 17483 tablet_bootstrap.cc:492] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:20.310614 17482 tablet_bootstrap.cc:654] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.312855 17481 raft_consensus.cc:359] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.313674 17481 raft_consensus.cc:385] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.314205 17481 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.327360 17481 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.331293 17481 ts_tablet_manager.cc:1434] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.000s
I20260709 12:09:20.332162 17744 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.332775 17744 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.334545 17751 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.335951 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:20.336077 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:20.337669 17404 leader_election.cc:343] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.338165 17406 leader_election.cc:343] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.338562 17406 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:20.339283 17753 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.339994 17481 tablet_bootstrap.cc:492] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:20.342206 17744 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:20.349934 17483 tablet_bootstrap.cc:654] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.355734 17482 tablet_bootstrap.cc:492] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:20.356191 17482 ts_tablet_manager.cc:1403] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.125s	user 0.023s	sys 0.012s
I20260709 12:09:20.360752 17481 tablet_bootstrap.cc:654] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.358862 17482 raft_consensus.cc:359] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.362968 17482 raft_consensus.cc:385] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.363237 17482 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.363865 17482 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.366180 17482 ts_tablet_manager.cc:1434] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 12:09:20.367311 17482 tablet_bootstrap.cc:492] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:20.372673 17483 tablet_bootstrap.cc:492] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:20.373208 17483 ts_tablet_manager.cc:1403] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.070s	user 0.006s	sys 0.004s
I20260709 12:09:20.377945 17483 raft_consensus.cc:359] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.378700 17483 raft_consensus.cc:385] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.378993 17483 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.379678 17483 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.381199 17482 tablet_bootstrap.cc:654] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.383486 17483 ts_tablet_manager.cc:1434] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:09:20.389422 17481 tablet_bootstrap.cc:492] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:20.389966 17481 ts_tablet_manager.cc:1403] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.000s
I20260709 12:09:20.390035 17744 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.392711 17481 raft_consensus.cc:359] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.393448 17481 raft_consensus.cc:385] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.393741 17481 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.394488 17481 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.396610 17481 ts_tablet_manager.cc:1434] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:20.397521 17481 tablet_bootstrap.cc:492] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:20.402024 17483 tablet_bootstrap.cc:492] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:20.411166 17482 tablet_bootstrap.cc:492] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:20.411751 17482 ts_tablet_manager.cc:1403] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.015s
I20260709 12:09:20.413476 17483 tablet_bootstrap.cc:654] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.414204 17482 raft_consensus.cc:359] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.414909 17482 raft_consensus.cc:385] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.415180 17482 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.415848 17482 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.426038 17483 tablet_bootstrap.cc:492] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:20.426574 17483 ts_tablet_manager.cc:1403] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.010s
I20260709 12:09:20.428514 17481 tablet_bootstrap.cc:654] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.428534 17482 ts_tablet_manager.cc:1434] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:09:20.429837 17482 tablet_bootstrap.cc:492] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:20.434353 17553 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.436365 17482 tablet_bootstrap.cc:654] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.439621 17483 raft_consensus.cc:359] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.440372 17483 raft_consensus.cc:385] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.440634 17483 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.441228 17483 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.451594 17483 ts_tablet_manager.cc:1434] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.001s
I20260709 12:09:20.452601 17483 tablet_bootstrap.cc:492] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
W20260709 12:09:20.456995 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:20.466931 17483 tablet_bootstrap.cc:654] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.473883 17483 tablet_bootstrap.cc:492] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:20.474606 17483 ts_tablet_manager.cc:1403] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.005s
I20260709 12:09:20.477734 17483 raft_consensus.cc:359] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.478591 17483 raft_consensus.cc:385] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.478885 17483 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.479612 17483 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.480696 17744 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.481315 17744 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.482371 17483 ts_tablet_manager.cc:1434] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:09:20.483767 17483 tablet_bootstrap.cc:492] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:20.489756 17487 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.490334 17487 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.490775 17483 tablet_bootstrap.cc:654] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.492484 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:20.494625 17406 leader_election.cc:343] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.497334 17487 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:20.499471 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:09:20.501279 17255 leader_election.cc:343] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.503347 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:20.504997 17258 leader_election.cc:343] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.505545 17258 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:20.507577 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:20.510856 17366 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:20.509263 17481 tablet_bootstrap.cc:492] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:20.511958 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:20.512867 17753 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.513257 17753 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.513785 17753 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.514846 17751 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.515851 17744 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:20.516636 17482 tablet_bootstrap.cc:492] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:20.511976 17481 ts_tablet_manager.cc:1403] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.115s	user 0.007s	sys 0.009s
I20260709 12:09:20.517259 17482 ts_tablet_manager.cc:1403] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.088s	user 0.040s	sys 0.028s
I20260709 12:09:20.520040 17481 raft_consensus.cc:359] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.520951 17481 raft_consensus.cc:385] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.520591 17482 raft_consensus.cc:359] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.521322 17481 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.521615 17482 raft_consensus.cc:385] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.521955 17482 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.522370 17481 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.522810 17482 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.525130 17482 ts_tablet_manager.cc:1434] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:20.526650 17482 tablet_bootstrap.cc:492] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:20.525343 17481 ts_tablet_manager.cc:1434] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:20.530629 17481 tablet_bootstrap.cc:492] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:20.547847 17753 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.552115 17483 tablet_bootstrap.cc:492] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:20.552671 17483 ts_tablet_manager.cc:1403] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.040s
I20260709 12:09:20.553395 17481 tablet_bootstrap.cc:654] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.553445 17482 tablet_bootstrap.cc:654] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.555855 17483 raft_consensus.cc:359] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.556596 17483 raft_consensus.cc:385] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.556872 17483 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.557235 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:20.557950 17753 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:20.558564 17406 leader_election.cc:343] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.557691 17483 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.559068 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:20.559655 17366 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.560313 17483 ts_tablet_manager.cc:1434] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:20.561501 17483 tablet_bootstrap.cc:492] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:20.565177 17765 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.568544 17483 tablet_bootstrap.cc:654] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.576586 17366 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:20.565728 17765 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.584138 17765 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:20.586447 17483 tablet_bootstrap.cc:492] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:20.586977 17483 ts_tablet_manager.cc:1403] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.010s
I20260709 12:09:20.588337 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:20.588563 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:20.589219 17289 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:20.589666 17483 raft_consensus.cc:359] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.590560 17483 raft_consensus.cc:385] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.590848 17483 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.591447 17483 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.593271 17483 ts_tablet_manager.cc:1434] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 12:09:20.590055 17333 leader_election.cc:343] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.595073 17483 tablet_bootstrap.cc:492] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:20.595685 17332 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:20.596984 17733 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.597374 17733 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.597713 17733 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.602550 17483 tablet_bootstrap.cc:654] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.605165 17733 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.619091 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:20.621942 17744 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.622524 17744 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:20.623383 17744 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.627321 17733 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:20.629522 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:20.630314 17286 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.633319 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:09:20.635227 17333 leader_election.cc:343] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.638304 17286 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:20.639864 17332 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:20.641701 17567 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.642354 17567 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:20.643519 17567 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.653890 17482 tablet_bootstrap.cc:492] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:20.654552 17482 ts_tablet_manager.cc:1403] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.128s	user 0.028s	sys 0.035s
I20260709 12:09:20.656420 17188 catalog_manager.cc:5697] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.657299 17482 raft_consensus.cc:359] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.658041 17487 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.658254 17482 raft_consensus.cc:385] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.657780 17189 catalog_manager.cc:5697] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.658710 17482 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.658550 17487 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.659636 17482 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.661203 17487 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:20.662407 17482 ts_tablet_manager.cc:1434] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:20.663492 17482 tablet_bootstrap.cc:492] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:20.663959 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:20.665469 17258 leader_election.cc:343] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.666312 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:20.667963 17744 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.668582 17744 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.670205 17733 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.670792 17733 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.672976 17733 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:20.673741 17255 leader_election.cc:343] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.674244 17255 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:20.674762 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:20.675355 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:20.675379 17637 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.675673 17286 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:20.676041 17637 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.677906 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:20.678397 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:20.678627 17286 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:20.680015 17751 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.680025 17553 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.681452 17553 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.681793 17553 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.682298 17482 tablet_bootstrap.cc:654] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.686851 17753 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.687373 17753 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.687803 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:20.688632 17733 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.689040 17733 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.689378 17733 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.689452 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:20.678010 17637 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:20.691289 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:09:20.691671 17258 leader_election.cc:343] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.691895 17363 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:20.692755 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:20.693074 17404 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:20.693784 17568 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.694161 17568 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.694540 17568 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.698053 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:09:20.698419 17406 leader_election.cc:343] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.699412 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:20.702280 17753 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:09:20.700732 17255 leader_election.cc:343] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.670738 17744 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:20.705272 17255 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:20.707960 17481 tablet_bootstrap.cc:492] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:20.708889 17481 ts_tablet_manager.cc:1403] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.004s
I20260709 12:09:20.711666 17481 raft_consensus.cc:359] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.712349 17481 raft_consensus.cc:385] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.712639 17481 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.707821 17568 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.714409 17487 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.715344 17568 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:20.715926 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:20.716171 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:20.716796 17363 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.717586 17568 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:20.717669 17406 leader_election.cc:343] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.718251 17553 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.718377 17568 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.719470 17441 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:20.721956 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:20.722625 17367 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:20.700033 17733 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.730026 17366 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 1: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:20.723475 17553 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:20.724038 17481 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.725364 17404 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:20.734051 17760 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.725364 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:20.727787 17568 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:20.734474 17760 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.734843 17760 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.734956 17367 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 1: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:20.735066 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:20.735980 17286 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:20.738312 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:20.738999 17286 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.741147 17481 ts_tablet_manager.cc:1434] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 12:09:20.742336 17481 tablet_bootstrap.cc:492] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:20.742376 17760 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.744724 17760 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:20.746942 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:20.747534 17363 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:20.747618 17366 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.756933 17366 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:20.757532 17733 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:20.758255 17404 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:20.767750 17286 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:20.753806 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:20.765920 17481 tablet_bootstrap.cc:654] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.769563 17441 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:20.770704 17760 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.771270 17760 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:20.772159 17760 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.779238 17404 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:20.780650 17553 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.781181 17553 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:20.782070 17553 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.795522 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:20.796454 17286 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:20.804565 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:20.805591 17568 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.806136 17568 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:20.807013 17568 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.811774 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:20.813082 17483 tablet_bootstrap.cc:492] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:20.813591 17483 ts_tablet_manager.cc:1403] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.219s	user 0.089s	sys 0.060s
I20260709 12:09:20.813522 17764 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.815728 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:20.816466 17286 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.834528 17482 tablet_bootstrap.cc:492] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:20.835549 17482 ts_tablet_manager.cc:1403] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.172s	user 0.016s	sys 0.028s
I20260709 12:09:20.836170 17483 raft_consensus.cc:359] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.836944 17483 raft_consensus.cc:385] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.837225 17483 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.838971 17487 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.837924 17483 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.858315 17286 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:20.859690 17482 raft_consensus.cc:359] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.872094 17482 raft_consensus.cc:385] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.872440 17482 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.873109 17482 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.873696 17483 ts_tablet_manager.cc:1434] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.060s	user 0.023s	sys 0.003s
I20260709 12:09:20.875015 17483 tablet_bootstrap.cc:492] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:20.862507 17481 tablet_bootstrap.cc:492] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:20.875936 17481 ts_tablet_manager.cc:1403] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.134s	user 0.019s	sys 0.004s
I20260709 12:09:20.879582 17482 ts_tablet_manager.cc:1434] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:09:20.880640 17482 tablet_bootstrap.cc:492] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:20.881317 17483 tablet_bootstrap.cc:654] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.874186 17487 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.884142 17487 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:20.886880 17481 raft_consensus.cc:359] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.887669 17481 raft_consensus.cc:385] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.887941 17481 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.888037 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:20.889357 17258 leader_election.cc:343] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.888674 17481 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.891813 17481 ts_tablet_manager.cc:1434] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:20.892725 17481 tablet_bootstrap.cc:492] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:20.892903 17482 tablet_bootstrap.cc:654] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.900420 17481 tablet_bootstrap.cc:654] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.934201 17744 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.935541 17744 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.942536 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:20.943394 17286 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 1: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:20.946434 17744 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:20.947314 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:20.948800 17404 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:20.949811 17188 catalog_manager.cc:5697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.955647 17760 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.951262 17188 catalog_manager.cc:5697] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:20.962919 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 92607.3us
I20260709 12:09:20.966372 17760 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.967481 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:20.971063 17366 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:20.973162 17482 tablet_bootstrap.cc:492] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:20.972422 17188 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.973814 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:20.977510 17808 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.977933 17808 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.978288 17808 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.978430 17482 ts_tablet_manager.cc:1403] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.098s	user 0.032s	sys 0.033s
I20260709 12:09:20.979521 17483 tablet_bootstrap.cc:492] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:20.979981 17483 ts_tablet_manager.cc:1403] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.025s
I20260709 12:09:20.981295 17482 raft_consensus.cc:359] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.981989 17482 raft_consensus.cc:385] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.982297 17482 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.983542 17482 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.984676 17481 tablet_bootstrap.cc:492] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:20.985109 17481 ts_tablet_manager.cc:1403] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.093s	user 0.021s	sys 0.030s
I20260709 12:09:20.985777 17482 ts_tablet_manager.cc:1434] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:09:20.986675 17482 tablet_bootstrap.cc:492] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:20.982877 17483 raft_consensus.cc:359] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.988389 17483 raft_consensus.cc:385] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.988683 17483 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.989315 17483 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.991561 17483 ts_tablet_manager.cc:1434] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:20.992461 17483 tablet_bootstrap.cc:492] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:20.993299 17482 tablet_bootstrap.cc:654] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.987568 17481 raft_consensus.cc:359] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:20.998541 17481 raft_consensus.cc:385] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.998883 17481 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.999703 17481 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.001973 17481 ts_tablet_manager.cc:1434] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:09:21.003224 17764 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.003731 17764 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.004410 17808 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.005620 17481 tablet_bootstrap.cc:492] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:21.005961 17764 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.008315 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:21.009009 17286 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:21.011159 17483 tablet_bootstrap.cc:654] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.011096 17332 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:21.012154 17764 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.010674 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:21.012506 17764 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.012849 17764 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.015071 17481 tablet_bootstrap.cc:654] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.017663 17441 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:21.022629 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:21.023712 17366 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.026783 17482 tablet_bootstrap.cc:492] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:21.027354 17482 ts_tablet_manager.cc:1403] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.004s
I20260709 12:09:21.030545 17482 raft_consensus.cc:359] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.031271 17482 raft_consensus.cc:385] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.031544 17482 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.032193 17482 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.027842 17808 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.040455 17482 ts_tablet_manager.cc:1434] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:09:21.041608 17366 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:21.043140 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:21.043813 17808 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.044216 17483 tablet_bootstrap.cc:492] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:21.044328 17808 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:21.038466 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:21.044716 17483 ts_tablet_manager.cc:1403] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.020s
I20260709 12:09:21.045276 17808 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.048009 17483 raft_consensus.cc:359] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.048727 17483 raft_consensus.cc:385] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.049147 17483 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.049836 17553 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.049842 17483 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:21.050441 17258 leader_election.cc:343] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.052695 17481 tablet_bootstrap.cc:492] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:21.053227 17481 ts_tablet_manager.cc:1403] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.002s
I20260709 12:09:21.056020 17483 ts_tablet_manager.cc:1434] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:21.055799 17481 raft_consensus.cc:359] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.056507 17481 raft_consensus.cc:385] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.056783 17481 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.057147 17483 tablet_bootstrap.cc:492] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:21.057451 17481 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.061383 17481 ts_tablet_manager.cc:1434] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:21.061563 17567 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.062077 17567 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.063521 17483 tablet_bootstrap.cc:654] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.064004 17567 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.064471 17567 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.066309 17481 tablet_bootstrap.cc:492] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:21.068194 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:21.070251 17808 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:21.070472 17332 leader_election.cc:343] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.070797 17808 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.071610 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:21.075352 17482 tablet_bootstrap.cc:492] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:21.037674 17764 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.082211 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:21.082839 17363 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:21.083877 17764 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.073137 17808 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.091411 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:21.093861 17441 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:21.094033 17187 catalog_manager.cc:5697] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.095324 17482 tablet_bootstrap.cc:654] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.088579 17333 leader_election.cc:343] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.097838 17333 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:21.102562 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:21.103343 17290 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.105062 17733 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.105741 17733 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.106389 17255 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:21.109809 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:21.110631 17438 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.110832 17487 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.111249 17487 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.111558 17487 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.117627 17487 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.120635 17487 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.125694 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:21.126430 17439 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.133627 17483 tablet_bootstrap.cc:492] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:21.134193 17483 ts_tablet_manager.cc:1403] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.026s
I20260709 12:09:21.139170 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:21.139794 17363 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.141531 17290 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:21.144326 17438 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:21.146760 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:21.148448 17765 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.146731 17439 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:21.148970 17765 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:21.150949 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:21.151022 17765 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.151887 17751 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.151096 17481 tablet_bootstrap.cc:654] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.152822 17751 raft_consensus.cc:697] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:21.153805 17751 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.163065 17483 raft_consensus.cc:359] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.163780 17483 raft_consensus.cc:385] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.164075 17483 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.164752 17483 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.179453 17483 ts_tablet_manager.cc:1434] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:09:21.180706 17363 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:21.189288 17483 tablet_bootstrap.cc:492] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:21.246189 17553 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.246966 17553 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.250305 17487 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.250881 17487 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.260164 17487 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.260864 17553 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:21.268724 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:21.311129 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:21.269532 17288 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:21.265457 17291 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.365278 17744 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.365846 17744 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.366360 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:21.368048 17744 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:21.392172 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:21.393044 17363 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 1: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:09:21.399753 17568 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.400617 17568 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.410841 17285 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.413096 17483 tablet_bootstrap.cc:654] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.415061 17481 tablet_bootstrap.cc:492] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:21.415637 17481 ts_tablet_manager.cc:1403] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.350s	user 0.020s	sys 0.022s
I20260709 12:09:21.427513 17406 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:21.428238 17553 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.428683 17553 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.429368 17553 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.418911 17568 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:21.438828 17482 tablet_bootstrap.cc:492] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:21.439673 17482 ts_tablet_manager.cc:1403] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.365s	user 0.048s	sys 0.043s
W20260709 12:09:21.441011 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 101116us
I20260709 12:09:21.434337 17187 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:21.443020 17404 leader_election.cc:343] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.450450 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:21.451244 17363 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 1: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:09:21.451576 17745 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.444196 17255 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:21.455814 17482 raft_consensus.cc:359] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.456573 17482 raft_consensus.cc:385] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.456859 17482 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.456784 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:21.457419 17367 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:09:21.458948 17481 raft_consensus.cc:359] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.459699 17481 raft_consensus.cc:385] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.459970 17481 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.460695 17481 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.457625 17482 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.464275 17482 ts_tablet_manager.cc:1434] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:09:21.465340 17482 tablet_bootstrap.cc:492] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:21.475471 17481 ts_tablet_manager.cc:1434] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 12:09:21.477350 17553 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.510061 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:21.529203 17404 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:21.487493 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:21.531311 17483 tablet_bootstrap.cc:492] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:21.569190 17637 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:21.556690 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.555737 17831 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:21.589795 17637 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.590591 17831 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.591001 17831 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:21.584326 17553 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:21.589756 17483 ts_tablet_manager.cc:1403] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.409s	user 0.024s	sys 0.021s
I20260709 12:09:21.598891 17637 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.604800 17483 raft_consensus.cc:359] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.605578 17483 raft_consensus.cc:385] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.605866 17483 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.606588 17483 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.608922 17483 ts_tablet_manager.cc:1434] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:09:21.612149 17481 tablet_bootstrap.cc:492] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:21.610143 17483 tablet_bootstrap.cc:492] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:21.622975 17482 tablet_bootstrap.cc:654] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.624333 17487 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:21.634955 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 104697us
I20260709 12:09:21.645190 17189 catalog_manager.cc:5697] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.647862 17568 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.628624 17637 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:21.658933 17829 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:09:21.662658 17831 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.647295 17808 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:09:21.664848 17831 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:21.669361 17567 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.641842 17836 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:21.671939 17836 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.684942 17836 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.685523 17483 tablet_bootstrap.cc:654] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.672789 17637 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.694517 17553 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.687619 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:21.703329 17568 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.683912 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:21.704034 17744 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:21.711838 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:21.712540 17288 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:21.713449 17637 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:21.708262 17291 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.715373 17406 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:21.716236 17833 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.718532 17765 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.719062 17765 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.720117 17834 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.742136 17765 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:21.746162 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 94744.4us
I20260709 12:09:21.746593 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:21.770360 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:21.771114 17283 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:21.786273 17332 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:21.765074 17760 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.798749 17840 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.798959 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:21.800047 17438 raft_consensus.cc:2368] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3.
I20260709 12:09:21.799096 17760 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:21.835635 17760 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:21.837776 17482 tablet_bootstrap.cc:492] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:21.838388 17482 ts_tablet_manager.cc:1403] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.373s	user 0.052s	sys 0.051s
I20260709 12:09:21.798799 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:21.799187 17840 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:21.839648 17404 leader_election.cc:343] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.848486 17481 tablet_bootstrap.cc:654] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.845770 17840 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.887146 17483 tablet_bootstrap.cc:492] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:21.888528 17483 ts_tablet_manager.cc:1403] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.279s	user 0.034s	sys 0.002s
I20260709 12:09:21.899777 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:21.903410 17255 leader_election.cc:343] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.903762 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:21.904448 17286 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:21.887135 17833 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.886584 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:21.979378 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:21.980257 17365 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 2: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:21.966267 17361 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:22.009105 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:09:22.092413 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 60989.9us
I20260709 12:09:22.093449 17838 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.065s
W20260709 12:09:22.092381 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 60819.8us
I20260709 12:09:22.100351 17568 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.100732 17568 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.101079 17568 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.180728 17483 raft_consensus.cc:359] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.181478 17483 raft_consensus.cc:385] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.181744 17483 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.185869 17483 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.189867 17481 tablet_bootstrap.cc:492] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:22.190747 17481 ts_tablet_manager.cc:1403] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.579s	user 0.030s	sys 0.034s
I20260709 12:09:22.191424 17568 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.196043 17568 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:22.196969 17483 ts_tablet_manager.cc:1434] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.307s	user 0.005s	sys 0.001s
I20260709 12:09:22.197913 17483 tablet_bootstrap.cc:492] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:22.170640 17291 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
W20260709 12:09:22.184684 17333 leader_election.cc:343] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.186978 17288 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:09:22.235457 17851 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:09:22.236266 17482 raft_consensus.cc:359] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.259477 17482 raft_consensus.cc:385] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.259812 17482 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.260437 17482 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:22.258826 17850 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:09:22.254216 17840 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:22.270015 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 173622us
I20260709 12:09:22.272673 17406 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:22.286393 17830 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:09:22.288969 17847 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:09:22.301033 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:22.271517 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 178292us
I20260709 12:09:22.318523 17834 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.319167 17834 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:22.326718 17481 raft_consensus.cc:359] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.328926 17481 raft_consensus.cc:385] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.329254 17481 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.331555 17481 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.343792 17487 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.344511 17487 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.370810 17258 leader_election.cc:400] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3.
I20260709 12:09:22.371243 17258 leader_election.cc:403] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:09:22.373054 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 100469us
I20260709 12:09:22.373276 17481 ts_tablet_manager.cc:1434] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.182s	user 0.006s	sys 0.002s
I20260709 12:09:22.374825 17481 tablet_bootstrap.cc:492] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
W20260709 12:09:22.376950 17258 leader_election.cc:343] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.377472 17487 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:22.377427 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:22.378312 17487 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.380942 17482 ts_tablet_manager.cc:1434] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.542s	user 0.004s	sys 0.015s
W20260709 12:09:22.381253 17482 ts_tablet_manager.cc:1467] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Tablet startup took 542ms
I20260709 12:09:22.375777 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:22.385860 17855 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 12:09:22.320042 17834 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:22.383925 17482 ts_tablet_manager.cc:1469] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Trace:
0709 12:09:13.981693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:14.629027 (+647334us) service_pool.cc:224] Handling call
0709 12:09:14.639394 (+ 10367us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:14.639496 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:14.917900 (+278404us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:14.995267 (+ 77367us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:14.995742 (+   475us) inbound_call.cc:177] Queueing success response
0709 12:09:21.465020 (+6469278us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:09:21.838688 (+373668us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:09:22.182321 (+343633us) tablet_replica.cc:261] Starting instrumentation
0709 12:09:22.182808 (+   487us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":48730,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":3768,"tablet-open.queue_time_us":6469369}
I20260709 12:09:22.388597 17288 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.391290 17482 tablet_bootstrap.cc:492] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:22.389532 17406 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:22.386432 17840 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:22.418421 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:22.419148 17363 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:22.418421 17483 tablet_bootstrap.cc:654] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.418483 17861 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3.
I20260709 12:09:22.433564 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:22.435254 17487 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.443017 17857 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:22.443670 17857 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:22.444218 17255 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:22.444968 17482 tablet_bootstrap.cc:654] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.444550 17857 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.449060 17861 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.449528 17861 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.434892 17434 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:22.449887 17861 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.454541 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:22.457796 17864 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.458258 17360 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:22.458729 17481 tablet_bootstrap.cc:654] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.468321 17860 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.468549 17288 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:22.468920 17860 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.470839 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:22.478358 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:22.471103 17864 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.479911 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:09:22.482383 17854 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.284s	user 0.000s	sys 0.006s
I20260709 12:09:22.485910 17859 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:22.473290 17834 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.484056 17360 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:09:22.499302 17834 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:22.537549 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:22.549646 17864 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:22.559016 17483 tablet_bootstrap.cc:492] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:22.559644 17483 ts_tablet_manager.cc:1403] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.362s	user 0.028s	sys 0.006s
I20260709 12:09:22.563328 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:22.565116 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:22.565812 17292 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.554181 17860 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:22.549979 17834 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.587713 17764 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:22.589810 17867 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:09:22.598698 17855 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:22.599231 17855 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.601476 17568 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.601171 17483 raft_consensus.cc:359] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.602178 17483 raft_consensus.cc:385] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.602454 17483 raft_consensus.cc:740] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.603071 17483 consensus_queue.cc:260] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.608505 17481 tablet_bootstrap.cc:492] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:22.608938 17481 ts_tablet_manager.cc:1403] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.234s	user 0.009s	sys 0.007s
I20260709 12:09:22.609845 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:22.613751 17483 ts_tablet_manager.cc:1434] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.002s
I20260709 12:09:22.626431 17483 tablet_bootstrap.cc:492] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:22.600950 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:09:22.634855 17848 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.376s	user 0.011s	sys 0.001s
I20260709 12:09:22.597091 17764 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.638471 17482 tablet_bootstrap.cc:492] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:22.639038 17482 ts_tablet_manager.cc:1403] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.248s	user 0.027s	sys 0.018s
I20260709 12:09:22.640116 17360 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.642518 17481 raft_consensus.cc:359] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.643226 17764 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:22.643249 17481 raft_consensus.cc:385] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.650996 17292 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:22.646130 17481 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.646386 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:22.653045 17764 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:22.653060 17481 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.637149 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:22.654238 17861 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:22.658493 17871 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:09:22.658901 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:22.653635 17764 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.661517 17481 ts_tablet_manager.cc:1434] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:09:22.662568 17481 tablet_bootstrap.cc:492] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:22.663800 17861 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:22.664410 17873 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:09:22.658948 17360 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
W20260709 12:09:22.669117 17333 leader_election.cc:343] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.669045 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:22.673300 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:22.672812 17764 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:22.679533 17836 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.680068 17836 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.682704 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:22.683629 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:22.669152 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:09:22.684521 17404 leader_election.cc:343] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.684644 17836 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:22.691622 17404 leader_election.cc:343] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.696590 17406 leader_election.cc:343] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.696978 17406 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:09:22.701130 17406 leader_election.cc:343] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.701864 17406 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:22.703001 17553 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.695382 17360 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.710721 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:22.711381 17439 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.714787 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:22.700906 17857 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.719374 17855 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:22.719880 17332 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:22.721295 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:22.719875 17187 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55932 (request call id 94) took 1463 ms. Trace:
I20260709 12:09:22.727906 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:22.735906 17483 tablet_bootstrap.cc:654] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.742820 17481 tablet_bootstrap.cc:654] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.750535 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 47365.1us
W20260709 12:09:22.756546 17258 leader_election.cc:343] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.743722 17840 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.744135 17764 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:22.751832 17838 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:22.767496 17189 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55928 (request call id 103) took 1199 ms. Trace:
I20260709 12:09:22.770835 17482 raft_consensus.cc:359] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.771574 17482 raft_consensus.cc:385] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.771853 17482 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.772511 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:22.773746 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:22.765702 17255 leader_election.cc:343] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.765918 17840 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:22.778589 17482 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.780931 17482 ts_tablet_manager.cc:1434] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.141s	user 0.004s	sys 0.002s
I20260709 12:09:22.781860 17482 tablet_bootstrap.cc:492] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:22.781786 17840 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.776410 17255 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:22.793533 17360 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:22.730613 17187 rpcz_store.cc:276] 0709 12:09:21.266068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:21.266216 (+   148us) service_pool.cc:224] Handling call
0709 12:09:22.719816 (+1453600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:21.462947 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:21.647656 (+184709us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b5400076128. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122bed79e1 00007f122bed664c 00007f1229565d5d 00007f12295510a6 00007f1229550d58 00007f12295559f1 00007f12295559a9 00007f1229555939 00007f1229555901 00007f1229554b2d 0000000000388634
0709 12:09:21.652018 (+  4362us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:21.655019 (+  3001us) write_op.cc:435] Acquired schema lock
0709 12:09:21.655039 (+    20us) tablet.cc:662] Decoding operations
0709 12:09:21.673664 (+ 18625us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:21.673720 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:21.673745 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:21.673925 (+   180us) tablet.cc:701] Row locks acquired
0709 12:09:21.673941 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:09:21.674181 (+   240us) write_op.cc:270] Start()
0709 12:09:21.674390 (+   209us) write_op.cc:276] Timestamp: P: 1783598961674038 usec, L: 0
0709 12:09:21.674415 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:09:21.675949 (+  1534us) log.cc:844] Serialized 540 byte log entry
0709 12:09:21.774417 (+ 98468us) op_driver.cc:464] REPLICATION: finished
0709 12:09:22.031891 (+257474us) write_op.cc:301] APPLY: starting
0709 12:09:22.095118 (+ 63227us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:22.171089 (+ 75971us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:22.172643 (+  1554us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:22.178439 (+  5796us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:22.178596 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:22.178639 (+    43us) write_op.cc:312] APPLY: finished
0709 12:09:22.178848 (+   209us) log.cc:844] Serialized 22 byte log entry
0709 12:09:22.179015 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:22.179088 (+    73us) write_op.cc:454] Released schema lock
0709 12:09:22.179122 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:22.179419 (+   297us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:22.179445 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":478581,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":228213,"apply.run_cpu_time_us":1721,"apply.run_wall_time_us":168486,"mutex_wait_us":7505,"num_ops":1,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":6303,"prepare.run_wall_time_us":219312,"replication_time_us":89849,"spinlock_wait_cycles":15585152,"thread_start_us":109299,"threads_started":1}]]}
I20260709 12:09:22.797168 17836 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.804926 17439 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:22.828095 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:09:22.830962 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.832245 17483 tablet_bootstrap.cc:492] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:22.832811 17483 ts_tablet_manager.cc:1403] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.207s	user 0.017s	sys 0.002s
I20260709 12:09:22.827423 17255 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:22.837937 17855 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:22.841035 17482 tablet_bootstrap.cc:654] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.833009 17861 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.843129 17861 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:22.847463 17861 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:22.855506 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 56026.6us
I20260709 12:09:22.873154 17360 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.886197 17483 raft_consensus.cc:359] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.887039 17483 raft_consensus.cc:385] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.887351 17483 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.889704 17483 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:22.894644 17483 ts_tablet_manager.cc:1434] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 12:09:22.896669 17483 tablet_bootstrap.cc:492] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:22.767915 17189 rpcz_store.cc:276] 0709 12:09:21.568345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:21.568546 (+   201us) service_pool.cc:224] Handling call
0709 12:09:22.767433 (+1198887us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:21.703089 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:21.763618 (+ 60529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:21.764749 (+  1131us) write_op.cc:435] Acquired schema lock
0709 12:09:21.766250 (+  1501us) tablet.cc:662] Decoding operations
0709 12:09:21.768186 (+  1936us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:21.768234 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:21.768260 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:21.768446 (+   186us) tablet.cc:701] Row locks acquired
0709 12:09:21.768459 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:09:21.768608 (+   149us) write_op.cc:270] Start()
0709 12:09:21.768722 (+   114us) write_op.cc:276] Timestamp: P: 1783598961768548 usec, L: 0
0709 12:09:21.768740 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:09:21.897348 (+128608us) log.cc:844] Serialized 540 byte log entry
0709 12:09:21.901481 (+  4133us) op_driver.cc:464] REPLICATION: finished
0709 12:09:22.200534 (+299053us) write_op.cc:301] APPLY: starting
0709 12:09:22.205892 (+  5358us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:22.233542 (+ 27650us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:22.270596 (+ 37054us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:22.290773 (+ 20177us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:22.290942 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:22.290990 (+    48us) write_op.cc:312] APPLY: finished
0709 12:09:22.375924 (+ 84934us) log.cc:844] Serialized 22 byte log entry
0709 12:09:22.382639 (+  6715us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:22.384529 (+  1890us) write_op.cc:454] Released schema lock
0709 12:09:22.386636 (+  2107us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:22.505129 (+118493us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54000762d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b16e28 00007f1229551581 00007f1229550d58 00007f12295559f1 00007f12295559a9 00007f1229555939 00007f1229555901 00007f1229554b2d 0000000000388634 0000000000388479
0709 12:09:22.509034 (+  3905us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:22.509385 (+   351us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":272623,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":285501,"apply.run_cpu_time_us":3078,"apply.run_wall_time_us":194172,"num_ops":1,"prepare.queue_time_us":38578,"prepare.run_cpu_time_us":13399,"prepare.run_wall_time_us":814323,"replication_time_us":132608,"spinlock_wait_cycles":269582720,"thread_start_us":81986,"threads_started":1}]]}
I20260709 12:09:23.008577 17361 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:23.016270 17482 tablet_bootstrap.cc:492] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:23.017210 17482 ts_tablet_manager.cc:1403] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.236s	user 0.016s	sys 0.003s
I20260709 12:09:23.027118 17285 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:23.035239 17483 tablet_bootstrap.cc:654] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.037775 17835 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.038048 17834 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:23.039151 17889 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:09:23.036805 17187 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.053158 17637 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.053825 17637 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.056538 17637 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.058346 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:23.059585 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:23.060815 17862 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:23.061259 17255 leader_election.cc:343] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.063238 17258 leader_election.cc:343] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.063815 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:23.064790 17861 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.074530 17481 tablet_bootstrap.cc:492] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:23.075263 17481 ts_tablet_manager.cc:1403] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.413s	user 0.026s	sys 0.021s
I20260709 12:09:23.076879 17567 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.077446 17567 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.080006 17567 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.083071 17482 raft_consensus.cc:359] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.083895 17482 raft_consensus.cc:385] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.084241 17482 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.085112 17482 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.087208 17481 raft_consensus.cc:359] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.088646 17744 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.089116 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:23.090837 17481 raft_consensus.cc:385] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.091442 17481 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.091202 17835 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.092305 17481 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.093271 17835 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.097898 17481 ts_tablet_manager.cc:1434] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.006s
I20260709 12:09:23.115239 17483 tablet_bootstrap.cc:492] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:23.122728 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:23.128014 17483 ts_tablet_manager.cc:1403] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.232s	user 0.028s	sys 0.001s
I20260709 12:09:23.106369 17482 ts_tablet_manager.cc:1434] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.089s	user 0.000s	sys 0.008s
I20260709 12:09:23.108798 17187 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.132489 17481 tablet_bootstrap.cc:492] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:23.134227 17482 tablet_bootstrap.cc:492] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:23.137234 17483 raft_consensus.cc:359] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.137884 17483 raft_consensus.cc:385] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.138159 17483 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.138954 17483 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.144377 17835 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:23.148624 17483 ts_tablet_manager.cc:1434] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:09:23.151672 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:23.152901 17567 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:23.154277 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:23.154136 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:23.156121 17404 leader_election.cc:343] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.157353 17406 leader_election.cc:343] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.153306 17187 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.157833 17406 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:23.159816 17862 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.162187 17481 tablet_bootstrap.cc:654] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.162045 17483 tablet_bootstrap.cc:492] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:23.164916 17482 tablet_bootstrap.cc:654] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.195209 17483 tablet_bootstrap.cc:654] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.199333 17481 tablet_bootstrap.cc:492] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:23.199972 17481 ts_tablet_manager.cc:1403] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.007s
I20260709 12:09:23.206339 17481 raft_consensus.cc:359] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.207273 17481 raft_consensus.cc:385] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.207700 17481 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.208555 17481 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.210057 17862 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.212724 17482 tablet_bootstrap.cc:492] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:23.213194 17482 ts_tablet_manager.cc:1403] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.003s
I20260709 12:09:23.214570 17835 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.215627 17481 ts_tablet_manager.cc:1434] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:23.216310 17482 raft_consensus.cc:359] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.216843 17482 raft_consensus.cc:385] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.217008 17482 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.217722 17482 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.219400 17482 ts_tablet_manager.cc:1434] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:09:23.220404 17482 tablet_bootstrap.cc:492] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:23.221892 17483 tablet_bootstrap.cc:492] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:23.223603 17483 ts_tablet_manager.cc:1403] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.004s
I20260709 12:09:23.229226 17481 tablet_bootstrap.cc:492] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:23.235891 17482 tablet_bootstrap.cc:654] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.230996 17483 raft_consensus.cc:359] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.243796 17483 raft_consensus.cc:385] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.244802 17483 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.245576 17483 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.248647 17483 ts_tablet_manager.cc:1434] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:09:23.250046 17482 tablet_bootstrap.cc:492] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:23.250710 17482 ts_tablet_manager.cc:1403] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.002s
I20260709 12:09:23.252348 17481 tablet_bootstrap.cc:654] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.253796 17482 raft_consensus.cc:359] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.254948 17482 raft_consensus.cc:385] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.255334 17482 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.255744 17483 tablet_bootstrap.cc:492] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:23.256126 17482 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.258348 17482 ts_tablet_manager.cc:1434] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:09:23.258488 17432 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.259919 17482 tablet_bootstrap.cc:492] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:23.263450 17483 tablet_bootstrap.cc:654] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.265381 17765 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.266480 17765 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.274982 17189 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.277086 17567 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.278980 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:09:23.285694 17332 leader_election.cc:343] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.287719 17859 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:23.309702 17481 tablet_bootstrap.cc:492] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:23.310417 17481 ts_tablet_manager.cc:1403] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.009s
I20260709 12:09:23.313323 17765 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.314383 17482 tablet_bootstrap.cc:654] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.319038 17481 raft_consensus.cc:359] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.319836 17481 raft_consensus.cc:385] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.320111 17481 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.315701 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:23.322728 17481 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.334260 17438 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:23.339449 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:23.338395 17483 tablet_bootstrap.cc:492] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:23.341893 17483 ts_tablet_manager.cc:1403] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.086s	user 0.021s	sys 0.001s
I20260709 12:09:23.354200 17481 ts_tablet_manager.cc:1434] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.001s
I20260709 12:09:23.355453 17481 tablet_bootstrap.cc:492] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:23.345868 17765 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.364202 17483 raft_consensus.cc:359] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.359274 17765 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.364835 17483 raft_consensus.cc:385] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.365163 17483 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.368963 17483 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.365058 17765 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.373505 17483 ts_tablet_manager.cc:1434] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:09:23.375249 17188 catalog_manager.cc:5697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.382773 17483 tablet_bootstrap.cc:492] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:23.388070 17834 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.390990 17834 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.388511 17859 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:23.395869 17482 tablet_bootstrap.cc:492] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:23.396358 17482 ts_tablet_manager.cc:1403] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.013s
I20260709 12:09:23.399488 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:23.400285 17283 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:23.401145 17765 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.402626 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:23.403523 17860 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.403909 17860 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.404237 17860 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.404403 17481 tablet_bootstrap.cc:654] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.408525 17840 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.412722 17482 raft_consensus.cc:359] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.413462 17482 raft_consensus.cc:385] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.413744 17482 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.414479 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:23.417723 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:23.422040 17834 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:23.418416 17765 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.420461 17483 tablet_bootstrap.cc:654] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.414479 17482 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.425563 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:23.426776 17360 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:23.422355 17439 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.429080 17332 leader_election.cc:343] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.427348 17482 ts_tablet_manager.cc:1434] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 12:09:23.432296 17482 tablet_bootstrap.cc:492] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:23.434979 17860 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.437935 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:23.438172 17860 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:23.438632 17283 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.443470 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:23.463783 17483 tablet_bootstrap.cc:492] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:23.464300 17483 ts_tablet_manager.cc:1403] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.000s
I20260709 12:09:23.472692 17483 raft_consensus.cc:359] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.473433 17483 raft_consensus.cc:385] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.473726 17483 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.461248 17360 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.479904 17483 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.487994 17483 ts_tablet_manager.cc:1434] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 12:09:23.495272 17439 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:23.496181 17859 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.496815 17859 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.499558 17481 tablet_bootstrap.cc:492] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:23.500162 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:23.501333 17481 ts_tablet_manager.cc:1403] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.146s	user 0.019s	sys 0.011s
W20260709 12:09:23.502352 17255 leader_election.cc:343] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.500712 17482 tablet_bootstrap.cc:654] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.502368 17483 tablet_bootstrap.cc:492] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:23.510696 17859 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.509054 17481 raft_consensus.cc:359] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.511646 17481 raft_consensus.cc:385] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.511718 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:23.511986 17481 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.512787 17432 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:23.514318 17258 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:23.515105 17859 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.515476 17859 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.516122 17859 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.516665 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:23.518010 17840 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.518762 17840 raft_consensus.cc:697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:23.519671 17840 consensus_queue.cc:237] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.520758 17482 tablet_bootstrap.cc:492] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:23.521202 17482 ts_tablet_manager.cc:1403] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.001s
I20260709 12:09:23.515875 17481 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.531672 17283 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:23.533804 17481 ts_tablet_manager.cc:1434] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.002s
I20260709 12:09:23.534314 17483 tablet_bootstrap.cc:654] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.533715 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:23.535333 17834 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.535859 17834 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:23.536749 17834 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.537711 17481 tablet_bootstrap.cc:492] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:23.539615 17482 raft_consensus.cc:359] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.540450 17482 raft_consensus.cc:385] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.540810 17482 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.541869 17482 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.544576 17482 ts_tablet_manager.cc:1434] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:09:23.545997 17482 tablet_bootstrap.cc:492] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:23.546826 17859 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.550113 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:23.550746 17438 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.557121 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:23.557790 17363 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.558334 17482 tablet_bootstrap.cc:654] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.540848 17360 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:23.564165 17438 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:23.549039 17859 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.565434 17258 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:23.567225 17637 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.567900 17637 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:23.568809 17481 tablet_bootstrap.cc:654] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.568720 17637 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.572645 17483 tablet_bootstrap.cc:492] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:23.573206 17483 ts_tablet_manager.cc:1403] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 12:09:23.573781 17482 tablet_bootstrap.cc:492] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:23.574792 17482 ts_tablet_manager.cc:1403] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.014s
I20260709 12:09:23.578128 17482 raft_consensus.cc:359] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.579113 17482 raft_consensus.cc:385] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.579474 17482 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.580363 17482 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.582856 17482 ts_tablet_manager.cc:1434] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:09:23.579365 17483 raft_consensus.cc:359] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.583863 17483 raft_consensus.cc:385] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.583956 17482 tablet_bootstrap.cc:492] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:23.584197 17483 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.584288 17363 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:23.584941 17483 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.590137 17483 ts_tablet_manager.cc:1434] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:09:23.591112 17482 tablet_bootstrap.cc:654] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.591248 17483 tablet_bootstrap.cc:492] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Bootstrap starting.
I20260709 12:09:23.596029 17826 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.596660 17826 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.600325 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:23.601706 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:09:23.616001 17333 leader_election.cc:343] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.616360 17483 tablet_bootstrap.cc:654] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.617194 17482 tablet_bootstrap.cc:492] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:23.617750 17482 ts_tablet_manager.cc:1403] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.026s
I20260709 12:09:23.600970 17826 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.601001 17283 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:23.622241 17483 tablet_bootstrap.cc:492] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: No bootstrap required, opened a new log
I20260709 12:09:23.622040 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:09:23.622713 17483 ts_tablet_manager.cc:1403] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 12:09:23.623601 17826 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.623996 17826 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.624330 17826 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.603623 17481 tablet_bootstrap.cc:492] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:23.626927 17481 ts_tablet_manager.cc:1403] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.089s	user 0.006s	sys 0.006s
I20260709 12:09:23.631138 17483 raft_consensus.cc:359] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.634406 17483 raft_consensus.cc:385] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.634790 17483 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.635532 17483 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.629685 17482 raft_consensus.cc:359] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.637728 17187 catalog_manager.cc:5697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.633097 17481 raft_consensus.cc:359] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.639735 17481 raft_consensus.cc:385] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.640348 17481 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.641212 17481 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.643424 17481 ts_tablet_manager.cc:1434] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:09:23.638688 17482 raft_consensus.cc:385] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.646872 17483 ts_tablet_manager.cc:1434] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:09:23.647418 17482 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.648393 17481 tablet_bootstrap.cc:492] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:23.648313 17482 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.650873 17482 ts_tablet_manager.cc:1434] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:09:23.651924 17482 tablet_bootstrap.cc:492] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:23.655540 17481 tablet_bootstrap.cc:654] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.660997 17826 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.664479 17826 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.663923 17188 catalog_manager.cc:5697] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.665714 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:23.666358 17438 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.666599 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:23.667138 17283 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.668051 17482 tablet_bootstrap.cc:654] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.673951 17438 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:23.675436 17333 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:23.676512 17826 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.677276 17826 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:23.678221 17826 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.680495 17283 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:23.682057 17189 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.684823 17861 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.692051 17840 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.692680 17840 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.685492 17861 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.711052 17840 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.716910 17861 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.721969 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:23.724436 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:23.725145 17363 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:23.727327 17481 tablet_bootstrap.cc:492] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:23.728790 17481 ts_tablet_manager.cc:1403] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.004s
I20260709 12:09:23.727694 17255 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:23.731578 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:23.733302 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:23.732389 17439 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 0.
I20260709 12:09:23.734062 17285 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:23.733772 17438 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 0.
I20260709 12:09:23.735450 17859 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.735858 17859 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.736191 17859 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.742136 17332 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:23.742967 17567 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.742172 17481 raft_consensus.cc:359] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.743377 17567 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.743567 17481 raft_consensus.cc:385] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.743726 17567 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.744052 17481 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.745204 17481 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.746430 17859 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.749361 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:23.749979 17363 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.751103 17481 ts_tablet_manager.cc:1434] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:09:23.754011 17481 tablet_bootstrap.cc:492] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6: Bootstrap starting.
I20260709 12:09:23.756700 17363 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:23.758279 17255 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:23.759514 17481 tablet_bootstrap.cc:654] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.760080 17861 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.760386 17482 tablet_bootstrap.cc:492] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:23.760579 17861 raft_consensus.cc:697] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:23.761314 17482 ts_tablet_manager.cc:1403] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.110s	user 0.029s	sys 0.024s
I20260709 12:09:23.761442 17861 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.775224 17835 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.775888 17835 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.779678 17567 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.782445 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:23.783186 17365 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:23.784821 17404 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:23.785714 17834 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.786082 17834 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.786455 17834 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.791216 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:23.791949 17283 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:23.793391 17567 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.794894 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:23.795073 17859 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.795614 17439 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.804896 17439 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:23.806751 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:23.786968 17835 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:23.807546 17482 raft_consensus.cc:359] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.808482 17482 raft_consensus.cc:385] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.808861 17482 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.819343 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:23.820166 17283 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.825395 17283 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:09:23.825964 17826 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.826563 17482 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.844659 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:23.845322 17439 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.829326 17826 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:23.850674 17482 ts_tablet_manager.cc:1434] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 12:09:23.857903 17826 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:23.826782 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 62203.6us
I20260709 12:09:23.866694 17439 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:09:23.872826 17481 tablet_bootstrap.cc:492] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6: No bootstrap required, opened a new log
I20260709 12:09:23.873451 17481 ts_tablet_manager.cc:1403] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6: Time spent bootstrapping tablet: real 0.120s	user 0.027s	sys 0.025s
I20260709 12:09:23.883829 17834 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.894441 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:23.895162 17363 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.902642 17363 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:23.904158 17404 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:23.907648 17933 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.908244 17933 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:23.909106 17933 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.904456 17834 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:23.910621 17482 tablet_bootstrap.cc:492] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346: Bootstrap starting.
I20260709 12:09:23.918589 17481 raft_consensus.cc:359] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.919312 17481 raft_consensus.cc:385] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.919577 17481 raft_consensus.cc:740] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.920178 17481 consensus_queue.cc:260] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.920395 17189 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:23.921630 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 68823.8us
I20260709 12:09:23.923007 17481 ts_tablet_manager.cc:1434] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.001s
I20260709 12:09:23.926189 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:23.926872 17287 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.942934 17287 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:23.962610 17834 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.963241 17834 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.969410 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:23.966042 17834 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:23.975914 17938 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.977015 17938 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:23.974002 17365 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:23.979259 17938 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:23.985903 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:23.986915 17934 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.987290 17934 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.987620 17934 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.989835 17187 catalog_manager.cc:5697] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.994338 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:23.997509 17189 catalog_manager.cc:5697] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.008201 17482 tablet_bootstrap.cc:654] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.008752 17188 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.014761 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:09:24.016744 17439 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 1: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:09:24.017910 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:24.018635 17287 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:24.026348 17935 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.034322 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:09:24.035415 17859 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.054024 17940 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.070017 17859 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.060436 17934 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:24.075317 17482 tablet_bootstrap.cc:492] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346: No bootstrap required, opened a new log
I20260709 12:09:24.076030 17482 ts_tablet_manager.cc:1403] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.010s
I20260709 12:09:24.086773 17482 raft_consensus.cc:359] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:24.088856 17482 raft_consensus.cc:385] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.089251 17482 raft_consensus.cc:740] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.089999 17482 consensus_queue.cc:260] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:24.093990 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:24.098137 17284 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.098513 17934 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:24.099619 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:24.103612 17936 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.104542 17365 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.108353 17284 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:24.108753 17859 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.109545 17406 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:24.110291 17860 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.110783 17860 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:24.111598 17860 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:24.118279 17482 ts_tablet_manager.cc:1434] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:09:24.124089 17826 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.138337 17365 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:24.147768 17862 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.218710 17187 catalog_manager.cc:5697] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:24.224510 17238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.254261 17932 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.270073 17932 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.319180 17860 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.319614 17860 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:24.321429 17860 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:24.322175 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:09:24.322371 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:09:24.322731 17290 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:24.322956 17360 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 0.
I20260709 12:09:24.323805 17406 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:24.324421 17860 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.324703 17860 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.324973 17860 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.330735 17860 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:24.332363 17860 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:24.333248 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:24.333428 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:24.333881 17290 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.334056 17360 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.341024 17290 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:24.342065 17406 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:24.342865 17860 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.344293 17860 raft_consensus.cc:697] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:24.344738 17360 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:09:24.345180 17860 consensus_queue.cc:237] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:24.355587 17929 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.356586 17188 catalog_manager.cc:5697] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.367956 17929 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.379036 17932 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.396546 17765 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.534384 17935 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.547765 17935 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.591780 17862 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.604776 17862 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.731645 17860 consensus_queue.cc:1048] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.751190 17935 consensus_queue.cc:1048] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.750470 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:25.783974 17969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:25.784390 17970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:25.786319 17972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:25.787133 16125 server_base.cc:1061] running on GCE node
I20260709 12:09:25.788858 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:25.789110 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:25.789279 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783598965789267 us; error 0 us; skew 500 ppm
I20260709 12:09:25.789829 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:25.792619 16125 webserver.cc:533] Webserver started at http://127.15.191.68:38483/ using document root <none> and password file <none>
I20260709 12:09:25.793136 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:25.793304 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:25.793557 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:25.794968 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-3-root/instance:
uuid: "868a5e341d0a41b4ac0927342c8cd598"
format_stamp: "Formatted at 2026-07-09 12:09:25 on dist-test-slave-1sdq"
I20260709 12:09:25.800611 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 12:09:25.804868 17977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:25.805657 16125 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:09:25.805974 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-3-root
uuid: "868a5e341d0a41b4ac0927342c8cd598"
format_stamp: "Formatted at 2026-07-09 12:09:25 on dist-test-slave-1sdq"
I20260709 12:09:25.806316 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:25.827097 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:25.829567 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:25.834029 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:25.837141 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:25.837347 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:25.837563 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:25.837716 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:25.912563 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.68:34143
I20260709 12:09:25.912708 18039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.68:34143 every 8 connection(s)
I20260709 12:09:25.923370 16125 auto_leader_rebalancer-test.cc:439] add a tserver: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:25.937875 18040 heartbeater.cc:344] Connected to a master server at 127.15.191.126:37225
I20260709 12:09:25.938387 18040 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:25.939143 18040 heartbeater.cc:507] Master 127.15.191.126:37225 requested a full tablet report, sending...
I20260709 12:09:25.940886 17188 ts_manager.cc:194] Registered new tserver with Master: 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:25.942334 17188 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60632
I20260709 12:09:26.351863 17290 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:26.359467 17365 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.359966 17439 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.361449 18048 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.362586 17637 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.375819 17637 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.378947 17439 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.384867 17361 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:26.402171 17258 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7f622d20c7b40a296d381dcc9b82704. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.401729 17188 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.433921 17361 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:26.447463 17287 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.449990 18053 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.457634 17439 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.458932 18053 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.463587 17826 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:26.466796 17333 consensus_peers.cc:597] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94fb1d5d8c204d70a68af6043f3ba9dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.474905 17287 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.479667 17290 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:26.482810 17187 catalog_manager.cc:5697] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.491346 17361 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.492964 17637 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.492475 17439 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.493048 17432 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:26.501863 17258 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b90fb9f510d4f0abcf7148b6fafae89. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.503392 17929 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.505645 18048 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.514843 17365 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.534134 17188 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.547190 17439 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.560755 17438 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:26.577425 17365 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:26.580025 17935 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.584908 17287 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:26.588613 18044 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:26.594945 17934 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.600373 17361 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:26.605394 17407 consensus_peers.cc:597] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe9b4ec086384e2b800cbd4d98e9fe33. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.608878 17287 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:26.617439 17187 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 2 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.803671 18072 ts_tablet_manager.cc:933] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:26.811121 18072 tablet_copy_client.cc:323] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:26.830494 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet d7f622d20c7b40a296d381dcc9b82704 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:26.831002 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet d7f622d20c7b40a296d381dcc9b82704 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-d7f622d20c7b40a296d381dcc9b82704
I20260709 12:09:26.836871 17302 tablet_copy_source_session.cc:215] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:26.841778 18072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f622d20c7b40a296d381dcc9b82704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:26.845767 18075 ts_tablet_manager.cc:933] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:26.848680 18075 tablet_copy_client.cc:323] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:26.858227 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet 94fb1d5d8c204d70a68af6043f3ba9dd from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:26.858781 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet 94fb1d5d8c204d70a68af6043f3ba9dd from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-94fb1d5d8c204d70a68af6043f3ba9dd
I20260709 12:09:26.862522 18072 tablet_copy_client.cc:806] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:26.863353 18072 tablet_copy_client.cc:670] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:26.865248 17377 tablet_copy_source_session.cc:215] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:26.868571 18072 tablet_copy_client.cc:538] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:26.868912 18075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94fb1d5d8c204d70a68af6043f3ba9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:26.879257 18072 tablet_bootstrap.cc:492] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:26.885263 18075 tablet_copy_client.cc:806] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:26.886029 18075 tablet_copy_client.cc:670] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:26.890758 18075 tablet_copy_client.cc:538] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:26.900863 18075 tablet_bootstrap.cc:492] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:26.911039 18072 tablet_bootstrap.cc:492] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:26.912200 18072 tablet_bootstrap.cc:492] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:26.912978 18072 ts_tablet_manager.cc:1403] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.010s
I20260709 12:09:26.916567 18072 raft_consensus.cc:359] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:26.917723 18072 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:26.920255 18072 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:26.924072 18040 heartbeater.cc:499] Master 127.15.191.126:37225 was elected leader, sending a full tablet report...
I20260709 12:09:26.924750 18072 ts_tablet_manager.cc:1434] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:09:26.931181 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-d7f622d20c7b40a296d381dcc9b82704 received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:26.931749 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-d7f622d20c7b40a296d381dcc9b82704 on tablet d7f622d20c7b40a296d381dcc9b82704 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:26.934418 18075 tablet_bootstrap.cc:492] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:26.935478 18075 tablet_bootstrap.cc:492] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:26.936236 18075 ts_tablet_manager.cc:1403] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.004s
I20260709 12:09:26.938625 18075 raft_consensus.cc:359] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:26.939390 18075 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:26.940052 18075 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:26.942209 18075 ts_tablet_manager.cc:1434] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:26.944209 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-94fb1d5d8c204d70a68af6043f3ba9dd received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:26.944680 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-94fb1d5d8c204d70a68af6043f3ba9dd on tablet 94fb1d5d8c204d70a68af6043f3ba9dd with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:26.968830 18075 ts_tablet_manager.cc:933] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:26.972347 18075 tablet_copy_client.cc:323] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:26.984535 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet fe9b4ec086384e2b800cbd4d98e9fe33 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:26.985150 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet fe9b4ec086384e2b800cbd4d98e9fe33 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-fe9b4ec086384e2b800cbd4d98e9fe33
I20260709 12:09:26.993028 17451 tablet_copy_source_session.cc:215] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:26.998131 18075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9b4ec086384e2b800cbd4d98e9fe33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.017509 18075 tablet_copy_client.cc:806] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.018234 18075 tablet_copy_client.cc:670] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.022128 18075 tablet_copy_client.cc:538] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.030965 18075 tablet_bootstrap.cc:492] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:27.049834 18075 tablet_bootstrap.cc:492] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.050716 18075 tablet_bootstrap.cc:492] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:27.051476 18075 ts_tablet_manager.cc:1403] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 12:09:27.054962 18075 raft_consensus.cc:359] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:27.056322 18075 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:27.057057 18075 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:27.065412 18075 ts_tablet_manager.cc:1434] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 12:09:27.067270 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-fe9b4ec086384e2b800cbd4d98e9fe33 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:27.067764 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-fe9b4ec086384e2b800cbd4d98e9fe33 on tablet fe9b4ec086384e2b800cbd4d98e9fe33 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:27.110321 18075 ts_tablet_manager.cc:933] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:27.114678 18075 tablet_copy_client.cc:323] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:27.116756 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet 4b90fb9f510d4f0abcf7148b6fafae89 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:27.117323 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet 4b90fb9f510d4f0abcf7148b6fafae89 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-4b90fb9f510d4f0abcf7148b6fafae89
I20260709 12:09:27.124657 17302 tablet_copy_source_session.cc:215] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:27.127625 18075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b90fb9f510d4f0abcf7148b6fafae89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.144580 18075 tablet_copy_client.cc:806] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.145145 18075 tablet_copy_client.cc:670] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.149959 18075 tablet_copy_client.cc:538] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.160406 18075 tablet_bootstrap.cc:492] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:27.178992 18075 tablet_bootstrap.cc:492] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.179924 18075 tablet_bootstrap.cc:492] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:27.180634 18075 ts_tablet_manager.cc:1403] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.020s	user 0.021s	sys 0.000s
I20260709 12:09:27.183261 18075 raft_consensus.cc:359] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:27.184231 18075 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:27.184903 18075 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:27.188578 18015 raft_consensus.cc:1217] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:27.190446 18075 ts_tablet_manager.cc:1434] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:27.195998 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4b90fb9f510d4f0abcf7148b6fafae89 received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:27.196460 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4b90fb9f510d4f0abcf7148b6fafae89 on tablet 4b90fb9f510d4f0abcf7148b6fafae89 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:27.290810 18015 raft_consensus.cc:1217] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:27.346338 18015 raft_consensus.cc:1217] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:09:27.552654 18015 raft_consensus.cc:1217] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:27.682736 17637 raft_consensus.cc:1064] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:27.685243 17637 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:27.694821 18015 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:27.695698 17438 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:27.696761 17361 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:27.697256 18048 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:27.699570 18088 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:27.700548 18081 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:27.714488 18081 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.717818 18015 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.718818 17360 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.746030 17438 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.750748 17935 raft_consensus.cc:1064] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:27.750560 17189 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.753131 17935 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:27.798552 17826 raft_consensus.cc:1064] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
W20260709 12:09:27.815600 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 48856.5us
I20260709 12:09:27.816984 17826 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:27.823210 18015 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:27.825009 18083 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:27.842417 18015 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:27.843879 18086 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:27.854872 17439 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:27.854830 17361 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:27.861061 18094 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:27.868804 18086 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:27.888381 17290 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:27.904908 18095 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:27.909665 17284 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:27.915330 17840 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.918864 17432 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.920027 18094 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.921370 17365 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.924290 17360 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:27.944381 18015 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.942925 18081 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:09:27.948779 17188 catalog_manager.cc:5697] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.949123 17187 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.955688 18014 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:27.957026 17284 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:27.968293 17637 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.976089 18014 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.979312 17840 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:27.983757 18081 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:27.991770 17285 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:27.992049 18013 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.004442 17188 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.004719 17360 raft_consensus.cc:2955] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.007630 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d7f622d20c7b40a296d381dcc9b82704 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:28.020452 17432 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:28.028618 17365 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:28.030038 17361 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:28.030345 18094 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.035346 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f622d20c7b40a296d381dcc9b82704 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:28.041720 18015 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:28.049813 18095 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.051119 18014 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.051859 17363 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.056329 18102 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:28.066124 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe9b4ec086384e2b800cbd4d98e9fe33 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:28.072631 17438 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.076680 17840 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:28.088032 17189 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 2 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.098587 17826 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.104755 17935 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:28.109004 18109 tablet_replica.cc:333] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:28.111622 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet fe9b4ec086384e2b800cbd4d98e9fe33 with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:28.113828 18111 tablet_replica.cc:333] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:28.113710 17284 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.118403 18014 raft_consensus.cc:2955] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.122613 18013 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.125970 17433 raft_consensus.cc:2955] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.130949 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94fb1d5d8c204d70a68af6043f3ba9dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:28.148627 18111 raft_consensus.cc:2243] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:28.149351 18111 raft_consensus.cc:2272] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:28.149237 17187 catalog_manager.cc:5697] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.153143 18111 ts_tablet_manager.cc:1916] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:28.164952 18088 raft_consensus.cc:1064] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:28.167681 18088 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:28.172415 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet 94fb1d5d8c204d70a68af6043f3ba9dd with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:28.178367 18109 raft_consensus.cc:2243] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:28.179167 18109 raft_consensus.cc:2272] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:28.182335 18109 ts_tablet_manager.cc:1916] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:28.185782 18014 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.187431 17433 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.189858 18048 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.190122 18111 ts_tablet_manager.cc:1929] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:09:28.190701 18111 log.cc:1199] T fe9b4ec086384e2b800cbd4d98e9fe33 P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/fe9b4ec086384e2b800cbd4d98e9fe33
I20260709 12:09:28.191993 18048 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.192509 18111 tablet_replica.cc:333] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:28.193601 18111 raft_consensus.cc:2243] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:28.195255 18111 raft_consensus.cc:2272] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:28.197685 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet fe9b4ec086384e2b800cbd4d98e9fe33 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:28.200929 18111 ts_tablet_manager.cc:1916] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:28.203754 17363 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.205834 17637 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.222419 18088 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.226670 18109 ts_tablet_manager.cc:1929] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:28.227206 18109 log.cc:1199] T d7f622d20c7b40a296d381dcc9b82704 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/d7f622d20c7b40a296d381dcc9b82704
I20260709 12:09:28.229557 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet d7f622d20c7b40a296d381dcc9b82704 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:28.233733 17363 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.242475 18111 ts_tablet_manager.cc:1929] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:28.242988 18111 log.cc:1199] T 94fb1d5d8c204d70a68af6043f3ba9dd P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/94fb1d5d8c204d70a68af6043f3ba9dd
I20260709 12:09:28.244689 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet 94fb1d5d8c204d70a68af6043f3ba9dd (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:28.236006 18014 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.254154 17189 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.254751 17433 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.301364 17284 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:28.314713 18014 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.315888 17433 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.316138 18048 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.320070 18048 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.324105 18088 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.334601 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b90fb9f510d4f0abcf7148b6fafae89 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:28.335598 18014 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.351217 17190 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:28.358297 17432 raft_consensus.cc:2955] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:28.364429 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b90fb9f510d4f0abcf7148b6fafae89 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:28.369796 18117 tablet_replica.cc:333] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:28.370847 18117 raft_consensus.cc:2243] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:28.371658 18117 raft_consensus.cc:2272] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:28.376413 18117 ts_tablet_manager.cc:1916] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:28.396687 18117 ts_tablet_manager.cc:1929] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:28.397063 18117 log.cc:1199] T 4b90fb9f510d4f0abcf7148b6fafae89 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/4b90fb9f510d4f0abcf7148b6fafae89
I20260709 12:09:28.398767 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet 4b90fb9f510d4f0abcf7148b6fafae89 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:29.436299 17365 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:09:29.442941 17333 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6728648e29b471c950575a72ecf0454. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:29.444197 17284 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:29.445089 17432 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:29.446171 18103 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:29.447496 18120 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:29.457975 18121 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.459290 17285 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.471853 17432 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.482049 17284 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:29.489768 17187 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:29.511023 17258 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a77855d79ba04cf1bf33cc20e8236abc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:29.511976 17432 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:29.513748 18088 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:29.517797 17365 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:29.520169 18088 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:29.527499 18126 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.531929 17365 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.533854 17433 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.555320 17433 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:29.569530 17190 catalog_manager.cc:5697] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:29.574455 17407 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd27279c3e8c4e0cbe30a2cbe7e56ab1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:29.574637 17363 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:29.575891 17284 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:29.576273 18095 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:29.579052 18095 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:29.591965 17935 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.595242 17284 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.615002 17363 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.617499 17190 catalog_manager.cc:5697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.623551 17365 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:09:29.638585 17333 consensus_peers.cc:597] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ec8dfd95d9a45c2a5becdfb706a42fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:29.648823 17433 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:29.653563 18121 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:29.656090 17284 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:29.659729 18121 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:29.663560 18103 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.665122 17433 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:29.681459 17187 catalog_manager.cc:5697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.682806 17284 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:30.015513 18138 ts_tablet_manager.cc:933] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:30.017344 18138 tablet_copy_client.cc:323] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:30.019017 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet c6728648e29b471c950575a72ecf0454 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:30.019594 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet c6728648e29b471c950575a72ecf0454 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-c6728648e29b471c950575a72ecf0454
I20260709 12:09:30.023407 18140 ts_tablet_manager.cc:933] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:30.025941 18140 tablet_copy_client.cc:323] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:30.027666 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet a77855d79ba04cf1bf33cc20e8236abc from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:30.028187 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet a77855d79ba04cf1bf33cc20e8236abc from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-a77855d79ba04cf1bf33cc20e8236abc
I20260709 12:09:30.029268 17377 tablet_copy_source_session.cc:215] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.033023 18138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6728648e29b471c950575a72ecf0454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:30.035661 17302 tablet_copy_source_session.cc:215] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.039194 18140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77855d79ba04cf1bf33cc20e8236abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:30.063407 18140 tablet_copy_client.cc:806] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:30.064073 18140 tablet_copy_client.cc:670] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:30.068348 18138 tablet_copy_client.cc:806] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:30.069216 18138 tablet_copy_client.cc:670] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:30.069324 18140 tablet_copy_client.cc:538] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:30.073084 18138 tablet_copy_client.cc:538] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:30.086212 18140 tablet_bootstrap.cc:492] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:30.087327 18138 tablet_bootstrap.cc:492] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:30.109473 18140 tablet_bootstrap.cc:492] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:30.110775 18140 tablet_bootstrap.cc:492] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:30.111820 18140 ts_tablet_manager.cc:1403] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 12:09:30.117264 18140 raft_consensus.cc:359] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:30.119144 18140 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:30.119771 18140 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:30.126160 18138 tablet_bootstrap.cc:492] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:30.127174 18138 tablet_bootstrap.cc:492] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:30.127878 18138 ts_tablet_manager.cc:1403] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.008s
I20260709 12:09:30.131824 18138 raft_consensus.cc:359] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:30.132736 18138 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:30.133419 18138 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:30.148104 18144 ts_tablet_manager.cc:933] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:30.159293 18140 ts_tablet_manager.cc:1434] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.008s
I20260709 12:09:30.161337 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-a77855d79ba04cf1bf33cc20e8236abc received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:30.161808 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-a77855d79ba04cf1bf33cc20e8236abc on tablet a77855d79ba04cf1bf33cc20e8236abc with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:30.169924 18138 ts_tablet_manager.cc:1434] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.042s	user 0.025s	sys 0.016s
I20260709 12:09:30.171732 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-c6728648e29b471c950575a72ecf0454 received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:30.172222 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-c6728648e29b471c950575a72ecf0454 on tablet c6728648e29b471c950575a72ecf0454 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:30.176728 18144 tablet_copy_client.cc:323] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:30.178663 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:30.179241 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-fd27279c3e8c4e0cbe30a2cbe7e56ab1
I20260709 12:09:30.182555 18138 ts_tablet_manager.cc:933] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:30.184376 18138 tablet_copy_client.cc:323] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:30.186249 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:30.186805 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet 4ec8dfd95d9a45c2a5becdfb706a42fb from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-4ec8dfd95d9a45c2a5becdfb706a42fb
I20260709 12:09:30.187253 17451 tablet_copy_source_session.cc:215] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.191154 18144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:30.194090 17377 tablet_copy_source_session.cc:215] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.198225 18138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:30.217552 18138 tablet_copy_client.cc:806] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:30.218159 18138 tablet_copy_client.cc:670] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:30.218668 18144 tablet_copy_client.cc:806] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:30.219245 18144 tablet_copy_client.cc:670] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:30.223511 18138 tablet_copy_client.cc:538] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:30.224834 18144 tablet_copy_client.cc:538] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:30.232538 18138 tablet_bootstrap.cc:492] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:30.239749 18144 tablet_bootstrap.cc:492] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:30.251772 18138 tablet_bootstrap.cc:492] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:30.252717 18138 tablet_bootstrap.cc:492] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:30.253443 18138 ts_tablet_manager.cc:1403] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 12:09:30.256667 18138 raft_consensus.cc:359] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:30.257436 18138 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:30.258139 18138 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:30.260602 18138 ts_tablet_manager.cc:1434] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:30.265763 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4ec8dfd95d9a45c2a5becdfb706a42fb received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:30.266290 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4ec8dfd95d9a45c2a5becdfb706a42fb on tablet 4ec8dfd95d9a45c2a5becdfb706a42fb with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:30.270650 18144 tablet_bootstrap.cc:492] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:30.273041 18144 tablet_bootstrap.cc:492] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:30.273674 18144 ts_tablet_manager.cc:1403] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.001s
I20260709 12:09:30.277465 18144 raft_consensus.cc:359] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:30.278369 18144 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:30.279052 18144 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:30.282485 18144 ts_tablet_manager.cc:1434] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:30.284385 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-fd27279c3e8c4e0cbe30a2cbe7e56ab1 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:30.284840 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-fd27279c3e8c4e0cbe30a2cbe7e56ab1 on tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:30.533762 18014 raft_consensus.cc:1217] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:30.569156 18014 raft_consensus.cc:1217] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:30.591836 18014 raft_consensus.cc:1217] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:30.728550 18014 raft_consensus.cc:1217] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.014385 18151 raft_consensus.cc:1064] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:31.016804 18151 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:31.023682 17935 raft_consensus.cc:1064] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:31.026935 17935 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:31.029167 18014 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.030617 17363 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.031420 18151 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.029469 17433 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.033229 18048 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.035207 18126 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:31.056130 18013 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.058380 18048 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.060029 18013 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.065255 18095 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:31.066012 17290 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.075042 18118 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.075986 17363 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.108515 17190 catalog_manager.cc:5697] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.118570 17433 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.147274 17363 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.147400 17935 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.160030 18120 raft_consensus.cc:1064] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:31.160498 17290 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.163436 18014 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.169553 18153 raft_consensus.cc:1064] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:31.172154 17285 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:31.179417 18153 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:31.182819 18013 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.184387 18048 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:31.186028 18120 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:31.190815 17188 catalog_manager.cc:5697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:31.195849 17433 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.194965 18162 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.197393 18126 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:31.209440 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a77855d79ba04cf1bf33cc20e8236abc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:31.213831 17433 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.211647 18013 raft_consensus.cc:2955] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.240312 17187 catalog_manager.cc:5697] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:31.254520 18014 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.256093 18152 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:31.292214 18015 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.301272 17433 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.306361 17935 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.312341 17433 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:31.320905 18015 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.323243 18160 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:31.299587 18153 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:09:31.323637 17285 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.331094 17284 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.334604 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet a77855d79ba04cf1bf33cc20e8236abc with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:31.336177 18159 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:31.337694 18160 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.341787 18015 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.352262 17285 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:09:31.353940 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 48938.5us
I20260709 12:09:31.368536 18175 tablet_replica.cc:333] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:31.370011 18175 raft_consensus.cc:2243] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:31.371024 18175 raft_consensus.cc:2272] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:31.377565 18152 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.384820 17290 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:31.387053 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 80206.5us
I20260709 12:09:31.388913 18120 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.400857 18175 ts_tablet_manager.cc:1916] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:31.405651 18120 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.411981 17433 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.412674 17187 catalog_manager.cc:5697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.415906 18153 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.419945 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:31.422603 18153 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.453344 18013 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.453279 17290 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.464318 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:31.471268 17361 raft_consensus.cc:2955] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.463521 17190 catalog_manager.cc:5697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:31.483510 17432 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.490856 17285 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.488814 18152 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.519084 18014 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.533262 18175 ts_tablet_manager.cc:1929] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:31.533816 18175 log.cc:1199] T a77855d79ba04cf1bf33cc20e8236abc P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/a77855d79ba04cf1bf33cc20e8236abc
I20260709 12:09:31.535576 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet a77855d79ba04cf1bf33cc20e8236abc (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:31.538321 18175 tablet_replica.cc:333] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:31.543784 17433 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.546988 18175 raft_consensus.cc:2243] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:31.547732 18175 raft_consensus.cc:2272] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:31.557163 17189 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.571094 18175 ts_tablet_manager.cc:1916] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:31.590406 18175 ts_tablet_manager.cc:1929] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:31.590960 18175 log.cc:1199] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/fd27279c3e8c4e0cbe30a2cbe7e56ab1
I20260709 12:09:31.592700 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:31.596112 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:31.597501 17365 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:31.598124 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet fd27279c3e8c4e0cbe30a2cbe7e56ab1 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:31.605351 18014 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.607384 18153 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:31.612550 17285 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.614549 18153 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:31.619032 18120 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.621876 18014 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.638372 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6728648e29b471c950575a72ecf0454 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:31.641268 17285 raft_consensus.cc:2955] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.644280 17188 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.653882 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet c6728648e29b471c950575a72ecf0454 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:31.655603 18184 tablet_replica.cc:333] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:31.656621 18184 raft_consensus.cc:2243] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:31.657697 18184 raft_consensus.cc:2272] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:31.662036 18184 ts_tablet_manager.cc:1916] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:31.675441 18184 ts_tablet_manager.cc:1929] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:31.675796 18184 log.cc:1199] T c6728648e29b471c950575a72ecf0454 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/c6728648e29b471c950575a72ecf0454
I20260709 12:09:31.677246 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet c6728648e29b471c950575a72ecf0454 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:31.921185 17362 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:31.928574 18014 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.929075 17433 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.930570 18120 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:31.931499 18152 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:31.940277 18153 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.941972 17433 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.949446 18014 raft_consensus.cc:2955] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.961355 17187 catalog_manager.cc:5697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:31.964336 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:31.975183 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ec8dfd95d9a45c2a5becdfb706a42fb with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:31.976783 18186 tablet_replica.cc:333] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:31.977641 18186 raft_consensus.cc:2243] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:31.978303 18186 raft_consensus.cc:2272] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:31.981197 18186 ts_tablet_manager.cc:1916] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:31.994091 18186 ts_tablet_manager.cc:1929] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:31.994462 18186 log.cc:1199] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/4ec8dfd95d9a45c2a5becdfb706a42fb
I20260709 12:09:31.996017 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet 4ec8dfd95d9a45c2a5becdfb706a42fb (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
W20260709 12:09:33.097466 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 45262us
I20260709 12:09:33.214602 17290 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:09:33.223409 17258 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ff441a2f8cb4ea9b0e9a4bec55d843b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.225035 17433 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.226732 18194 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.227321 17365 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.228605 18188 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.235713 18194 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.237921 17433 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.239418 17362 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.257573 17290 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:33.260502 17190 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:33.299736 17258 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8832d652d7004314892ca1c18bd94f7c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.300549 17433 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.307365 18194 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.309299 17362 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.310914 18194 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:33.335363 18188 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.337039 17433 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.342211 17365 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.357014 17190 catalog_manager.cc:5697] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.364410 17433 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:33.376466 17365 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:33.376983 17407 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97e731eb30ed4f36ab13505e2cad7085. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.378253 17290 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.377931 18193 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.379690 18192 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.387624 18173 raft_consensus.cc:2955] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.389801 17365 raft_consensus.cc:2955] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.392639 17290 raft_consensus.cc:2955] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.410284 17433 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:33.410446 17187 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.454282 17365 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:33.454789 17407 consensus_peers.cc:597] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ddf5e2cbdb748f7a7ed880493377874. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.457576 17290 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.460384 18160 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:33.464008 18190 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.473112 18173 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.474893 17285 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.475317 17362 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.499979 17187 catalog_manager.cc:5697] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:33.823210 18212 ts_tablet_manager.cc:933] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:33.825621 18212 tablet_copy_client.cc:323] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:33.827900 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:33.828552 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-9ff441a2f8cb4ea9b0e9a4bec55d843b
I20260709 12:09:33.837138 17302 tablet_copy_source_session.cc:215] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.840533 18212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.857710 18212 tablet_copy_client.cc:806] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:33.858462 18212 tablet_copy_client.cc:670] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.863722 18212 tablet_copy_client.cc:538] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.874958 18212 tablet_bootstrap.cc:492] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:33.888954 18214 ts_tablet_manager.cc:933] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:33.890715 18214 tablet_copy_client.cc:323] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:33.892294 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet 8832d652d7004314892ca1c18bd94f7c from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:33.892840 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet 8832d652d7004314892ca1c18bd94f7c from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-8832d652d7004314892ca1c18bd94f7c
I20260709 12:09:33.897398 18212 tablet_bootstrap.cc:492] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:33.898511 18212 tablet_bootstrap.cc:492] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:33.899281 18212 ts_tablet_manager.cc:1403] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.012s
I20260709 12:09:33.901154 17302 tablet_copy_source_session.cc:215] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.904465 18212 raft_consensus.cc:359] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:33.905527 18212 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:33.906342 18212 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:33.908849 18214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8832d652d7004314892ca1c18bd94f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.916901 18212 ts_tablet_manager.cc:1434] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 12:09:33.923295 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-9ff441a2f8cb4ea9b0e9a4bec55d843b received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:33.923835 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-9ff441a2f8cb4ea9b0e9a4bec55d843b on tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:33.937965 18214 tablet_copy_client.cc:806] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:33.938669 18214 tablet_copy_client.cc:670] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.941946 18212 ts_tablet_manager.cc:933] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:33.944530 18214 tablet_copy_client.cc:538] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.951432 18212 tablet_copy_client.cc:323] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:33.953517 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 97e731eb30ed4f36ab13505e2cad7085 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:33.954072 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 97e731eb30ed4f36ab13505e2cad7085 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-97e731eb30ed4f36ab13505e2cad7085
I20260709 12:09:33.956321 18214 tablet_bootstrap.cc:492] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:33.963889 17451 tablet_copy_source_session.cc:215] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.972126 18212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e731eb30ed4f36ab13505e2cad7085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.014633 18214 tablet_bootstrap.cc:492] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.015841 18214 tablet_bootstrap.cc:492] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:34.016649 18214 ts_tablet_manager.cc:1403] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.005s
I20260709 12:09:34.020218 18214 raft_consensus.cc:359] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:34.020957 18212 tablet_copy_client.cc:806] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.021430 18214 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:34.021780 18212 tablet_copy_client.cc:670] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.022287 18214 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:34.025012 18214 ts_tablet_manager.cc:1434] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:34.026185 18212 tablet_copy_client.cc:538] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.026880 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-8832d652d7004314892ca1c18bd94f7c received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:34.027314 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-8832d652d7004314892ca1c18bd94f7c on tablet 8832d652d7004314892ca1c18bd94f7c with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:34.035480 18212 tablet_bootstrap.cc:492] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:34.053032 18212 tablet_bootstrap.cc:492] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.053805 18212 tablet_bootstrap.cc:492] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:34.054428 18212 ts_tablet_manager.cc:1403] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.008s
I20260709 12:09:34.056787 18212 raft_consensus.cc:359] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:34.057432 18212 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:34.057926 18212 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:34.059854 18212 ts_tablet_manager.cc:1434] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:09:34.061913 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-97e731eb30ed4f36ab13505e2cad7085 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:34.062404 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-97e731eb30ed4f36ab13505e2cad7085 on tablet 97e731eb30ed4f36ab13505e2cad7085 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:34.078930 18212 ts_tablet_manager.cc:933] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:34.080662 18212 tablet_copy_client.cc:323] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:34.082333 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 4ddf5e2cbdb748f7a7ed880493377874 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:34.082892 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 4ddf5e2cbdb748f7a7ed880493377874 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-4ddf5e2cbdb748f7a7ed880493377874
I20260709 12:09:34.090916 17451 tablet_copy_source_session.cc:215] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.094208 18212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddf5e2cbdb748f7a7ed880493377874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.112979 18212 tablet_copy_client.cc:806] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.113677 18212 tablet_copy_client.cc:670] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.117856 18212 tablet_copy_client.cc:538] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.128746 18212 tablet_bootstrap.cc:492] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:34.142705 18212 tablet_bootstrap.cc:492] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.143589 18212 tablet_bootstrap.cc:492] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:34.144120 18212 ts_tablet_manager.cc:1403] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 12:09:34.146013 18212 raft_consensus.cc:359] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:34.146695 18212 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:34.147289 18212 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:34.149221 18212 ts_tablet_manager.cc:1434] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:34.152606 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4ddf5e2cbdb748f7a7ed880493377874 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:34.153086 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4ddf5e2cbdb748f7a7ed880493377874 on tablet 4ddf5e2cbdb748f7a7ed880493377874 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:34.282243 18014 raft_consensus.cc:1217] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.315461 18014 raft_consensus.cc:1217] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.433509 18014 raft_consensus.cc:1217] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.550349 18013 raft_consensus.cc:1217] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.788295 18194 raft_consensus.cc:1064] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:34.790580 18194 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:34.798408 18224 raft_consensus.cc:1064] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:34.801625 18224 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:34.804219 18013 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.804361 17439 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.804893 17362 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.806507 18194 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.807571 18223 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.810207 18048 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.820627 17362 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.822522 18194 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.823549 18013 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.827486 17433 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.840991 18224 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.867404 18194 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.872035 18048 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:34.878917 17433 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:34.885175 18190 raft_consensus.cc:1064] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:34.887939 18190 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:34.899745 17190 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:34.891772 18014 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:34.909569 17365 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:34.961153 18015 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.962865 18160 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.021710 17284 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.025949 18185 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:09:35.042552 17439 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.034345 18223 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.047379 18013 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.080179 17362 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.090034 17362 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:09:35.093011 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 45845.3us
I20260709 12:09:35.093569 18185 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:35.114475 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 59173.3us
I20260709 12:09:35.133757 18190 raft_consensus.cc:1064] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:35.136823 18190 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:35.141289 18173 raft_consensus.cc:2955] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.145144 17287 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:35.160990 18015 raft_consensus.cc:2955] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.164456 17365 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.172713 18224 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:35.174444 17285 raft_consensus.cc:2955] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.175994 17189 catalog_manager.cc:5697] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:35.187119 18013 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.199015 17290 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:35.199681 18224 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.205473 18194 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.207201 17189 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.212689 17360 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.216456 18013 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.217897 17365 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.228277 17361 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.229699 18185 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.230134 18224 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.233465 18185 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.239907 18048 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.248793 17365 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.249491 17433 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:35.257385 18015 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.262388 18190 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.272666 18237 raft_consensus.cc:2955] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.280694 18014 raft_consensus.cc:2955] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.287174 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97e731eb30ed4f36ab13505e2cad7085 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.295100 17189 catalog_manager.cc:5697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:09:35.304525 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 83288.8us
I20260709 12:09:35.306370 18237 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.309183 17290 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.310142 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.311049 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8832d652d7004314892ca1c18bd94f7c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.311275 17287 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.314783 17190 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.316797 18015 raft_consensus.cc:2955] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.317608 17187 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.323001 18013 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.326624 18173 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.328477 18173 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.334167 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet 97e731eb30ed4f36ab13505e2cad7085 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:35.337776 18048 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.338128 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet 8832d652d7004314892ca1c18bd94f7c with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:35.337311 17362 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.346383 18253 tablet_replica.cc:333] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:35.351337 18253 raft_consensus.cc:2243] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.350907 17284 raft_consensus.cc:2955] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.352136 18253 pending_rounds.cc:70] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: Trying to abort 1 pending ops.
I20260709 12:09:35.362727 18253 pending_rounds.cc:77] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305621401134743552 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "97e731eb30ed4f36ab13505e2cad7085" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } } }
I20260709 12:09:35.364110 18253 raft_consensus.cc:2917] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:09:35.364569 18253 raft_consensus.cc:2889] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:09:35.364953 18253 raft_consensus.cc:2272] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.351994 18013 raft_consensus.cc:2955] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.372161 18015 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.375293 18253 ts_tablet_manager.cc:1916] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.375090 17285 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.388131 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:35.396167 17189 catalog_manager.cc:5697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:35.410645 18253 ts_tablet_manager.cc:1929] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.411238 18253 log.cc:1199] T 97e731eb30ed4f36ab13505e2cad7085 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/97e731eb30ed4f36ab13505e2cad7085
I20260709 12:09:35.411366 18254 tablet_replica.cc:333] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:35.412606 18254 raft_consensus.cc:2243] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.413827 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet 97e731eb30ed4f36ab13505e2cad7085 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:35.413427 18254 raft_consensus.cc:2272] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.427731 18254 ts_tablet_manager.cc:1916] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.432749 17433 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:35.441671 17360 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.443879 18015 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.444460 18190 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.445456 18237 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.454005 18173 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.457051 17360 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.459229 18013 raft_consensus.cc:2955] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.467672 18254 ts_tablet_manager.cc:1929] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.468226 18254 log.cc:1199] T 8832d652d7004314892ca1c18bd94f7c P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/8832d652d7004314892ca1c18bd94f7c
I20260709 12:09:35.470904 18254 tablet_replica.cc:333] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:35.471647 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet 8832d652d7004314892ca1c18bd94f7c (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:35.472146 18254 raft_consensus.cc:2243] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.473003 18254 raft_consensus.cc:2272] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.483569 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ddf5e2cbdb748f7a7ed880493377874 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.491524 18254 ts_tablet_manager.cc:1916] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.490676 17187 catalog_manager.cc:5697] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:35.507158 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ddf5e2cbdb748f7a7ed880493377874 with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:35.510989 18256 tablet_replica.cc:333] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:35.511986 18254 ts_tablet_manager.cc:1929] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.512262 18256 raft_consensus.cc:2243] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.512537 18254 log.cc:1199] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/9ff441a2f8cb4ea9b0e9a4bec55d843b
I20260709 12:09:35.513204 18256 raft_consensus.cc:2272] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.514561 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet 9ff441a2f8cb4ea9b0e9a4bec55d843b (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:35.516767 18256 ts_tablet_manager.cc:1916] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.530323 18256 ts_tablet_manager.cc:1929] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.530779 18256 log.cc:1199] T 4ddf5e2cbdb748f7a7ed880493377874 P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/4ddf5e2cbdb748f7a7ed880493377874
I20260709 12:09:35.533499 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet 4ddf5e2cbdb748f7a7ed880493377874 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:36.591737 17361 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:36.598181 17439 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:36.599321 17333 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d582e1abf9be42689682da4cee6206c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.600245 18258 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.601131 17285 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.602588 18244 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.613876 18244 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.614296 17284 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.616606 17433 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.629619 17190 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.630401 17361 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:36.639981 17433 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:36.640102 17333 consensus_peers.cc:597] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 623409527b5e49f3a95ae127569da2b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.640722 17284 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.641810 18209 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.643781 18258 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.659688 18244 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.660923 17285 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.663080 17433 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.680454 17285 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:36.680745 17187 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:36.689886 17258 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f4d0995911b4beb98abd9a7a508cddc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.692278 17360 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.692874 17433 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.694509 18250 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.695803 18223 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.706466 18270 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.709208 17362 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.727797 17439 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.730618 17284 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:36.735905 17187 catalog_manager.cc:5697] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:36.751459 17362 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.752159 17439 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.752803 18223 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.753636 18250 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:36.754554 17258 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff74c08559a64593bfe9cdc08a3b96d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.769318 18250 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.776099 17360 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.776105 17439 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:36.793746 17189 catalog_manager.cc:5697] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:37.024869 18276 ts_tablet_manager.cc:933] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:37.027206 18276 tablet_copy_client.cc:323] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:37.029268 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet 623409527b5e49f3a95ae127569da2b0 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:37.029861 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet 623409527b5e49f3a95ae127569da2b0 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-623409527b5e49f3a95ae127569da2b0
I20260709 12:09:37.039021 17377 tablet_copy_source_session.cc:215] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.047266 18276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623409527b5e49f3a95ae127569da2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.061913 18276 tablet_copy_client.cc:806] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.062682 18276 tablet_copy_client.cc:670] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.066649 18276 tablet_copy_client.cc:538] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.078142 18276 tablet_bootstrap.cc:492] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:37.097451 18276 tablet_bootstrap.cc:492] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.098481 18276 tablet_bootstrap.cc:492] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:37.099259 18276 ts_tablet_manager.cc:1403] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.021s	user 0.021s	sys 0.000s
I20260709 12:09:37.102308 18276 raft_consensus.cc:359] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:37.103204 18276 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:37.103940 18276 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:37.113893 18276 ts_tablet_manager.cc:1434] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:09:37.115916 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-623409527b5e49f3a95ae127569da2b0 received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:37.116379 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-623409527b5e49f3a95ae127569da2b0 on tablet 623409527b5e49f3a95ae127569da2b0 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:37.120801 18276 ts_tablet_manager.cc:933] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:37.138906 18276 tablet_copy_client.cc:323] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:37.140334 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet d582e1abf9be42689682da4cee6206c8 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:37.140769 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet d582e1abf9be42689682da4cee6206c8 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-d582e1abf9be42689682da4cee6206c8
I20260709 12:09:37.145905 17377 tablet_copy_source_session.cc:215] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.148046 18280 ts_tablet_manager.cc:933] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:37.150785 18280 tablet_copy_client.cc:323] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:37.150972 18276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d582e1abf9be42689682da4cee6206c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.152570 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet 6f4d0995911b4beb98abd9a7a508cddc from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:37.153103 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet 6f4d0995911b4beb98abd9a7a508cddc from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-6f4d0995911b4beb98abd9a7a508cddc
I20260709 12:09:37.161079 17302 tablet_copy_source_session.cc:215] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.167819 18280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4d0995911b4beb98abd9a7a508cddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.172446 18276 tablet_copy_client.cc:806] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.173162 18276 tablet_copy_client.cc:670] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.177205 18276 tablet_copy_client.cc:538] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.184469 18280 tablet_copy_client.cc:806] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.185128 18280 tablet_copy_client.cc:670] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.188360 18280 tablet_copy_client.cc:538] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.189294 18276 tablet_bootstrap.cc:492] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:37.198202 18280 tablet_bootstrap.cc:492] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:37.226693 18280 tablet_bootstrap.cc:492] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.227522 18280 tablet_bootstrap.cc:492] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:37.228358 18280 ts_tablet_manager.cc:1403] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.015s
I20260709 12:09:37.231174 18276 tablet_bootstrap.cc:492] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.232105 18280 raft_consensus.cc:359] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:37.233036 18280 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:37.233673 18280 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:37.234227 18276 tablet_bootstrap.cc:492] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:37.235157 18276 ts_tablet_manager.cc:1403] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.047s	user 0.027s	sys 0.011s
I20260709 12:09:37.236460 18280 ts_tablet_manager.cc:1434] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:37.238873 18276 raft_consensus.cc:359] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:37.239854 18276 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:37.240528 18276 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:37.241258 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-6f4d0995911b4beb98abd9a7a508cddc received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:37.241715 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-6f4d0995911b4beb98abd9a7a508cddc on tablet 6f4d0995911b4beb98abd9a7a508cddc with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:37.243337 18276 ts_tablet_manager.cc:1434] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:09:37.246378 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-d582e1abf9be42689682da4cee6206c8 received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:37.246809 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-d582e1abf9be42689682da4cee6206c8 on tablet d582e1abf9be42689682da4cee6206c8 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:37.272604 18276 ts_tablet_manager.cc:933] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:37.281828 18276 tablet_copy_client.cc:323] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:37.283335 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet ff74c08559a64593bfe9cdc08a3b96d1 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:37.283900 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet ff74c08559a64593bfe9cdc08a3b96d1 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-ff74c08559a64593bfe9cdc08a3b96d1
I20260709 12:09:37.295437 17302 tablet_copy_source_session.cc:215] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.298342 18276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff74c08559a64593bfe9cdc08a3b96d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.319979 18276 tablet_copy_client.cc:806] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.320752 18276 tablet_copy_client.cc:670] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.329401 18276 tablet_copy_client.cc:538] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.340364 18276 tablet_bootstrap.cc:492] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:37.357019 18276 tablet_bootstrap.cc:492] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.357738 18276 tablet_bootstrap.cc:492] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:37.358294 18276 ts_tablet_manager.cc:1403] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.006s
I20260709 12:09:37.360541 18276 raft_consensus.cc:359] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:37.361374 18276 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:37.362042 18276 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:37.364189 18276 ts_tablet_manager.cc:1434] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:37.366366 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-ff74c08559a64593bfe9cdc08a3b96d1 received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:37.366789 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-ff74c08559a64593bfe9cdc08a3b96d1 on tablet ff74c08559a64593bfe9cdc08a3b96d1 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:37.447055 18013 raft_consensus.cc:1217] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.504004 18013 raft_consensus.cc:1217] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.749191 18013 raft_consensus.cc:1217] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.885057 18013 raft_consensus.cc:1217] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.907907 18286 raft_consensus.cc:1064] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:37.911187 18286 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:37.923178 18013 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.923419 17433 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.923822 17285 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.924912 18258 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.934202 18244 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:37.943348 18286 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.951653 18015 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:37.950320 18244 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:37.971695 17187 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:37.973227 17433 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:37.998322 17285 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.031364 17362 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:38.036214 18015 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.036866 17433 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.038890 18292 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.041467 18291 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.047825 18286 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.049715 18013 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.059316 18258 raft_consensus.cc:1064] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:38.062192 18258 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:38.065711 17433 raft_consensus.cc:2955] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.070393 17187 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.079290 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 623409527b5e49f3a95ae127569da2b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.099882 18013 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.100353 17284 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.101891 18298 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.104038 18244 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.110839 17433 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.117106 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet 623409527b5e49f3a95ae127569da2b0 with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:38.119699 18303 tablet_replica.cc:333] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:38.120852 18303 raft_consensus.cc:2243] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.121397 18244 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.121670 18303 raft_consensus.cc:2272] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.124594 18244 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.127348 17284 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.136691 18303 ts_tablet_manager.cc:1916] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.146816 17190 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.159806 18303 ts_tablet_manager.cc:1929] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.164536 18303 log.cc:1199] T 623409527b5e49f3a95ae127569da2b0 P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/623409527b5e49f3a95ae127569da2b0
I20260709 12:09:38.167173 17439 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.170882 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet 623409527b5e49f3a95ae127569da2b0 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:38.173679 18013 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.197220 17362 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:38.204782 17284 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.208070 18244 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:38.219561 18301 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.222666 18013 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.225036 18298 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.221333 17284 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.239353 18223 raft_consensus.cc:1064] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:38.240834 18015 raft_consensus.cc:2955] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.242220 18223 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:38.255316 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d582e1abf9be42689682da4cee6206c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.256799 17187 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.274405 17439 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.278702 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet d582e1abf9be42689682da4cee6206c8 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:38.278568 18250 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.286892 17362 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.289288 18308 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.290483 18015 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.294938 18307 tablet_replica.cc:333] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:38.296110 18307 raft_consensus.cc:2243] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.297000 18307 raft_consensus.cc:2272] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.299842 18223 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.312958 18307 ts_tablet_manager.cc:1916] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.353048 18270 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.354408 18307 ts_tablet_manager.cc:1929] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.354862 18307 log.cc:1199] T d582e1abf9be42689682da4cee6206c8 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/d582e1abf9be42689682da4cee6206c8
I20260709 12:09:38.357580 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet d582e1abf9be42689682da4cee6206c8 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:38.358515 17439 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.358798 17360 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.379179 17187 catalog_manager.cc:5697] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.382925 18308 raft_consensus.cc:1064] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:38.386449 18308 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:38.392355 18015 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.399693 17284 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:38.410327 18013 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.410526 17433 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.415269 18223 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.424655 18270 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:38.456455 18013 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.470778 17362 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.469906 18270 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.468434 18308 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:09:38.484354 18223 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.501421 17189 catalog_manager.cc:5697] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:38.523499 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f4d0995911b4beb98abd9a7a508cddc with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
W20260709 12:09:38.538878 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 69856.6us
I20260709 12:09:38.547638 17433 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.553118 18014 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:09:38.553874 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 81410.4us
I20260709 12:09:38.556334 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f4d0995911b4beb98abd9a7a508cddc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.562088 17433 raft_consensus.cc:2955] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.564496 18315 tablet_replica.cc:333] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:38.569507 18223 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.586473 18315 raft_consensus.cc:2243] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.587375 18315 raft_consensus.cc:2272] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.589244 18223 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.592769 17433 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.607280 17362 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.617344 18315 ts_tablet_manager.cc:1916] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.653676 17189 catalog_manager.cc:5697] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.656682 18013 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.673337 18315 ts_tablet_manager.cc:1929] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.673941 18315 log.cc:1199] T 6f4d0995911b4beb98abd9a7a508cddc P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/6f4d0995911b4beb98abd9a7a508cddc
I20260709 12:09:38.676386 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet 6f4d0995911b4beb98abd9a7a508cddc (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:38.683787 17284 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:38.688937 17362 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.690456 18223 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.694198 18013 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.695737 18223 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:38.699384 18313 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.701363 17361 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.702868 18014 raft_consensus.cc:2955] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.716216 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff74c08559a64593bfe9cdc08a3b96d1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.728699 17190 catalog_manager.cc:5697] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:38.742080 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet ff74c08559a64593bfe9cdc08a3b96d1 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:38.743549 18307 tablet_replica.cc:333] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:38.745200 18307 raft_consensus.cc:2243] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.745980 18307 raft_consensus.cc:2272] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.748597 18307 ts_tablet_manager.cc:1916] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.765740 18307 ts_tablet_manager.cc:1929] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.766296 18307 log.cc:1199] T ff74c08559a64593bfe9cdc08a3b96d1 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/ff74c08559a64593bfe9cdc08a3b96d1
I20260709 12:09:38.767918 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet ff74c08559a64593bfe9cdc08a3b96d1 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:39.810534 17433 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:09:39.817289 17407 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 119706da80854a2680f098d29fac4c43. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.817682 17285 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.817706 17361 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.819345 18190 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.820144 18185 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.827586 18190 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:39.829734 17362 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:39.838335 17285 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:39.843582 17187 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.845160 17433 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:39.853602 17362 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:39.854408 17407 consensus_peers.cc:597] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9367e72dd7c24f7e8aa4d479a069ed0e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.855468 17285 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.855960 18185 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.879249 18185 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:39.884251 18320 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:39.901721 17362 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:39.922288 17283 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:39.923967 17361 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:39.935967 17190 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:39.965133 17333 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d769dc29730489bb1bc366ea38bf391. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.965507 17439 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.966879 18298 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.967199 17283 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.968863 18298 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.979315 18298 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:39.981884 17439 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:39.982266 17283 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:39.999310 17187 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.003854 17361 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:40.016686 17283 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:40.017830 17333 consensus_peers.cc:597] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8386bc0b5fc7467d87ca1ca69464e42e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.017927 18244 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:40.021121 17439 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.022476 18244 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.028825 18336 raft_consensus.cc:2955] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:40.031419 17283 raft_consensus.cc:2955] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:40.042160 17439 raft_consensus.cc:2955] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:40.050063 17189 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.291927 18343 ts_tablet_manager.cc:933] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:40.294844 18343 tablet_copy_client.cc:323] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:40.296775 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 119706da80854a2680f098d29fac4c43 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:40.297358 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 119706da80854a2680f098d29fac4c43 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-119706da80854a2680f098d29fac4c43
I20260709 12:09:40.305606 17451 tablet_copy_source_session.cc:215] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.310021 18343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119706da80854a2680f098d29fac4c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.330056 18343 tablet_copy_client.cc:806] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.330775 18343 tablet_copy_client.cc:670] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.335587 18343 tablet_copy_client.cc:538] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.345510 18343 tablet_bootstrap.cc:492] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:40.371062 18346 ts_tablet_manager.cc:933] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:40.371838 18343 tablet_bootstrap.cc:492] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.372852 18343 tablet_bootstrap.cc:492] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:40.375100 18343 ts_tablet_manager.cc:1403] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.003s
I20260709 12:09:40.378418 18343 raft_consensus.cc:359] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:40.379339 18343 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:40.380036 18343 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:40.383599 18343 ts_tablet_manager.cc:1434] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:09:40.391469 18346 tablet_copy_client.cc:323] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:40.391453 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-119706da80854a2680f098d29fac4c43 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:40.392653 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-119706da80854a2680f098d29fac4c43 on tablet 119706da80854a2680f098d29fac4c43 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:40.393833 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet 5d769dc29730489bb1bc366ea38bf391 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:40.394434 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet 5d769dc29730489bb1bc366ea38bf391 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-5d769dc29730489bb1bc366ea38bf391
I20260709 12:09:40.402529 17377 tablet_copy_source_session.cc:215] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.406090 18346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d769dc29730489bb1bc366ea38bf391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.427364 18346 tablet_copy_client.cc:806] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.428077 18346 tablet_copy_client.cc:670] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.429576 18343 ts_tablet_manager.cc:933] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:40.445811 18343 tablet_copy_client.cc:323] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:40.447608 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 9367e72dd7c24f7e8aa4d479a069ed0e from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:40.448174 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 9367e72dd7c24f7e8aa4d479a069ed0e from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-9367e72dd7c24f7e8aa4d479a069ed0e
I20260709 12:09:40.453740 18346 tablet_copy_client.cc:538] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.460642 17451 tablet_copy_source_session.cc:215] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.463981 18346 tablet_bootstrap.cc:492] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:40.464459 18343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9367e72dd7c24f7e8aa4d479a069ed0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.485283 18343 tablet_copy_client.cc:806] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.486029 18343 tablet_copy_client.cc:670] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.496402 18343 tablet_copy_client.cc:538] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.503811 18346 tablet_bootstrap.cc:492] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.504923 18346 tablet_bootstrap.cc:492] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:40.505473 18343 tablet_bootstrap.cc:492] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:40.505944 18346 ts_tablet_manager.cc:1403] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.004s
I20260709 12:09:40.509477 18346 raft_consensus.cc:359] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:40.510448 18346 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:40.511161 18346 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:40.523542 18346 ts_tablet_manager.cc:1434] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:09:40.527879 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-5d769dc29730489bb1bc366ea38bf391 received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:40.528367 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-5d769dc29730489bb1bc366ea38bf391 on tablet 5d769dc29730489bb1bc366ea38bf391 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:40.535691 18343 tablet_bootstrap.cc:492] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.536446 18343 tablet_bootstrap.cc:492] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:40.538035 18343 ts_tablet_manager.cc:1403] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.005s
I20260709 12:09:40.541657 18343 raft_consensus.cc:359] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:40.542440 18343 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:40.543035 18343 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:40.549906 18343 ts_tablet_manager.cc:1434] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:09:40.551666 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-9367e72dd7c24f7e8aa4d479a069ed0e received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:40.552100 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-9367e72dd7c24f7e8aa4d479a069ed0e on tablet 9367e72dd7c24f7e8aa4d479a069ed0e with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:40.639323 18343 ts_tablet_manager.cc:933] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:40.640911 18343 tablet_copy_client.cc:323] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:40.642325 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet 8386bc0b5fc7467d87ca1ca69464e42e from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:40.642882 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet 8386bc0b5fc7467d87ca1ca69464e42e from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-8386bc0b5fc7467d87ca1ca69464e42e
I20260709 12:09:40.650748 17377 tablet_copy_source_session.cc:215] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.653928 18343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8386bc0b5fc7467d87ca1ca69464e42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.671306 18343 tablet_copy_client.cc:806] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.672017 18343 tablet_copy_client.cc:670] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.676826 18343 tablet_copy_client.cc:538] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.686249 18343 tablet_bootstrap.cc:492] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:40.731392 18343 tablet_bootstrap.cc:492] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.732332 18343 tablet_bootstrap.cc:492] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:40.733022 18343 ts_tablet_manager.cc:1403] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.014s
I20260709 12:09:40.735294 18343 raft_consensus.cc:359] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:40.735988 18343 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:40.736467 18343 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:40.740159 18343 ts_tablet_manager.cc:1434] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:40.741607 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-8386bc0b5fc7467d87ca1ca69464e42e received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:40.741951 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-8386bc0b5fc7467d87ca1ca69464e42e on tablet 8386bc0b5fc7467d87ca1ca69464e42e with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:40.757447 18013 raft_consensus.cc:1217] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:40.904841 18013 raft_consensus.cc:1217] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.031539 18013 raft_consensus.cc:1217] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.048134 18013 raft_consensus.cc:1217] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.346649 18342 raft_consensus.cc:1064] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:41.349397 18342 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:41.357865 18013 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.359652 18342 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.359958 17433 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.360078 17283 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.361542 18355 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.362411 18354 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.382454 18354 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.384464 18013 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.395911 17433 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.396741 17283 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.408310 17187 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:41.416716 18330 raft_consensus.cc:1064] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:41.419206 18330 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:41.435335 17362 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.435719 18013 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.436985 18356 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.439877 18190 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.444453 17283 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.445771 18190 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.447865 18333 raft_consensus.cc:1064] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:41.450476 18333 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:41.462550 18342 raft_consensus.cc:1064] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:41.464268 18013 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.465106 18342 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:41.466202 18330 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.469144 17361 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:41.470734 17360 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.472810 18357 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.486385 18013 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.489354 18354 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:41.501513 18298 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.503278 17283 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.507432 18355 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:41.510592 18012 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.535748 18015 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.537297 18355 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.539098 17433 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.541687 18355 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.545857 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d769dc29730489bb1bc366ea38bf391 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:41.548723 18377 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.550309 18013 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.559486 17283 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.564783 18354 raft_consensus.cc:2955] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.573009 17187 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:41.573644 18015 raft_consensus.cc:2955] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.577458 17189 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:41.586639 17361 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.586848 18357 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.598764 18013 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.615517 17362 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.620570 17187 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:41.616451 17189 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:41.638859 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d769dc29730489bb1bc366ea38bf391 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:41.642678 18330 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.654376 17433 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:41.659806 18015 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.661510 18372 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:41.664379 17439 raft_consensus.cc:2955] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.667315 17283 raft_consensus.cc:2955] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.668984 17362 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:41.673002 17284 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.674333 18382 tablet_replica.cc:333] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:41.675462 18382 raft_consensus.cc:2243] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:41.676148 18382 raft_consensus.cc:2272] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:41.676586 18372 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.679338 18382 ts_tablet_manager.cc:1916] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:41.679441 18015 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.685798 18014 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.687397 18354 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:41.691339 17362 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.699291 18354 raft_consensus.cc:2955] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.703872 17290 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.709973 17441 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:41.706554 17190 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.724958 17441 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.725868 18333 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:41.726758 18014 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.728528 18357 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:41.714296 18013 raft_consensus.cc:2955] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.742821 17285 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.747062 18377 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.748315 17287 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.756722 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8386bc0b5fc7467d87ca1ca69464e42e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:41.769623 18298 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:41.761807 18015 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.778232 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9367e72dd7c24f7e8aa4d479a069ed0e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:41.768711 17188 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:41.781730 17362 raft_consensus.cc:2955] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.798813 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 119706da80854a2680f098d29fac4c43 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:41.806710 17432 raft_consensus.cc:2955] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.798573 17188 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.825872 18382 ts_tablet_manager.cc:1929] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:41.826366 18382 log.cc:1199] T 5d769dc29730489bb1bc366ea38bf391 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/5d769dc29730489bb1bc366ea38bf391
I20260709 12:09:41.827539 18190 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:41.845785 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet 119706da80854a2680f098d29fac4c43 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:41.853874 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet 9367e72dd7c24f7e8aa4d479a069ed0e with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:41.854359 17281 tablet_service.cc:1558] Processing DeleteTablet for tablet 8386bc0b5fc7467d87ca1ca69464e42e with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:41.856209 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet 5d769dc29730489bb1bc366ea38bf391 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:41.864599 18385 tablet_replica.cc:333] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:41.864238 17283 raft_consensus.cc:2955] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:41.867548 18385 raft_consensus.cc:2243] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:41.868299 18385 raft_consensus.cc:2272] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:41.870008 18386 tablet_replica.cc:333] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:41.871201 18386 raft_consensus.cc:2243] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:41.871944 18386 raft_consensus.cc:2272] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:41.873731 18385 ts_tablet_manager.cc:1916] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:41.876266 18386 ts_tablet_manager.cc:1916] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:41.898072 18385 ts_tablet_manager.cc:1929] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:41.898579 18385 log.cc:1199] T 119706da80854a2680f098d29fac4c43 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/119706da80854a2680f098d29fac4c43
I20260709 12:09:41.898605 18386 ts_tablet_manager.cc:1929] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:41.899181 18386 log.cc:1199] T 9367e72dd7c24f7e8aa4d479a069ed0e P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/9367e72dd7c24f7e8aa4d479a069ed0e
I20260709 12:09:41.900425 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet 119706da80854a2680f098d29fac4c43 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:41.903378 18386 tablet_replica.cc:333] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:41.904325 18386 raft_consensus.cc:2243] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:41.904819 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet 9367e72dd7c24f7e8aa4d479a069ed0e (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:41.904975 18386 raft_consensus.cc:2272] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:41.907461 18386 ts_tablet_manager.cc:1916] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:41.918982 18386 ts_tablet_manager.cc:1929] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:09:41.919291 18386 log.cc:1199] T 8386bc0b5fc7467d87ca1ca69464e42e P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/8386bc0b5fc7467d87ca1ca69464e42e
I20260709 12:09:41.920588 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet 8386bc0b5fc7467d87ca1ca69464e42e (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:42.901830 17439 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:42.907651 17285 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:42.908007 17407 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4466b54543584a9898797997087d10f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.908373 17362 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.910023 18377 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.910890 18357 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.928485 18357 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:42.933619 17362 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:42.934835 17290 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:42.948340 17362 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:42.950907 17190 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:42.961553 17439 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:09:42.963603 17333 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9955d24ad7243689a5a438424f992e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.965473 18355 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.968277 17283 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:42.970280 18354 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.977341 18355 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:42.984586 17432 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:42.993443 17283 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:43.009399 17432 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.023099 17187 catalog_manager.cc:5697] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 3, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:43.029104 17407 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bbcd6d92bbd4175a2f8233eb40726ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:43.030444 17283 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.029760 17362 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.032346 18357 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.033232 18377 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.047603 18356 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:43.055347 17362 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:43.056255 17283 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:43.066802 17432 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.072831 17187 catalog_manager.cc:5697] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:43.076294 17361 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:43.076716 17407 consensus_peers.cc:597] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3657462e03f42ac95c71bed480ca6a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:43.078135 18356 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.080412 17283 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.081872 18356 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.095496 18357 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:43.131513 17361 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:43.217466 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 53343.8us
I20260709 12:09:43.239283 17188 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:43.352324 17283 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:43.416965 18417 ts_tablet_manager.cc:933] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:43.419668 18417 tablet_copy_client.cc:323] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:43.422188 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 4466b54543584a9898797997087d10f1 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:43.422897 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 4466b54543584a9898797997087d10f1 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-4466b54543584a9898797997087d10f1
I20260709 12:09:43.432392 17451 tablet_copy_source_session.cc:215] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:43.436367 18417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4466b54543584a9898797997087d10f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:43.454079 18417 tablet_copy_client.cc:806] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:43.454869 18417 tablet_copy_client.cc:670] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:43.459277 18417 tablet_copy_client.cc:538] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:43.467296 18419 ts_tablet_manager.cc:933] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:43.469194 18419 tablet_copy_client.cc:323] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:43.469622 18417 tablet_bootstrap.cc:492] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:43.471074 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet a9955d24ad7243689a5a438424f992e9 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:43.471669 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet a9955d24ad7243689a5a438424f992e9 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-a9955d24ad7243689a5a438424f992e9
I20260709 12:09:43.479820 17377 tablet_copy_source_session.cc:215] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:43.485716 18419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9955d24ad7243689a5a438424f992e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:43.494364 18417 tablet_bootstrap.cc:492] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:43.495505 18417 tablet_bootstrap.cc:492] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:43.496304 18417 ts_tablet_manager.cc:1403] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.008s
I20260709 12:09:43.499855 18417 raft_consensus.cc:359] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.500797 18417 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:43.501572 18417 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.510156 18417 ts_tablet_manager.cc:1434] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:09:43.511139 18419 tablet_copy_client.cc:806] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:43.511797 18419 tablet_copy_client.cc:670] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:43.512050 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4466b54543584a9898797997087d10f1 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:43.512554 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4466b54543584a9898797997087d10f1 on tablet 4466b54543584a9898797997087d10f1 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:43.516770 18419 tablet_copy_client.cc:538] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:43.527877 18419 tablet_bootstrap.cc:492] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:43.532431 18417 ts_tablet_manager.cc:933] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:43.542798 18417 tablet_copy_client.cc:323] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:43.544718 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet b3657462e03f42ac95c71bed480ca6a6 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:43.545346 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet b3657462e03f42ac95c71bed480ca6a6 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-b3657462e03f42ac95c71bed480ca6a6
I20260709 12:09:43.549505 18419 tablet_bootstrap.cc:492] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:43.550361 18419 tablet_bootstrap.cc:492] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:43.550925 18419 ts_tablet_manager.cc:1403] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.002s
I20260709 12:09:43.553972 17451 tablet_copy_source_session.cc:215] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:43.553987 18419 raft_consensus.cc:359] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.555240 18419 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:43.555958 18419 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.584718 18419 ts_tablet_manager.cc:1434] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.034s	user 0.020s	sys 0.002s
I20260709 12:09:43.586863 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-a9955d24ad7243689a5a438424f992e9 received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:43.587368 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-a9955d24ad7243689a5a438424f992e9 on tablet a9955d24ad7243689a5a438424f992e9 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:43.604404 18417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3657462e03f42ac95c71bed480ca6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:43.627231 18419 ts_tablet_manager.cc:933] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:43.627812 18417 tablet_copy_client.cc:806] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:43.628516 18417 tablet_copy_client.cc:670] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:43.632917 18417 tablet_copy_client.cc:538] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:43.636663 18419 tablet_copy_client.cc:323] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:43.638531 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 6bbcd6d92bbd4175a2f8233eb40726ad from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:43.639083 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 6bbcd6d92bbd4175a2f8233eb40726ad from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-6bbcd6d92bbd4175a2f8233eb40726ad
I20260709 12:09:43.647131 17451 tablet_copy_source_session.cc:215] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:43.648675 18417 tablet_bootstrap.cc:492] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:43.650408 18419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbcd6d92bbd4175a2f8233eb40726ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:43.667778 18419 tablet_copy_client.cc:806] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:43.668426 18419 tablet_copy_client.cc:670] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:43.670804 18417 tablet_bootstrap.cc:492] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:43.671759 18417 tablet_bootstrap.cc:492] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:43.672401 18417 ts_tablet_manager.cc:1403] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.005s
I20260709 12:09:43.672521 18419 tablet_copy_client.cc:538] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:43.675607 18417 raft_consensus.cc:359] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.676512 18417 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:43.677209 18417 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.680058 18417 ts_tablet_manager.cc:1434] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:43.684878 18419 tablet_bootstrap.cc:492] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:43.686080 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-b3657462e03f42ac95c71bed480ca6a6 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:43.686609 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-b3657462e03f42ac95c71bed480ca6a6 on tablet b3657462e03f42ac95c71bed480ca6a6 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:43.713342 18419 tablet_bootstrap.cc:492] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:43.714154 18419 tablet_bootstrap.cc:492] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:43.714780 18419 ts_tablet_manager.cc:1403] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.007s
I20260709 12:09:43.717067 18419 raft_consensus.cc:359] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.717674 18419 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:43.718221 18419 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:43.720530 18419 ts_tablet_manager.cc:1434] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:43.724797 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-6bbcd6d92bbd4175a2f8233eb40726ad received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:43.725234 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-6bbcd6d92bbd4175a2f8233eb40726ad on tablet 6bbcd6d92bbd4175a2f8233eb40726ad with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:43.929442 18015 raft_consensus.cc:1217] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:44.025849 18013 raft_consensus.cc:1217] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:44.101740 18013 raft_consensus.cc:1217] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:44.126878 18013 raft_consensus.cc:1217] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:44.480378 18398 raft_consensus.cc:1064] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:44.483204 18398 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:44.489471 18013 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:44.490788 17432 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:44.491408 17290 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:44.491214 18355 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:44.492687 18398 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.493611 18397 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.515890 18355 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.519594 18013 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.520311 17287 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.529610 18415 raft_consensus.cc:1064] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:44.532459 18415 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:44.535288 17432 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.543879 17188 catalog_manager.cc:5697] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 3 to 4, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.547720 18357 raft_consensus.cc:1064] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:44.550463 18015 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.556701 18357 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:44.557233 17290 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.552186 17360 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.558938 18428 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:44.564111 18428 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:44.570520 18416 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:44.610591 18415 raft_consensus.cc:1064] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:44.617055 18014 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.619140 17362 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.621193 18416 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:44.626192 18428 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:44.637910 18415 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:09:44.644286 18437 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:09:44.647672 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 59464.3us
I20260709 12:09:44.656450 17290 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.657698 17359 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.658838 18357 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.660642 18436 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:44.672989 18428 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.684896 18014 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.711916 18014 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.723623 17359 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.736454 17360 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.737447 18014 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.740351 17283 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.744246 18446 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:09:44.747409 17284 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:44.748409 18415 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:44.751889 17290 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.756670 18447 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:44.788591 18452 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.792392 17284 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.797713 17359 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:44.804061 17360 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.814571 17283 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:44.818451 18438 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:44.819528 18014 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:44.822638 18438 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:44.825667 18015 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.828066 18397 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.812408 17189 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.830694 17189 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.835595 17290 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.838773 18013 raft_consensus.cc:2955] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.851276 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a9955d24ad7243689a5a438424f992e9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.887364 17190 catalog_manager.cc:5697] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:44.907096 17189 catalog_manager.cc:5697] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 4 to 5, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.914659 17432 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:44.914819 17439 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:44.920663 18015 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.921150 18013 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.922791 18452 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.924131 17359 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.922969 18415 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.926849 18448 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:44.933106 18445 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.939025 18013 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.942185 18446 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.953879 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet a9955d24ad7243689a5a438424f992e9 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:44.959704 17360 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.970814 17284 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.975241 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3657462e03f42ac95c71bed480ca6a6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.991647 18415 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.996958 18012 raft_consensus.cc:2955] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:44.996934 17290 raft_consensus.cc:2955] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:45.007071 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bbcd6d92bbd4175a2f8233eb40726ad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.007318 17189 catalog_manager.cc:5697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:45.021728 18458 tablet_replica.cc:333] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:44.994952 17188 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:45.041426 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bbcd6d92bbd4175a2f8233eb40726ad with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:45.042558 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet b3657462e03f42ac95c71bed480ca6a6 with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:45.045491 18461 tablet_replica.cc:333] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:45.048189 18460 tablet_replica.cc:333] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:45.049185 18458 raft_consensus.cc:2243] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.049372 18461 raft_consensus.cc:2243] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.050704 18460 raft_consensus.cc:2243] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.051405 18460 raft_consensus.cc:2272] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.051620 18458 raft_consensus.cc:2272] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.050877 18461 raft_consensus.cc:2272] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.054950 18460 ts_tablet_manager.cc:1916] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.073838 18461 ts_tablet_manager.cc:1916] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.075320 18458 ts_tablet_manager.cc:1916] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.083144 18460 ts_tablet_manager.cc:1929] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.083727 18460 log.cc:1199] T 6bbcd6d92bbd4175a2f8233eb40726ad P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/6bbcd6d92bbd4175a2f8233eb40726ad
I20260709 12:09:45.086563 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet 6bbcd6d92bbd4175a2f8233eb40726ad (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:45.097893 18461 ts_tablet_manager.cc:1929] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.098531 18461 log.cc:1199] T b3657462e03f42ac95c71bed480ca6a6 P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/b3657462e03f42ac95c71bed480ca6a6
I20260709 12:09:45.101380 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet b3657462e03f42ac95c71bed480ca6a6 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:45.121271 18458 ts_tablet_manager.cc:1929] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:45.121798 18458 log.cc:1199] T a9955d24ad7243689a5a438424f992e9 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/a9955d24ad7243689a5a438424f992e9
I20260709 12:09:45.123716 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet a9955d24ad7243689a5a438424f992e9 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:45.249686 17432 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:45.255733 18012 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.257665 18446 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.258051 17284 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.259796 18445 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.271926 18448 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:45.280521 18012 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:45.282508 17284 raft_consensus.cc:2955] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:45.287868 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4466b54543584a9898797997087d10f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.297834 17189 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.320047 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet 4466b54543584a9898797997087d10f1 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:45.321054 18460 tablet_replica.cc:333] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:45.322130 18460 raft_consensus.cc:2243] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.323012 18460 raft_consensus.cc:2272] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.326555 18460 ts_tablet_manager.cc:1916] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.342308 18460 ts_tablet_manager.cc:1929] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.342625 18460 log.cc:1199] T 4466b54543584a9898797997087d10f1 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/4466b54543584a9898797997087d10f1
I20260709 12:09:45.345034 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet 4466b54543584a9898797997087d10f1 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:45.924628 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:45.977229 17439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "119706da80854a2680f098d29fac4c43"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:45.977777 17439 raft_consensus.cc:606] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:45.980057 17439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:45.980511 17439 raft_consensus.cc:606] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:45.992586 17359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:45.993130 17359 raft_consensus.cc:606] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:45.995965 17439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:45.996420 17439 raft_consensus.cc:606] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:45.998646 17439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:45.999045 17439 raft_consensus.cc:606] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:46.000087 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:46.001688 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:46.002766 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:46.034264 18415 raft_consensus.cc:993] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:46.034932 18415 raft_consensus.cc:1081] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:46.036705 18012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52246
I20260709 12:09:46.037312 18012 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:46.037680 18012 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.053249 18415 raft_consensus.cc:993] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:46.053807 18448 raft_consensus.cc:1081] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:46.054402 18012 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:46.055475 18013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52246
I20260709 12:09:46.055934 18013 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:46.056224 18013 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.057828 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:46.058614 18012 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:46.058897 17359 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.061309 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:46.061896 17439 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:46.062217 17439 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:46.062386 18013 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:46.062949 17439 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:46.064145 17439 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.065007 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:46.065457 17360 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.066474 17359 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:46.066845 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:46.067289 17432 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:46.067518 17432 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:46.068109 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:46.068287 17432 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:46.069504 17432 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.069839 18467 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:46.070799 17439 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:46.076110 17360 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:46.076990 18467 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:46.077675 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:46.078414 18467 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:46.080523 18013 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:46.083112 18468 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:46.086534 18468 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:46.090462 17432 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:46.087791 18468 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:46.105399 17187 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.124363 17187 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.127174 18415 raft_consensus.cc:993] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:46.127708 18448 raft_consensus.cc:1081] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:46.129187 18013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "119706da80854a2680f098d29fac4c43"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52246
I20260709 12:09:46.129734 18013 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:46.130084 18013 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.136227 18013 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:46.137816 18013 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:46.138700 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:46.138705 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:46.139420 17432 raft_consensus.cc:3055] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:46.139499 17290 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.139714 17432 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:46.140411 17432 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:46.141419 17432 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.144795 17290 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:46.146034 17980 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:09:46.146281 17432 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:46.146853 18468 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:46.147305 18468 raft_consensus.cc:697] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:46.148095 18468 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:46.156680 17187 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.335625 18446 raft_consensus.cc:993] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:46.336175 18446 raft_consensus.cc:1081] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:46.337931 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48992
I20260709 12:09:46.338467 17360 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:46.338769 17360 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.344847 17360 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:46.346979 17360 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:46.348052 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:46.348248 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:46.348737 17439 raft_consensus.cc:3055] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:46.349107 17439 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:46.349164 17290 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.349992 17439 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:46.351287 17439 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.356036 17290 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:46.358387 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:46.359370 18462 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:46.359882 18462 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:46.360821 18462 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:46.363592 17439 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:46.377921 17187 catalog_manager.cc:5697] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:46.393345 18397 raft_consensus.cc:993] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:46.393803 18462 raft_consensus.cc:1081] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:46.395367 17290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:09:46.395839 17290 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:46.396095 17290 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.405296 17290 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:46.408952 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:46.409651 17360 raft_consensus.cc:3055] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:46.409027 17439 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:46.408385 17290 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:46.409914 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:46.409915 17360 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:46.410542 17432 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.410961 17360 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:46.411774 17360 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.417805 17359 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.418196 17432 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:46.419224 17360 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:46.419760 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:46.420020 18415 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.420626 18466 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:46.421103 18466 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:46.421788 17290 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:46.423559 17407 consensus_peers.cc:597] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd0b7d359bb7400c8b795e1b6f9dd1a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:46.423962 18446 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.422032 18466 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:46.432514 18446 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.460132 17360 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.467185 17187 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:46.472461 17284 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:46.473047 17189 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:46.489032 17432 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.494483 18441 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.494359 17283 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.494858 17359 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.498163 18408 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:46.503010 17258 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7c3705a9e0e457898a7061b4170a8a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:46.536559 17432 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:46.538048 18468 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:46.543231 18441 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.548383 17441 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.556686 17359 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.560108 17360 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:46.570641 18468 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:46.571410 17441 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:46.575820 17187 catalog_manager.cc:5697] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:46.597958 17407 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8789c06ba7714e709d794ce12c4141d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:46.598593 17283 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.600313 18446 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.602887 17359 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.604458 18446 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.619891 18448 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.623270 17360 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.626888 17283 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.648106 17441 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:46.655143 17360 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:46.654615 17189 catalog_manager.cc:5697] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.655710 17432 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:46.656476 18468 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:46.663611 18467 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:46.668144 17283 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:46.670872 18468 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:46.680092 17439 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:46.683034 18468 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:09:46.729913 17407 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4198acb44a394602a442737d55022d72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:46.730720 17362 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.735150 18446 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.739503 17290 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.742266 18446 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.750006 18480 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.751888 17362 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.775769 17290 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.786130 17190 catalog_manager.cc:5697] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:46.797016 17290 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:46.798363 18397 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.813017 17439 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:46.814920 18462 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.941666 17359 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:46.943181 18441 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.971832 17441 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:46.975664 18466 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.004958 18508 ts_tablet_manager.cc:933] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:47.018175 18508 tablet_copy_client.cc:323] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:47.021107 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:47.021682 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet bd0b7d359bb7400c8b795e1b6f9dd1a2 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-bd0b7d359bb7400c8b795e1b6f9dd1a2
I20260709 12:09:47.029784 17451 tablet_copy_source_session.cc:215] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.033238 18508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.044356 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:47.051173 18508 tablet_copy_client.cc:806] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.051914 18508 tablet_copy_client.cc:670] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.056670 18508 tablet_copy_client.cc:538] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.075809 18508 tablet_bootstrap.cc:492] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:47.095430 18510 ts_tablet_manager.cc:933] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:47.104715 18508 tablet_bootstrap.cc:492] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.105862 18508 tablet_bootstrap.cc:492] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:47.106673 18508 ts_tablet_manager.cc:1403] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.031s	user 0.026s	sys 0.003s
I20260709 12:09:47.109853 18508 raft_consensus.cc:359] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:47.110878 18508 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:47.111613 18508 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:47.123149 18508 ts_tablet_manager.cc:1434] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:47.128365 17451 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-bd0b7d359bb7400c8b795e1b6f9dd1a2 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:47.128870 17451 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-bd0b7d359bb7400c8b795e1b6f9dd1a2 on tablet bd0b7d359bb7400c8b795e1b6f9dd1a2 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:47.128412 18514 ts_tablet_manager.cc:933] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:47.136181 18510 tablet_copy_client.cc:323] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:47.138554 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet f7c3705a9e0e457898a7061b4170a8a1 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:47.139140 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet f7c3705a9e0e457898a7061b4170a8a1 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-f7c3705a9e0e457898a7061b4170a8a1
I20260709 12:09:47.152061 17302 tablet_copy_source_session.cc:215] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.155938 18510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7c3705a9e0e457898a7061b4170a8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.164870 18514 tablet_copy_client.cc:323] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:47.166863 17451 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 4198acb44a394602a442737d55022d72 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:47.167407 17451 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 4198acb44a394602a442737d55022d72 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-4198acb44a394602a442737d55022d72
I20260709 12:09:47.172820 18508 ts_tablet_manager.cc:933] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:47.183692 17441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:47.184429 17441 raft_consensus.cc:606] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:47.191022 18508 tablet_copy_client.cc:323] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:47.193477 17451 tablet_copy_source_session.cc:215] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.195156 17450 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 8789c06ba7714e709d794ce12c4141d1 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:47.195789 17450 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 8789c06ba7714e709d794ce12c4141d1 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-8789c06ba7714e709d794ce12c4141d1
I20260709 12:09:47.198357 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4198acb44a394602a442737d55022d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.218753 17450 tablet_copy_source_session.cc:215] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.220548 18514 tablet_copy_client.cc:806] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.221240 18514 tablet_copy_client.cc:670] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.223824 18508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8789c06ba7714e709d794ce12c4141d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.239028 18514 tablet_copy_client.cc:538] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.246668 18508 tablet_copy_client.cc:806] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.249907 18508 tablet_copy_client.cc:670] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.256124 18508 tablet_copy_client.cc:538] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.259670 18514 tablet_bootstrap.cc:492] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:47.269402 18508 tablet_bootstrap.cc:492] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:47.288784 17283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:47.289454 17283 raft_consensus.cc:606] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:47.324600 17441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:47.325225 17441 raft_consensus.cc:606] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:47.328001 17362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6728648e29b471c950575a72ecf0454"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:47.328580 17362 raft_consensus.cc:606] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:47.332893 18510 tablet_copy_client.cc:806] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.333557 18510 tablet_copy_client.cc:670] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.334468 17441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:47.335163 17441 raft_consensus.cc:606] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:47.337134 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:47.338940 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:47.339759 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:47.344336 18510 tablet_copy_client.cc:538] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.356369 18466 raft_consensus.cc:993] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:47.356911 18466 raft_consensus.cc:1081] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:47.359055 17362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48990
I20260709 12:09:47.359653 17362 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.359989 17362 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.362035 18510 tablet_bootstrap.cc:492] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:47.363108 18514 tablet_bootstrap.cc:492] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.368891 18514 tablet_bootstrap.cc:492] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:47.371966 18514 ts_tablet_manager.cc:1403] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.113s	user 0.029s	sys 0.009s
I20260709 12:09:47.370749 17362 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.375427 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:47.375973 17290 raft_consensus.cc:3055] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:47.376257 17290 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:47.376946 17290 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.378539 18013 raft_consensus.cc:1217] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:47.381567 18508 tablet_bootstrap.cc:492] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.384387 18514 raft_consensus.cc:359] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:47.385268 18514 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:47.385919 18514 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:47.388975 18514 ts_tablet_manager.cc:1434] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:09:47.391114 17450 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4198acb44a394602a442737d55022d72 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:47.391541 17450 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-4198acb44a394602a442737d55022d72 on tablet 4198acb44a394602a442737d55022d72 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:47.394433 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:47.395022 17441 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.382509 18508 tablet_bootstrap.cc:492] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:47.398938 18508 ts_tablet_manager.cc:1403] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.130s	user 0.021s	sys 0.002s
I20260709 12:09:47.377938 17290 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.401966 18508 raft_consensus.cc:359] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:47.404734 18508 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:47.405501 18508 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:47.408406 18508 ts_tablet_manager.cc:1434] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:09:47.409405 17290 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:09:47.410732 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:47.411578 18397 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:47.412052 18397 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:47.412766 18397 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.413126 17441 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:09:47.414000 17362 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:47.415140 18510 tablet_bootstrap.cc:492] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.410815 17450 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-8789c06ba7714e709d794ce12c4141d1 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:47.416962 17450 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-8789c06ba7714e709d794ce12c4141d1 on tablet 8789c06ba7714e709d794ce12c4141d1 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:47.417538 18510 tablet_bootstrap.cc:492] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:47.418802 18510 ts_tablet_manager.cc:1403] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.007s
I20260709 12:09:47.428819 17188 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 3, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 3 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.439721 18510 raft_consensus.cc:359] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:47.442637 18510 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:47.443460 18510 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:47.445986 18510 ts_tablet_manager.cc:1434] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 12:09:47.447794 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-f7c3705a9e0e457898a7061b4170a8a1 received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:47.448297 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-f7c3705a9e0e457898a7061b4170a8a1 on tablet f7c3705a9e0e457898a7061b4170a8a1 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:47.468572 18446 raft_consensus.cc:993] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:47.468981 18415 raft_consensus.cc:1081] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:47.470530 17290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:09:47.471027 17290 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.471376 17290 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.477746 17290 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.479339 17290 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:47.480997 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:47.481504 17441 raft_consensus.cc:3055] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.481727 17441 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:47.482448 17441 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.483858 17441 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.486490 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:47.487170 17362 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.506278 17362 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:47.508322 17255 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:47.509176 18441 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.509757 18441 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:47.510910 18441 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.515372 17441 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:47.531267 17190 catalog_manager.cc:5697] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.538739 18446 raft_consensus.cc:993] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:47.539260 18446 raft_consensus.cc:1081] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:47.540975 17362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48992
I20260709 12:09:47.541502 17362 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.541844 17362 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.553220 17362 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.555824 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:47.557360 17290 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.558530 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:47.559115 17441 raft_consensus.cc:3055] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.559394 17441 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:47.560124 17441 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.561175 17441 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.556463 17362 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:47.565279 17290 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:47.566401 17332 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:47.567289 18397 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.567728 18397 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:47.568486 18397 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.570645 17441 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:47.580610 17190 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.617111 18013 raft_consensus.cc:1217] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:47.667327 18013 raft_consensus.cc:1217] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:47.698237 18013 raft_consensus.cc:1217] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:47.700269 18446 raft_consensus.cc:993] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:47.700830 18446 raft_consensus.cc:1081] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:47.702816 17284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:09:47.703317 17284 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.703662 17284 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.712108 17284 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.714177 17284 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:47.714999 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:47.715723 17361 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.714999 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:47.716820 17441 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.717157 17441 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:47.717886 17441 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.719133 17441 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.722141 18397 raft_consensus.cc:993] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:47.722607 18512 raft_consensus.cc:1081] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:47.725865 17361 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:47.726279 17441 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:47.726843 17255 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:47.727861 18441 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.728404 18441 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:47.726934 18013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6728648e29b471c950575a72ecf0454"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52238
I20260709 12:09:47.729384 18013 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.729838 18013 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.729949 18441 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:47.741873 17190 catalog_manager.cc:5697] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.738387 18013 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:47.747702 18013 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:47.748752 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:47.748752 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:47.749388 17361 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.749619 17284 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.749738 17361 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:47.750527 17361 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:47.751603 17361 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.758315 17361 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:47.759266 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:47.759953 18467 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.763825 17284 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:47.766754 18467 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:47.768239 18467 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:47.779404 17190 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.868186 17284 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:47.869529 18397 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.882411 17441 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:47.884188 18512 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.943998 17439 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:47.945437 18466 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.954618 17362 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:47.956264 18408 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.966830 18527 raft_consensus.cc:1064] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:47.969282 18527 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:47.980722 18013 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.981447 17362 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.982486 18480 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.984447 18446 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.990082 17290 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.991484 18446 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.035974 18415 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.037832 18012 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.040325 17284 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.052932 17359 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.064132 17190 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.101239 17441 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:48.101944 18480 raft_consensus.cc:1064] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:48.103873 17290 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.105479 18512 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.104892 18480 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:48.130595 17359 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.133219 18527 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.130960 18013 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.138705 18415 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.143872 18415 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.149070 18013 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.151965 17439 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.151981 17361 raft_consensus.cc:2955] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.159652 18512 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.162521 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:48.163420 18540 raft_consensus.cc:1064] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:48.169492 18540 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:48.172693 17188 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.209887 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet bd0b7d359bb7400c8b795e1b6f9dd1a2 with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:48.214602 18546 tablet_replica.cc:333] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:48.228405 18546 raft_consensus.cc:2243] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:48.217940 17361 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.229327 18546 raft_consensus.cc:2272] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:48.232183 17362 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.235049 18467 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:09:48.240973 18013 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.239750 17359 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.240828 17283 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.238253 18012 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.241092 17361 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.246791 18543 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.245922 18441 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.248739 18441 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.250185 18466 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.250897 18543 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:48.255563 18546 ts_tablet_manager.cc:1916] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:48.270293 17284 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.272101 18529 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:09:48.294373 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 52708.6us
I20260709 12:09:48.295986 17439 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.297878 17439 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.301501 18466 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.301652 18540 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.307062 18546 ts_tablet_manager.cc:1929] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:48.307646 18546 log.cc:1199] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/bd0b7d359bb7400c8b795e1b6f9dd1a2
I20260709 12:09:48.309785 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet bd0b7d359bb7400c8b795e1b6f9dd1a2 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:48.317400 18543 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.318532 18446 raft_consensus.cc:1064] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:48.321463 18446 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:09:48.384840 18552 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:09:48.437498 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 67572.4us
I20260709 12:09:48.456802 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:48.476069 18415 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:09:48.496120 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 120425us
W20260709 12:09:48.534960 18550 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:09:48.549263 18441 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.553520 17359 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.553581 17360 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:09:48.571475 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 99493.7us
W20260709 12:09:48.576207 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 65598.5us
I20260709 12:09:48.582089 17362 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.585803 18527 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:48.603229 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 86677.6us
I20260709 12:09:48.607177 18013 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.614737 17189 catalog_manager.cc:5697] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.631340 18012 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.629549 17188 catalog_manager.cc:5697] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.643695 18446 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:48.698570 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 185292us
I20260709 12:09:48.726459 18015 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.729174 18563 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.730850 17359 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.765527 18012 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.769229 17287 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.781811 17285 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.801129 17439 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.809122 17432 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:48.826085 18415 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.829035 17189 catalog_manager.cc:5697] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.846576 18012 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.850183 17284 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:48.863772 18480 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:48.876333 17287 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.885620 18480 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:48.898317 18012 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.899278 17359 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.900753 18408 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.908179 18565 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.914151 17289 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.919730 18540 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.921898 18527 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.927280 18014 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.933036 17291 raft_consensus.cc:2955] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.936105 17359 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.940251 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7c3705a9e0e457898a7061b4170a8a1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:48.952148 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4198acb44a394602a442737d55022d72 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:48.952230 17189 catalog_manager.cc:5697] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.966691 17289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:48.967294 17289 raft_consensus.cc:606] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:48.965932 18012 raft_consensus.cc:2955] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:48.975718 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:48.976370 17284 raft_consensus.cc:606] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:48.979013 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet 4198acb44a394602a442737d55022d72 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:48.980242 17361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:48.980829 17361 raft_consensus.cc:606] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:48.981452 17187 catalog_manager.cc:5697] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.988368 17361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:48.989023 17361 raft_consensus.cc:606] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:48.995270 17441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:48.996229 17441 raft_consensus.cc:606] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:48.997601 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:48.999233 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:49.001354 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet f7c3705a9e0e457898a7061b4170a8a1 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:49.007061 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:49.015260 18576 tablet_replica.cc:333] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:49.016422 18576 raft_consensus.cc:2243] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.017175 18576 raft_consensus.cc:2272] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.020917 18576 ts_tablet_manager.cc:1916] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.029582 18575 tablet_replica.cc:333] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:49.030678 18556 raft_consensus.cc:993] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:49.031282 18462 raft_consensus.cc:1081] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:49.030773 18575 raft_consensus.cc:2243] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.032744 18575 raft_consensus.cc:2272] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.032910 18015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52238
I20260709 12:09:49.033670 18015 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.034065 18015 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.036557 18575 ts_tablet_manager.cc:1916] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.044875 18015 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:49.054682 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:49.055285 17284 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.068033 17284 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:49.069883 18576 ts_tablet_manager.cc:1929] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.072130 18576 log.cc:1199] T f7c3705a9e0e457898a7061b4170a8a1 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/f7c3705a9e0e457898a7061b4170a8a1
I20260709 12:09:49.070396 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:49.074267 17359 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.074213 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet f7c3705a9e0e457898a7061b4170a8a1 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:49.074800 17359 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:49.078392 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:09:49.079571 18567 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.080084 18567 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:49.080971 18567 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:49.069301 18015 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:49.099056 17189 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.075819 17359 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:49.102192 17359 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.111759 18575 ts_tablet_manager.cc:1929] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.112339 18575 log.cc:1199] T 4198acb44a394602a442737d55022d72 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/4198acb44a394602a442737d55022d72
I20260709 12:09:49.114447 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet 4198acb44a394602a442737d55022d72 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:49.115477 17359 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:49.320199 17441 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:49.326450 17284 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.330492 18015 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.332373 18561 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.335587 18480 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.343678 18561 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:49.349010 18015 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:49.350809 17284 raft_consensus.cc:2955] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:49.360014 18563 raft_consensus.cc:993] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:49.360584 18563 raft_consensus.cc:1081] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:49.362360 17359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48992
I20260709 12:09:49.362910 17359 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.363250 17359 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.369185 17359 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:49.371907 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:49.372500 17359 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:49.372577 17291 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.380447 18540 raft_consensus.cc:993] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:49.380951 18540 raft_consensus.cc:1081] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:49.384841 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:49.385429 17441 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:49.386024 17441 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:49.385718 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8789c06ba7714e709d794ce12c4141d1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.389032 17291 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:09:49.390271 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:49.391302 17441 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:49.392578 17441 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.396119 18573 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:49.386740 18012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52232
I20260709 12:09:49.397075 18012 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.397421 18012 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.401765 17441 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:09:49.393621 17189 catalog_manager.cc:5697] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:49.416735 18573 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:49.417605 18573 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:49.419697 18012 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:49.421110 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet 8789c06ba7714e709d794ce12c4141d1 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:49.422055 18575 tablet_replica.cc:333] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:49.423121 18575 raft_consensus.cc:2243] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.423133 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:49.423910 17291 raft_consensus.cc:3055] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.424286 17291 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:49.425053 17291 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:49.426229 17291 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.423928 18575 raft_consensus.cc:2272] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.433543 18565 raft_consensus.cc:993] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:49.434033 18408 raft_consensus.cc:1081] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:49.435909 17361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48990
I20260709 12:09:49.436545 17361 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.436635 18575 ts_tablet_manager.cc:1916] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.436946 17361 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.444257 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:49.444903 17439 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.444679 17361 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:49.447546 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:49.448127 17284 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.448437 17284 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:49.448818 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:49.449398 17441 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.449225 17284 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:49.450448 17284 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.451174 18012 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:49.452101 17291 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:49.454914 17980 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:09:49.455797 18567 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.456308 18567 raft_consensus.cc:697] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:49.457173 18567 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:49.461458 17361 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:49.463786 17441 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:49.464910 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:49.465556 18556 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.466020 18556 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:49.466590 18575 ts_tablet_manager.cc:1929] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.467015 18575 log.cc:1199] T 8789c06ba7714e709d794ce12c4141d1 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/8789c06ba7714e709d794ce12c4141d1
I20260709 12:09:49.466915 18556 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:49.468698 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet 8789c06ba7714e709d794ce12c4141d1 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:49.468827 17439 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:49.475953 17284 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:49.480378 17187 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 4, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.481551 17190 catalog_manager.cc:5697] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.495873 17361 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.497074 18567 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.501468 17187 catalog_manager.cc:5697] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.509788 17291 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.519032 18583 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:49.582290 18573 raft_consensus.cc:993] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:49.582753 18578 raft_consensus.cc:1081] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:49.584496 17291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:09:49.585134 17291 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.585500 17291 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.591400 17291 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:49.593202 17291 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:49.593858 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:49.594224 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:49.594497 17359 raft_consensus.cc:3055] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.594741 17441 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.594790 17359 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:49.595647 17359 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:49.596812 17359 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.600375 17441 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:49.601496 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:49.602207 18408 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.602669 18408 raft_consensus.cc:697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:49.603458 18408 consensus_queue.cc:237] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:49.603838 17359 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:49.617654 17190 catalog_manager.cc:5697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.858057 17291 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:49.859719 18578 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.874974 17441 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:49.876210 18556 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.905263 17289 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.906958 18578 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:49.926940 17441 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.928534 18578 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:49.943110 17291 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.945365 18567 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:50.002351 17441 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.004166 18585 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.037544 17439 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.039300 18565 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.049862 17361 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.051425 18408 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.137360 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.183403 17441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4198acb44a394602a442737d55022d72"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:50.183897 17441 raft_consensus.cc:606] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:50.186249 17359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:50.186859 17359 raft_consensus.cc:606] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:50.189404 17359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:50.189963 17359 raft_consensus.cc:606] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:50.192198 17441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:50.192713 17441 raft_consensus.cc:606] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:50.196964 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:50.197566 17284 raft_consensus.cc:606] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:50.199116 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:50.200729 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:50.201310 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.302505 18573 raft_consensus.cc:993] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:50.303054 18573 raft_consensus.cc:1081] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:50.305450 17284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:09:50.306017 17284 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.306408 17284 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.312794 17284 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:50.314615 17284 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:50.315234 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:50.315553 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:50.316424 17359 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.316752 17359 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:50.316643 17441 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.317881 17359 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:50.319175 17359 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.322731 17441 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:50.323829 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:50.324875 18408 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.325067 17359 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:50.325384 18408 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:50.326563 18408 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:50.338156 17189 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.364110 18565 raft_consensus.cc:993] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:50.364859 18408 raft_consensus.cc:1081] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:50.366909 18015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52232
I20260709 12:09:50.367527 18015 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.368016 18015 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.373522 18015 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:50.376232 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:50.376493 18015 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:50.376858 17284 raft_consensus.cc:3055] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.377233 17284 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:50.377106 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:50.378342 17360 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.378084 17284 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:50.379261 17284 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.383383 17360 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:50.384636 17284 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:50.384748 17978 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:50.385514 18585 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.385939 18585 raft_consensus.cc:697] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:50.386863 18585 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:50.397750 17189 catalog_manager.cc:5697] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.493042 17360 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:50.501389 17284 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:50.502578 17333 consensus_peers.cc:597] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: faefcc2755734398b9b0b1a778da9a50. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.503870 17439 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.503409 18578 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.506619 18573 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.515376 18573 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.523973 17284 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.532804 17289 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:50.535853 17441 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.542128 17189 catalog_manager.cc:5697] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.557593 18561 raft_consensus.cc:993] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:50.558073 18561 raft_consensus.cc:1081] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:50.567305 18609 raft_consensus.cc:993] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:50.567763 18609 raft_consensus.cc:1081] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:50.569268 18015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4198acb44a394602a442737d55022d72"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52246
I20260709 12:09:50.569883 18015 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.570255 18015 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:50.572536 17258 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 814b69784b0f4c3d8b07d13d54ae4b47. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.573377 18012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52246
I20260709 12:09:50.573949 18012 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.574342 18012 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.574165 17441 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.576498 18408 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.581941 18015 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:50.584511 18015 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:50.585168 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:50.585804 17289 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.585300 17359 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.588635 18408 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.596180 17289 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:50.597931 17980 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:09:50.595968 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:50.598713 17439 raft_consensus.cc:3055] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.599017 18585 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.599257 17439 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:50.600140 18585 raft_consensus.cc:697] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:50.601347 18585 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:50.593576 18012 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:50.602286 17439 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:50.604240 17439 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.605047 18012 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:50.605370 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:50.605624 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:50.606024 17360 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.606181 17432 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.606549 17432 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:50.607345 17432 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:50.608570 17432 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.615967 18611 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.619594 17361 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.624958 17432 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:50.629258 17360 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:50.632985 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:50.634298 18585 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.634829 18585 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:50.635673 18585 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:50.637782 17190 catalog_manager.cc:5697] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.643750 17439 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:50.648180 17439 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.645850 17189 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.660879 18578 raft_consensus.cc:993] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:50.661423 18578 raft_consensus.cc:1081] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:50.666630 17284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:09:50.667205 17284 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.667546 17284 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.674240 17360 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:50.675243 17284 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:50.677211 17284 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:50.680898 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:50.681478 17439 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.681492 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:50.682202 17361 raft_consensus.cc:3055] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:50.682492 17361 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:50.683235 17361 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:50.684640 17361 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.688735 17439 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:09:50.695006 17361 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:09:50.696411 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:50.697357 18408 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.697849 18408 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:50.699146 18408 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:09:50.709837 17333 consensus_peers.cc:597] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff2e0aa678a447dcab13573f3577208e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.712319 17284 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.712337 17439 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.710932 17187 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.713935 18578 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.715058 18462 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.723249 17189 catalog_manager.cc:5697] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 2 to 3, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.727943 18573 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.731796 17439 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.745193 17361 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:50.748186 17189 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.751453 17289 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:09:50.772926 17333 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9356b25ee58416ca89b944be6f0b562. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.773802 17439 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.774300 17289 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.775413 18573 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.776420 18578 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.788446 17439 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.789659 17289 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.786712 18573 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.806337 17187 catalog_manager.cc:5697] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:50.807696 17439 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.807696 17361 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.809281 18408 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.811216 18585 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.867625 17284 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.869586 18604 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.891916 17361 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.893550 18408 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.947343 18632 ts_tablet_manager.cc:933] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:50.959295 18632 tablet_copy_client.cc:323] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:50.963352 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet faefcc2755734398b9b0b1a778da9a50 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:50.963939 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet faefcc2755734398b9b0b1a778da9a50 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-faefcc2755734398b9b0b1a778da9a50
I20260709 12:09:50.971889 17377 tablet_copy_source_session.cc:215] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:50.975322 18632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faefcc2755734398b9b0b1a778da9a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:50.999290 18632 tablet_copy_client.cc:806] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:50.999886 18632 tablet_copy_client.cc:670] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.004053 18632 tablet_copy_client.cc:538] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.004599 17432 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.005872 18604 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.014451 18632 tablet_bootstrap.cc:492] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:51.035710 17284 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.039366 18585 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.086017 18632 tablet_bootstrap.cc:492] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.087100 18632 tablet_bootstrap.cc:492] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:51.087862 18632 ts_tablet_manager.cc:1403] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.074s	user 0.031s	sys 0.041s
I20260709 12:09:51.096015 18632 raft_consensus.cc:359] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:51.096895 18632 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:51.097620 18632 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:51.103569 18632 ts_tablet_manager.cc:1434] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:09:51.105662 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-faefcc2755734398b9b0b1a778da9a50 received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:51.106207 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-faefcc2755734398b9b0b1a778da9a50 on tablet faefcc2755734398b9b0b1a778da9a50 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:51.106494 18637 ts_tablet_manager.cc:933] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:51.111411 18637 tablet_copy_client.cc:323] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:51.113104 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet 814b69784b0f4c3d8b07d13d54ae4b47 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:51.113668 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet 814b69784b0f4c3d8b07d13d54ae4b47 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-814b69784b0f4c3d8b07d13d54ae4b47
I20260709 12:09:51.122181 17302 tablet_copy_source_session.cc:215] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.125633 18637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814b69784b0f4c3d8b07d13d54ae4b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.146317 18637 tablet_copy_client.cc:806] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.146859 18637 tablet_copy_client.cc:670] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.151122 18637 tablet_copy_client.cc:538] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.158761 18637 tablet_bootstrap.cc:492] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:51.168907 18632 ts_tablet_manager.cc:933] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:51.186043 18641 ts_tablet_manager.cc:933] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:51.188221 17432 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:51.190332 18408 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.198653 18632 tablet_copy_client.cc:323] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:51.203044 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet ff2e0aa678a447dcab13573f3577208e from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:51.203689 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet ff2e0aa678a447dcab13573f3577208e from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-ff2e0aa678a447dcab13573f3577208e
I20260709 12:09:51.211145 17360 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:51.217118 17377 tablet_copy_source_session.cc:215] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.202720 18641 tablet_copy_client.cc:323] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
I20260709 12:09:51.221290 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet b9356b25ee58416ca89b944be6f0b562 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:09:51.222721 18637 tablet_bootstrap.cc:492] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.217372 18565 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:09:51.221918 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet b9356b25ee58416ca89b944be6f0b562 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-b9356b25ee58416ca89b944be6f0b562
I20260709 12:09:51.221959 18632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e0aa678a447dcab13573f3577208e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.233603 18637 tablet_bootstrap.cc:492] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:51.234513 18637 ts_tablet_manager.cc:1403] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.009s
I20260709 12:09:51.239735 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:51.243324 18637 raft_consensus.cc:359] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:51.245267 17377 tablet_copy_source_session.cc:215] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.245813 18637 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:51.248275 18637 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:51.250509 17361 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.252512 18585 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.254565 18641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9356b25ee58416ca89b944be6f0b562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.256428 18637 ts_tablet_manager.cc:1434] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:09:51.258327 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-814b69784b0f4c3d8b07d13d54ae4b47 received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:51.258764 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-814b69784b0f4c3d8b07d13d54ae4b47 on tablet 814b69784b0f4c3d8b07d13d54ae4b47 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:51.267375 17439 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.269282 18604 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.294631 18632 tablet_copy_client.cc:806] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.295279 18632 tablet_copy_client.cc:670] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.302587 18641 tablet_copy_client.cc:806] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.303315 18641 tablet_copy_client.cc:670] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.303483 18632 tablet_copy_client.cc:538] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.320488 18641 tablet_copy_client.cc:538] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.333101 18015 raft_consensus.cc:1217] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.351188 18632 tablet_bootstrap.cc:492] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:51.408675 18641 tablet_bootstrap.cc:492] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:51.410746 18632 tablet_bootstrap.cc:492] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.411705 18632 tablet_bootstrap.cc:492] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:51.413650 18632 ts_tablet_manager.cc:1403] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.000s
I20260709 12:09:51.417120 18632 raft_consensus.cc:359] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:51.419320 18632 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:51.420064 18632 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:51.443497 18632 ts_tablet_manager.cc:1434] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:09:51.454558 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-ff2e0aa678a447dcab13573f3577208e received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:51.454886 18641 tablet_bootstrap.cc:492] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.455075 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-ff2e0aa678a447dcab13573f3577208e on tablet ff2e0aa678a447dcab13573f3577208e with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:51.455797 18641 tablet_bootstrap.cc:492] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:51.456535 18641 ts_tablet_manager.cc:1403] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.005s
I20260709 12:09:51.459599 18641 raft_consensus.cc:359] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:51.460476 18641 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:51.461120 18641 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:51.463641 18641 ts_tablet_manager.cc:1434] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:51.468804 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-b9356b25ee58416ca89b944be6f0b562 received from {username='slave'} at 127.0.0.1:34702
I20260709 12:09:51.469255 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-b9356b25ee58416ca89b944be6f0b562 on tablet b9356b25ee58416ca89b944be6f0b562 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:51.505223 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:51.505826 17284 raft_consensus.cc:606] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:51.509130 17432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:51.509717 17432 raft_consensus.cc:606] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:51.512584 17432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:51.513032 17432 raft_consensus.cc:606] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:51.514003 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:51.515539 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:51.516216 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:51.546878 18609 raft_consensus.cc:993] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:51.547433 18527 raft_consensus.cc:1081] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:51.549160 17284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:09:51.549717 17284 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.550065 17284 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.559671 17284 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:51.561617 17284 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:51.562937 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:51.563560 17432 raft_consensus.cc:3055] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.563850 17432 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:51.564607 17432 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:51.565658 17432 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.574800 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:09:51.575415 18012 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.582545 18012 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:51.582676 18014 raft_consensus.cc:1217] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.584383 17432 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:51.589208 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:09:51.590425 18565 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.590924 18565 raft_consensus.cc:697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:51.591759 18565 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:51.616017 17187 catalog_manager.cc:5697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.659535 18012 raft_consensus.cc:1217] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.781235 18012 raft_consensus.cc:1217] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.844421 18462 raft_consensus.cc:1064] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:51.847337 18462 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:51.858742 18012 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:51.861007 17289 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:51.863202 17432 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:51.864044 18462 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:09:51.869376 18578 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.870323 18573 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:51.883791 18462 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:51.887152 17432 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:51.887152 17289 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:51.919482 18012 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:51.924945 18561 raft_consensus.cc:993] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:51.925483 18561 raft_consensus.cc:1081] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:51.932560 17361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48992
I20260709 12:09:51.933121 17361 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.933470 17361 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.912019 17190 catalog_manager.cc:5697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:51.946326 17361 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:51.955327 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:51.955962 17439 raft_consensus.cc:3055] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.956262 17439 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:51.956950 17439 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:51.963114 18614 raft_consensus.cc:993] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:51.963640 18614 raft_consensus.cc:1081] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:51.965163 17359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48990
I20260709 12:09:51.965703 17359 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.966076 17359 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.957954 17439 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:51.975386 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46338.6us
I20260709 12:09:51.975636 17361 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:51.977777 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:51.978381 17284 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.977888 17439 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:51.981225 17333 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:51.982226 17361 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:51.984076 18658 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.986438 17359 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:51.988626 18658 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:51.989575 18658 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:51.997375 18012 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.998183 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:51.998832 17291 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:51.999922 17291 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:52.001015 17359 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:52.001116 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:52.001726 17432 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.004609 18578 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.008606 17439 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.011143 18573 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.011878 17291 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:52.013357 18462 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.022152 18012 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.032606 17439 raft_consensus.cc:2955] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.036676 17291 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.014855 17432 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:09:52.017223 17284 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:52.040172 17333 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:52.041831 18573 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.042414 18573 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:52.043284 18573 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:52.048756 17291 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:09:52.049830 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet faefcc2755734398b9b0b1a778da9a50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.064146 18012 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.064175 17188 catalog_manager.cc:5697] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.066555 18408 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:52.082368 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet faefcc2755734398b9b0b1a778da9a50 with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:52.086037 17187 catalog_manager.cc:5697] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.103350 18663 tablet_replica.cc:333] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:52.110447 17187 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 3, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 3 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.126885 18663 raft_consensus.cc:2243] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.127681 18663 raft_consensus.cc:2272] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.130828 17439 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.131843 18663 ts_tablet_manager.cc:1916] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.132938 18408 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:52.150151 18663 ts_tablet_manager.cc:1929] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:52.150650 18663 log.cc:1199] T faefcc2755734398b9b0b1a778da9a50 P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/faefcc2755734398b9b0b1a778da9a50
I20260709 12:09:52.152621 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet faefcc2755734398b9b0b1a778da9a50 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:52.154796 18408 raft_consensus.cc:1064] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:52.157688 18408 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:52.172619 18012 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.173911 17361 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.175534 18408 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.177623 17439 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.184718 18666 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.185763 18565 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.187897 18658 raft_consensus.cc:1064] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:52.190670 18658 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:52.219468 18014 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.219810 18015 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.218017 18666 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.223222 18462 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.230868 17284 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.236800 17439 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.235112 18658 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:09:52.242125 18462 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.254120 17361 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.255518 17187 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.244184 17432 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.279132 18462 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.281541 17441 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.283322 17284 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.290375 17289 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:52.303978 17359 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.305778 18408 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.310225 18014 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.310295 18015 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.316280 18614 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.319669 18658 raft_consensus.cc:1064] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:52.320026 17190 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.323390 18658 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:52.336688 18666 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.344323 17360 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:52.345845 18015 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.353664 18014 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.356428 18578 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.357638 17361 raft_consensus.cc:2955] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.365859 18573 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.376848 17190 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.381968 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 814b69784b0f4c3d8b07d13d54ae4b47 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.385542 18015 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.388027 17441 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.390039 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff2e0aa678a447dcab13573f3577208e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.391345 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet 814b69784b0f4c3d8b07d13d54ae4b47 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:52.392894 18654 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.401772 17441 raft_consensus.cc:2955] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.415230 18678 tablet_replica.cc:333] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:52.419914 18678 raft_consensus.cc:2243] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.421902 18678 raft_consensus.cc:2272] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.425918 18678 ts_tablet_manager.cc:1916] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.425427 17190 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.442349 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet ff2e0aa678a447dcab13573f3577208e with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:52.443435 18663 tablet_replica.cc:333] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:52.444448 18663 raft_consensus.cc:2243] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.445154 18663 raft_consensus.cc:2272] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.450052 18663 ts_tablet_manager.cc:1916] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.466369 18678 ts_tablet_manager.cc:1929] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:52.466908 18678 log.cc:1199] T 814b69784b0f4c3d8b07d13d54ae4b47 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/814b69784b0f4c3d8b07d13d54ae4b47
I20260709 12:09:52.470820 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet 814b69784b0f4c3d8b07d13d54ae4b47 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:52.486025 18663 ts_tablet_manager.cc:1929] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:52.486660 18663 log.cc:1199] T ff2e0aa678a447dcab13573f3577208e P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/ff2e0aa678a447dcab13573f3577208e
I20260709 12:09:52.487807 17432 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.488878 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet ff2e0aa678a447dcab13573f3577208e (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:52.490339 18015 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.495148 17291 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.501912 18679 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.504801 18680 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.510010 18684 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.532557 18684 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.537467 18015 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.546350 17287 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:52.708868 17441 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.711488 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.744648 17285 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.754958 17187 catalog_manager.cc:5697] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.776320 18679 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.779289 18679 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.797365 17432 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.802615 17432 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:52.840548 17433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:52.841144 17433 raft_consensus.cc:606] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:52.854655 17287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:52.855289 17287 raft_consensus.cc:606] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:52.860260 18565 raft_consensus.cc:993] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:52.860737 18565 raft_consensus.cc:1081] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:52.862512 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:52.863107 17360 raft_consensus.cc:606] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:52.863958 18682 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.867578 18683 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.869707 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:52.870311 17360 raft_consensus.cc:606] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:09:52.871752 18012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52232
I20260709 12:09:52.872272 18012 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.872610 18012 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.873649 17291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:52.874224 17291 raft_consensus.cc:606] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:52.875977 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:52.877746 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:52.878551 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.880278 18012 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:52.884200 17291 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:52.901399 18012 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:52.903576 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:52.904213 17289 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.904487 17289 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:52.908321 17289 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:52.908802 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:52.909420 17360 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.931568 17289 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.960700 17360 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:52.983172 17289 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
W20260709 12:09:53.104501 18660 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:09:53.091370 18687 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 12:09:53.124156 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 182548us
W20260709 12:09:53.166067 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 88904.4us
W20260709 12:09:53.178915 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 80356.9us
I20260709 12:09:53.195782 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:09:53.258484 18683 raft_consensus.cc:993] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: : Instructing follower e860f7e876b74ec589f447737822a4f6 to start an election
W20260709 12:09:53.269482 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 51395us
W20260709 12:09:53.271397 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 59561.3us
I20260709 12:09:53.243499 18698 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.326164 18698 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:53.328502 18658 raft_consensus.cc:1081] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Signalling peer e860f7e876b74ec589f447737822a4f6 to start an election
I20260709 12:09:53.351514 18698 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:09:53.378003 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 155557us
I20260709 12:09:53.476501 17359 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.515654 17438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33826
I20260709 12:09:53.516597 17438 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.517210 17438 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:53.529429 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 108718us
I20260709 12:09:53.547430 17187 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.568203 18014 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.574893 18573 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:53.579406 17438 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.580643 17440 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:53.601336 18721 raft_consensus.cc:993] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:53.601974 18721 raft_consensus.cc:1081] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:53.603317 18724 raft_consensus.cc:993] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:53.604000 18724 raft_consensus.cc:1081] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:53.598526 18573 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:53.620810 18013 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:53.637799 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9356b25ee58416ca89b944be6f0b562 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.646041 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:09:53.651140 18015 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.644286 17438 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:53.667514 18701 raft_consensus.cc:993] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:53.668797 18710 raft_consensus.cc:1081] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:53.675388 18015 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:09:53.688874 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:53.689841 18710 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.690358 18710 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:53.691284 18710 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.692546 18658 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.693332 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:53.693703 18658 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.694120 18658 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:53.695266 18658 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.696838 18658 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.700883 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48992
I20260709 12:09:53.701633 17360 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.702030 17360 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.725236 17359 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:09:53.725611 17190 catalog_manager.cc:5697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.731667 17188 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 2, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.736099 17360 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.738067 17285 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.739019 17287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:09:53.739646 17287 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.739997 17287 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:53.740991 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:53.741564 17438 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.741842 17438 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:53.742149 18015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52232
I20260709 12:09:53.742799 18015 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.743217 18015 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.752271 17287 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:53.754182 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet b9356b25ee58416ca89b944be6f0b562 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:53.756417 17287 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:53.760118 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:53.760823 17361 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:53.761128 17361 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:53.762007 17361 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:53.766517 17361 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:53.742786 17438 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.768551 17438 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.780028 18015 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.784480 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:53.785172 17287 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.785516 17287 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:53.786357 17360 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:53.787428 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:09:53.788203 18013 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.787635 17287 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.796741 18013 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
W20260709 12:09:53.797117 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.798329 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:53.799198 18680 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.800066 18680 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:53.801370 18680 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.803354 17287 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.806968 18732 tablet_replica.cc:333] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:53.809520 18732 raft_consensus.cc:2243] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.814893 18732 raft_consensus.cc:2272] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.820976 18732 ts_tablet_manager.cc:1916] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.810281 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:53.826092 17360 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.816589 17361 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:09:53.810782 18015 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:53.824677 17289 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.830355 17255 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:53.831044 18689 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.832820 18408 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:53.833331 18408 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:53.824848 17287 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:53.825459 17438 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:53.839916 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:09:53.834062 18408 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:53.841190 18689 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.840046 17188 catalog_manager.cc:5697] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.841751 18689 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:53.834447 17360 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:09:53.842836 18689 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:53.857880 18680 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:53.864284 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:53.864951 17439 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:53.864585 17188 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 4 to 5, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 5 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.874302 17360 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.875895 18604 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.870965 18732 ts_tablet_manager.cc:1929] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.877239 18732 log.cc:1199] T b9356b25ee58416ca89b944be6f0b562 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/b9356b25ee58416ca89b944be6f0b562
I20260709 12:09:53.881402 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet b9356b25ee58416ca89b944be6f0b562 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
W20260709 12:09:53.890502 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.897583 17289 raft_consensus.cc:2955] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:53.917109 17439 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:09:53.917511 17190 catalog_manager.cc:5697] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.958298 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.006230 17361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:54.006798 17361 raft_consensus.cc:606] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:54.009554 17439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:54.010039 17439 raft_consensus.cc:606] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:54.013219 17289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:54.013736 17289 raft_consensus.cc:606] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:54.015049 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:54.016412 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:54.017345 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.075414 18015 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.077641 18701 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.092204 17361 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.093670 18701 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.207044 17439 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.208519 18684 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:54.218796 18015 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.220156 18658 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.297312 17361 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.298810 18707 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:54.309233 17289 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.310864 18719 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.335708 17361 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:09:54.337273 18712 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:54.379623 17439 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:09:54.383301 18725 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:54.417778 18408 raft_consensus.cc:993] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:54.418272 18712 raft_consensus.cc:1081] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:54.419710 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48990
I20260709 12:09:54.420140 17360 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.420397 17360 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.425856 17360 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:54.427891 17360 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:54.429459 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:54.429788 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:54.430416 17439 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.430536 17285 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:54.431006 17285 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:54.432040 17285 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:54.433439 17285 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.444399 17439 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:09:54.445814 17333 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:54.446686 18680 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:54.447873 18680 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:54.449210 18680 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:54.450382 18721 raft_consensus.cc:993] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:54.450982 18721 raft_consensus.cc:1081] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:54.451545 17285 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:09:54.453056 17285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:09:54.453631 17285 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.454016 17285 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.460736 17285 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:54.463425 17285 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:54.464731 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:54.464916 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:54.465514 17439 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.465396 17362 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.465696 17187 catalog_manager.cc:5697] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 3, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 3 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.466643 17362 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:54.467547 17362 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:54.468560 17362 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.472769 17439 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:54.473997 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:54.474849 18712 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.475342 18712 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:54.476294 18712 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:54.476756 17362 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:54.492141 17187 catalog_manager.cc:5697] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.512846 18710 raft_consensus.cc:993] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:54.513414 18609 raft_consensus.cc:1081] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:54.514930 17290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:09:54.515370 17290 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.515684 17290 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.523062 17290 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:54.524971 17290 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:54.525708 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:54.526413 17438 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.526434 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:09:54.526731 17438 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:54.527014 18015 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.527614 17438 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:54.528854 17438 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.532902 18015 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:54.535131 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:09:54.535830 17438 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:54.535888 18712 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.537271 18712 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:54.540211 18712 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:54.549520 17187 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:54.853673 17238 auto_rebalancer.cc:629] Failed to schedule move for tablet 62f5a9a5a773414fa979e4e68b31bb5d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:09:54.857918 17441 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:54.864940 17362 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:54.865578 17407 consensus_peers.cc:597] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b55e72b6c888480d92e455681414fbb0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.866076 17290 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.867395 18609 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.868283 18701 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.879927 18701 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:54.884080 17290 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:54.881655 17362 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:54.899000 17285 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:54.909664 17292 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.914083 18684 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.925490 17441 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:54.927515 17258 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e31ef54befbd4be3b1626005e275d427. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.928911 18725 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:54.917316 17187 catalog_manager.cc:5697] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.941699 17362 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.944762 18712 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.960826 18712 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:54.972230 17362 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:54.983219 17290 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:54.990629 17439 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.992326 18725 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.997200 17359 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.002663 17440 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:55.002997 18712 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.017118 17440 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.000875 17188 catalog_manager.cc:5697] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:55.022969 17258 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12759295b3a947cca3d2c7fc3c815e59. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:55.022369 17440 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:55.024263 18712 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.047377 17360 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.048972 18760 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.055966 18013 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.057451 17441 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:09:55.058904 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 52137.3us
I20260709 12:09:55.059978 18766 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:55.061081 18712 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.059504 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.093792 17359 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:55.099535 18408 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:55.130092 18725 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.131036 17188 catalog_manager.cc:5697] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.137049 17432 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:55.253654 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:55.254619 17360 raft_consensus.cc:606] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:55.257773 17292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:55.258416 17292 raft_consensus.cc:606] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:55.261536 17292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:55.262298 17292 raft_consensus.cc:606] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:09:55.263537 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:55.265468 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:55.266703 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.406059 18774 raft_consensus.cc:993] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower e860f7e876b74ec589f447737822a4f6 to start an election
I20260709 12:09:55.408310 18774 raft_consensus.cc:1081] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Signalling peer e860f7e876b74ec589f447737822a4f6 to start an election
I20260709 12:09:55.419677 17440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33816
I20260709 12:09:55.420382 17440 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.420817 17440 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:55.429390 17440 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:55.431114 18777 ts_tablet_manager.cc:933] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:55.432106 17440 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:55.432439 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:55.433039 17290 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:09:55.432991 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:55.433653 17290 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:55.434010 17360 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:55.434641 17290 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:55.435840 17290 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:55.446283 17290 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:09:55.446462 18777 tablet_copy_client.cc:323] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:55.447886 17406 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:55.448742 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet e31ef54befbd4be3b1626005e275d427 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:55.449396 18701 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:09:55.449926 18701 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:55.450822 18701 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:55.451298 17360 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:09:55.449360 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet e31ef54befbd4be3b1626005e275d427 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-e31ef54befbd4be3b1626005e275d427
I20260709 12:09:55.473272 17302 tablet_copy_source_session.cc:215] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.476990 18777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31ef54befbd4be3b1626005e275d427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.481067 18684 raft_consensus.cc:993] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:55.481778 18766 raft_consensus.cc:1081] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:55.483853 17292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:09:55.484411 17292 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.484771 17292 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.488456 18780 ts_tablet_manager.cc:933] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:55.492426 17292 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:55.497751 17188 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 5 to 6, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 6 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.506227 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:55.506876 17360 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:55.507156 17360 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:55.508072 18780 tablet_copy_client.cc:323] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:09:55.507948 17360 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:55.509064 17360 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.509677 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:55.510289 17432 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.511869 17292 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:55.520476 17450 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet b55e72b6c888480d92e455681414fbb0 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:09:55.521090 17450 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet b55e72b6c888480d92e455681414fbb0 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-b55e72b6c888480d92e455681414fbb0
I20260709 12:09:55.522653 18777 tablet_copy_client.cc:806] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.523444 18777 tablet_copy_client.cc:670] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.523995 17432 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:09:55.525245 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:55.526649 18725 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:55.527202 18725 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:55.528106 18725 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:55.530771 17360 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:09:55.537207 17450 tablet_copy_source_session.cc:215] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.543497 18780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55e72b6c888480d92e455681414fbb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.556905 18777 tablet_copy_client.cc:538] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.571215 18783 ts_tablet_manager.cc:933] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:09:55.573652 18777 tablet_bootstrap.cc:492] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:55.579350 17188 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 3 to 4, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 4 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.585363 18783 tablet_copy_client.cc:323] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:09:55.587276 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet 12759295b3a947cca3d2c7fc3c815e59 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:09:55.587834 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet 12759295b3a947cca3d2c7fc3c815e59 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-12759295b3a947cca3d2c7fc3c815e59
I20260709 12:09:55.601615 18780 tablet_copy_client.cc:806] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.602421 18780 tablet_copy_client.cc:670] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.606451 17302 tablet_copy_source_session.cc:215] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.608122 18780 tablet_copy_client.cc:538] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.609903 18783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12759295b3a947cca3d2c7fc3c815e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.614254 18777 tablet_bootstrap.cc:492] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.615410 18777 tablet_bootstrap.cc:492] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:55.616180 18777 ts_tablet_manager.cc:1403] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.013s
I20260709 12:09:55.619514 18777 raft_consensus.cc:359] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:55.620462 18777 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:55.621572 18777 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:55.622531 18780 tablet_bootstrap.cc:492] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:55.625156 18777 ts_tablet_manager.cc:1434] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 12:09:55.626961 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-e31ef54befbd4be3b1626005e275d427 received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:55.627435 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-e31ef54befbd4be3b1626005e275d427 on tablet e31ef54befbd4be3b1626005e275d427 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:55.646299 18783 tablet_copy_client.cc:806] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.658159 18783 tablet_copy_client.cc:670] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.663240 18780 tablet_bootstrap.cc:492] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.663529 18783 tablet_copy_client.cc:538] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.664291 18780 tablet_bootstrap.cc:492] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:55.665058 18780 ts_tablet_manager.cc:1403] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.012s
I20260709 12:09:55.668275 18780 raft_consensus.cc:359] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:55.670635 18780 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:55.671342 18780 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:55.676796 18783 tablet_bootstrap.cc:492] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:09:55.678619 18780 ts_tablet_manager.cc:1434] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 12:09:55.685141 17450 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-b55e72b6c888480d92e455681414fbb0 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:09:55.685628 17450 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-b55e72b6c888480d92e455681414fbb0 on tablet b55e72b6c888480d92e455681414fbb0 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:55.701627 18783 tablet_bootstrap.cc:492] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.702679 18783 tablet_bootstrap.cc:492] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:09:55.703406 18783 ts_tablet_manager.cc:1403] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 12:09:55.705978 18783 raft_consensus.cc:359] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:55.706637 18783 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:09:55.707217 18783 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:55.710695 18783 ts_tablet_manager.cc:1434] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:55.714130 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-12759295b3a947cca3d2c7fc3c815e59 received from {username='slave'} at 127.0.0.1:36408
I20260709 12:09:55.714586 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-12759295b3a947cca3d2c7fc3c815e59 on tablet 12759295b3a947cca3d2c7fc3c815e59 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:55.718429 18725 raft_consensus.cc:993] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:55.718906 18712 raft_consensus.cc:1081] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:55.721246 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48990
I20260709 12:09:55.721839 17360 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.722152 17360 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.730259 17360 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:55.732936 17360 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:55.732846 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:55.733565 17284 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.733875 17284 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:55.734561 17284 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:55.735450 17284 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.737174 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:09:55.737776 18014 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.740523 17284 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:55.741600 17332 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:55.742270 18680 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.742679 18680 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:55.743460 18680 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:55.749624 18014 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:55.761608 17188 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.879870 17284 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:09:55.881155 18710 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.896940 17359 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:09:55.902113 18609 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.938740 18015 raft_consensus.cc:1217] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:56.014313 18015 raft_consensus.cc:1217] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:09:56.080957 17440 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:56.082472 18712 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.105842 17362 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:56.117540 18725 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.196521 18015 raft_consensus.cc:1217] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:56.248616 18015 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.249895 18680 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:56.273646 17284 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.278537 18803 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:56.336750 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.398721 17292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:56.399358 17292 raft_consensus.cc:606] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:56.402432 17359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:56.402912 17359 raft_consensus.cc:606] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:09:56.405344 17432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:56.405853 17432 raft_consensus.cc:606] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:56.406972 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:56.408123 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:56.408738 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.564949 18792 raft_consensus.cc:1064] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:56.568378 18792 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:56.586366 18798 raft_consensus.cc:1064] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:56.586736 17359 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.588937 18701 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.589226 18014 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.589111 18798 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:56.591650 18701 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.604619 18774 raft_consensus.cc:1064] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:09:56.607324 18774 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:56.613018 17292 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.617813 18792 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.624660 18015 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.626237 18799 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.628572 17440 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.631763 18799 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.631309 18014 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.630337 18710 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.637104 17359 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.640034 17362 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.641335 17432 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.638447 18013 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.641209 18774 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.643549 18712 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.644630 18800 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.645514 18799 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.721668 17187 catalog_manager.cc:5697] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.726022 17361 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.756179 18712 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.758386 18798 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.778146 18800 raft_consensus.cc:993] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:56.778759 18800 raft_consensus.cc:1081] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:56.768075 17359 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:09:56.786610 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 124842us
I20260709 12:09:56.789372 17362 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.810186 18014 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.817386 17190 catalog_manager.cc:5697] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:56.834882 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 63061.1us
I20260709 12:09:56.842144 18815 raft_consensus.cc:993] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:56.843538 18815 raft_consensus.cc:1081] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:56.840969 18014 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.852206 17362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48990
I20260709 12:09:56.852829 17362 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.853209 17362 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.859563 17285 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.861189 17362 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:56.865689 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:56.866312 17290 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.866623 17290 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:56.867393 17290 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:56.868510 17290 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.869024 17362 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:56.869668 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:09:56.870291 18015 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.877493 17290 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:56.878468 17284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:09:56.879071 17284 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.879460 17284 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.882884 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:56.884742 18803 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.885247 18803 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:56.886340 18803 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:56.888038 18680 raft_consensus.cc:993] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: : Instructing follower e860f7e876b74ec589f447737822a4f6 to start an election
I20260709 12:09:56.888553 18680 raft_consensus.cc:1081] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Signalling peer e860f7e876b74ec589f447737822a4f6 to start an election
I20260709 12:09:56.885157 17440 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.894701 17432 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.904618 18015 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:56.912113 17439 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:56.921965 17362 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:56.922945 18014 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:56.923592 18810 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.923650 17187 catalog_manager.cc:5697] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.938766 18815 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.939793 18810 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.940671 17284 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:56.943778 17361 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.946554 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:56.947259 18015 raft_consensus.cc:2955] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:56.947209 17359 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.964164 17359 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:56.965413 17255 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:56.966261 18800 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.966799 18800 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:56.967756 18800 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:56.980337 17284 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:56.981336 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:56.982057 17440 raft_consensus.cc:3055] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.982434 17440 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:56.983466 17440 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:56.984925 17440 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.986006 17290 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:56.988853 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b55e72b6c888480d92e455681414fbb0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:09:56.992090 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 106396us
I20260709 12:09:56.993131 17440 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:09:56.993610 17439 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.997440 18823 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.999495 17439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33826
I20260709 12:09:57.000133 17439 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.000526 17439 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.007269 18013 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:57.011482 18800 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:57.013183 18823 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:57.020428 17440 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:57.025580 18013 raft_consensus.cc:2955] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:57.037901 17284 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.044229 18015 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:57.044713 17188 catalog_manager.cc:5697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.047341 17359 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:57.049013 18798 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:57.051695 18798 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:57.055274 17186 catalog_manager.cc:5697] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:57.051920 17439 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.061852 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e31ef54befbd4be3b1626005e275d427 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:57.062112 17439 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:57.063251 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:09:57.063851 18013 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.063738 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:57.066294 17361 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.066606 17361 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:57.067384 17361 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.068661 17361 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.067878 18799 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:57.071179 18013 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:09:57.072433 17407 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:57.073873 18810 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.074370 18810 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:57.075208 18810 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.079209 17361 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:09:57.080853 18013 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:57.083078 17176 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12759295b3a947cca3d2c7fc3c815e59 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:57.084805 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet b55e72b6c888480d92e455681414fbb0 with delete_type TABLET_DATA_TOMBSTONED (TS 33539b233c2044afa31017244f6cc0d1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:57.087167 17359 raft_consensus.cc:2955] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:57.111521 17188 catalog_manager.cc:5697] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:57.113219 17188 catalog_manager.cc:5697] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 4, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:09:57.120972 18833 tablet_replica.cc:333] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:09:57.122309 18833 raft_consensus.cc:2243] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:57.123215 18833 raft_consensus.cc:2272] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:57.127179 18833 ts_tablet_manager.cc:1916] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:57.126286 17189 catalog_manager.cc:5697] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 2, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.130373 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet e31ef54befbd4be3b1626005e275d427 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48976
I20260709 12:09:57.131507 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet 12759295b3a947cca3d2c7fc3c815e59 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33810
I20260709 12:09:57.147682 18833 ts_tablet_manager.cc:1929] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:57.148296 18833 log.cc:1199] T b55e72b6c888480d92e455681414fbb0 P 33539b233c2044afa31017244f6cc0d1: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/wals/b55e72b6c888480d92e455681414fbb0
I20260709 12:09:57.148756 18834 tablet_replica.cc:333] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:09:57.149912 18834 raft_consensus.cc:2243] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:57.150717 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet b55e72b6c888480d92e455681414fbb0 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:57.151098 18835 tablet_replica.cc:333] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:09:57.151527 18834 raft_consensus.cc:2272] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:57.152132 18835 raft_consensus.cc:2243] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:57.153155 18835 raft_consensus.cc:2272] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:57.155885 18834 ts_tablet_manager.cc:1916] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:57.155429 17186 catalog_manager.cc:5697] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.156618 18835 ts_tablet_manager.cc:1916] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:57.171427 17282 tablet_service.cc:1558] Processing DeleteTablet for tablet b55e72b6c888480d92e455681414fbb0 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:53668
I20260709 12:09:57.172678 18834 ts_tablet_manager.cc:1929] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:09:57.173157 18834 log.cc:1199] T e31ef54befbd4be3b1626005e275d427 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/e31ef54befbd4be3b1626005e275d427
I20260709 12:09:57.173375 17176 catalog_manager.cc:5028] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): tablet b55e72b6c888480d92e455681414fbb0 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:57.175930 18835 ts_tablet_manager.cc:1929] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:57.175803 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet e31ef54befbd4be3b1626005e275d427 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:57.176554 18835 log.cc:1199] T 12759295b3a947cca3d2c7fc3c815e59 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/12759295b3a947cca3d2c7fc3c815e59
I20260709 12:09:57.178277 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet 12759295b3a947cca3d2c7fc3c815e59 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:09:57.383036 17361 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.384332 18799 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:57.399780 17440 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.401010 18823 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:57.440305 18013 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.441546 18766 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.451603 17284 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.452930 18680 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.465505 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:57.520862 17361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:09:57.521443 17361 raft_consensus.cc:606] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:09:57.524022 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:09:57.524549 17284 raft_consensus.cc:606] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:09:57.527248 17439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:09:57.527818 17439 raft_consensus.cc:606] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:09:57.529047 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:57.530400 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:57.530980 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:57.534164 17361 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.535418 18815 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.545089 18013 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.547200 18810 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.765511 18799 raft_consensus.cc:993] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:57.766032 18799 raft_consensus.cc:1081] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:09:57.767508 18013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52232
I20260709 12:09:57.767966 18013 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.768303 18013 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.774053 18013 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.775823 18013 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:57.776365 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:57.776748 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:57.777011 17284 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:57.777307 17439 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.777344 17284 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:57.778264 17284 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.779457 17284 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.784435 17439 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:09:57.785712 17981 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:09:57.786060 17284 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:09:57.786571 18789 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.787046 18789 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:09:57.787933 18789 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.798441 17187 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 3, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 3 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.852111 18803 raft_consensus.cc:993] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:57.852624 18829 raft_consensus.cc:1081] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:09:57.854070 17290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:09:57.854599 17290 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.854878 17290 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.860553 17290 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.862075 17290 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:57.862754 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:09:57.863001 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:09:57.863302 17361 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:57.863544 18013 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.863649 17361 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:57.864331 17361 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.865211 17361 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.868482 18013 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:09:57.869477 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:09:57.870024 17361 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:09:57.870293 18799 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.870888 18799 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:09:57.871672 18799 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:57.880646 17187 catalog_manager.cc:5697] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 2 to 3, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.975342 18824 raft_consensus.cc:993] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:57.975739 18810 raft_consensus.cc:1081] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:09:57.977072 17361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48992
I20260709 12:09:57.977599 17361 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.978135 17361 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.983847 17361 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:57.985220 17361 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:57.986158 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:09:57.986158 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:09:57.986966 17290 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.987023 17432 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.987411 17432 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:09:57.988041 17432 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:57.988984 17432 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.995069 17432 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:57.995352 17290 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:09:57.996778 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:09:57.997540 18829 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.997910 18829 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:09:57.998775 18829 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:58.011086 17187 catalog_manager.cc:5697] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.193502 17290 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:58.200380 17439 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:58.200417 17359 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:58.201232 17258 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7912262477ba4fc0a074c658eed0d241. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:58.201959 18823 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.202988 18799 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.211570 18799 raft_consensus.cc:2955] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.213335 17439 raft_consensus.cc:2955] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.223379 17361 raft_consensus.cc:2955] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.233155 17432 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:58.233464 17187 catalog_manager.cc:5697] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.242524 17361 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:09:58.244441 18810 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:58.243113 17290 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:09:58.248948 17407 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee22d4e5e05e423097297625d6158f21. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:58.249977 18810 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:58.262538 18815 raft_consensus.cc:2955] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.264231 17359 raft_consensus.cc:2955] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.275032 17284 raft_consensus.cc:2955] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.276312 17285 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:58.277748 18789 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:58.288795 17439 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:58.288864 17186 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 6, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 6 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.331023 17432 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:58.334390 18567 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:09:58.350343 17407 consensus_peers.cc:597] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c41ebef06654a43a98e69d0c065bba4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:58.352221 17359 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:58.355862 18824 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.367864 18013 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:58.371316 17284 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:58.372318 18798 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:58.373061 18815 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:58.378345 18824 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.391104 17361 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:09:58.399537 17359 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:58.408768 17362 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:09:58.414913 18823 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:09:58.631006 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:59.225950 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.010s
W20260709 12:09:59.226655 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.005s	sys 0.010s
I20260709 12:09:59.665813 18789 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:59.684603 18789 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:09:59.689792 17978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.003s	sys 0.010s
W20260709 12:09:59.690714 17978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.003s	sys 0.011s
I20260709 12:09:59.696398 18789 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:59.698840 18882 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:59.699559 18882 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:59.702266 18882 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:59.703375 17981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.005s	sys 0.009s
W20260709 12:09:59.758730 17981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.005s	sys 0.010s
I20260709 12:09:59.738435 18884 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:09:59.753806 18885 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:09:59.757299 18567 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:59.760195 18884 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.734177 18883 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:09:59.761233 18567 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.761233 18885 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.762722 18884 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:59.763368 18567 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:59.764163 18877 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:09:59.753016 18789 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:09:59.760795 18880 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:09:59.754014 18881 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:09:59.768100 18567 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:09:59.772893 18884 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:09:59.780426 18567 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.780887 18884 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.783123 18884 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:59.784070 18567 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:09:59.781873 17406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.207s	user 0.008s	sys 0.012s
W20260709 12:09:59.784838 17406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.009s	sys 0.012s
I20260709 12:09:59.764696 18882 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:59.812145 18885 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:59.765588 18883 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.786983 18877 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.896469 18884 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:09:59.898741 18882 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.788230 18880 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.921876 18885 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:09:59.927623 18889 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:59.927899 18887 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:09:59.928308 18889 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:59.929658 18880 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:59.928462 18887 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:59.931381 18877 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:59.931545 18887 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:59.787221 18881 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.933092 18883 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:59.934769 18881 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:59.938937 18889 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:09:59.939929 18882 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:59.927297 18884 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.927691 18885 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.942194 18882 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:09:59.942741 18882 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.943159 18885 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:59.945564 18878 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:09:59.945662 18885 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:09:59.946283 18885 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.946206 18878 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:59.947221 18879 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:09:59.947734 18879 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:09:59.951215 18882 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:59.953512 18879 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:09:59.954178 18889 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:09:59.958261 18876 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:09:59.958926 18876 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:59.954813 18891 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:00.231415 18879 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:00.237044 18879 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:00.238401 18892 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:00.238924 18892 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:09:59.954761 18889 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:00.267241 18882 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:00.267845 18882 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:00.247418 18891 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:00.390661 18891 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:00.391379 18878 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:00.392001 18878 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:00.392490 18878 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:00.394388 18879 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:00.323069 18884 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:00.395452 18876 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:00.254452 18892 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:00.409891 18878 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:00.559520 18885 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:00.631577 17359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.172s	user 0.025s	sys 0.025s
W20260709 12:10:00.632262 17359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.172s	user 0.025s	sys 0.025s
I20260709 12:10:00.633112 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1205) took 2211 ms. Trace:
W20260709 12:10:00.661001 17406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.000s	sys 0.041s
W20260709 12:10:00.661438 17406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.000s	sys 0.041s
W20260709 12:10:00.682943 17361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.225s	user 0.030s	sys 0.032s
W20260709 12:10:00.683565 17361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.226s	user 0.030s	sys 0.032s
I20260709 12:10:00.684325 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 1959) took 2294 ms. Trace:
I20260709 12:10:00.684684 17361 rpcz_store.cc:276] 0709 12:09:58.390383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.390562 (+   179us) service_pool.cc:224] Handling call
0709 12:09:58.390833 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:58.390994 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:58.433824 (+ 42830us) log.cc:844] Serialized 14 byte log entry
0709 12:10:00.683945 (+2250121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.684009 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:00.684051 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.684123 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:00.684261 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76699,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"thread_start_us":2226266,"threads_started":1}
W20260709 12:10:00.775880 17255 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.014s	sys 0.001s
W20260709 12:10:00.776530 17255 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.015s	sys 0.002s
I20260709 12:10:00.781243 18890 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:00.782002 18890 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:00.784310 18890 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:00.798679 17285 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:10:00.810335 17462 debug-util.cc:398] Leaking SignalData structure 0x7b08001cde60 after lost signal to thread 16128
I20260709 12:10:00.866626 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:00.633536 17359 rpcz_store.cc:276] 0709 12:09:58.421614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.421765 (+   151us) service_pool.cc:224] Handling call
0709 12:09:58.422123 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:58.422462 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:58.422636 (+   174us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:58.423434 (+   798us) log.cc:844] Serialized 26 byte log entry
0709 12:09:58.429609 (+  6175us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:09:58.459397 (+ 29788us) log.cc:844] Serialized 14 byte log entry
0709 12:10:00.632694 (+2173297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.632793 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:00.632849 (+    56us) raft_consensus.cc:1685] finished
0709 12:10:00.632861 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:00.633017 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32409,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2833,"raft.queue_time_us":80488,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":185,"thread_start_us":2202120,"threads_started":2}
I20260709 12:10:00.909008 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:00.910578 18895 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:00.911840 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 44748.9us
I20260709 12:10:00.911865 18878 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:00.924160 18878 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:00.929795 18878 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:09:59.787556 18789 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:00.932212 18789 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:00.933179 18885 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:00.933933 18885 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:00.911266 18895 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:00.922477 18890 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:00.941341 18878 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:00.942169 18878 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:00.938617 18900 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:00.945227 18898 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:00.944063 18890 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:00.946748 18878 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:00.951761 18878 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:00.952265 18878 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:00.952991 18890 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:00.953635 18900 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:00.954540 18878 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:00.955483 18878 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:00.947997 18903 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:00.948489 18894 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:00.955983 18900 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:00.956621 18898 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:00.960685 18903 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:00.967455 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.210s	user 0.016s	sys 0.011s
W20260709 12:10:00.969399 17404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.372s	user 0.024s	sys 0.036s
W20260709 12:10:00.972891 17404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.375s	user 0.025s	sys 0.036s
I20260709 12:10:00.960186 18894 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:00.974282 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.217s	user 0.016s	sys 0.014s
I20260709 12:10:00.976137 18789 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:00.975244 18894 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:00.956000 18878 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:00.988011 18903 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:00.988497 18789 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:00.988986 17407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.382s	user 0.005s	sys 0.021s
W20260709 12:10:01.078495 17407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.472s	user 0.006s	sys 0.021s
W20260709 12:10:01.078868 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 2.47231e+06us
I20260709 12:10:00.966382 18898 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.114580 18895 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.127311 18889 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.227257 18878 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.229650 18902 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.229853 18889 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.230424 18902 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.230572 18889 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.232847 18902 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.232873 18889 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.235814 18909 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.229668 18906 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.237031 18885 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.246578 18895 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.239012 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.258605 17292 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
W20260709 12:10:01.241019 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 283313us
I20260709 12:10:01.240161 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.234141 18789 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.260690 18789 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.261861 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.261328 18789 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.246452 17189 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60632 (request call id 213) took 2789 ms. Trace:
I20260709 12:10:01.263809 18878 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.265574 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.266050 18897 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.266551 18897 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.268754 18897 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.263825 17189 rpcz_store.cc:276] 0709 12:09:58.456786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.457038 (+   252us) service_pool.cc:224] Handling call
0709 12:10:01.246387 (+2789349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1491601,"reported_tablets":1}
I20260709 12:10:01.236431 18909 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.237438 18906 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.251816 18829 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.272267 18829 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.273577 18909 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.274147 18909 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:01.278348 17333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.837s	user 0.022s	sys 0.054s
I20260709 12:10:01.278123 18909 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:01.278833 17333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.837s	user 0.022s	sys 0.054s
W20260709 12:10:01.280612 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.808s	user 0.029s	sys 0.055s
W20260709 12:10:01.281090 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.808s	user 0.029s	sys 0.055s
I20260709 12:10:01.250502 18907 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.243925 17186 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55944 (request call id 306) took 2855 ms. Trace:
I20260709 12:10:01.282260 18908 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.282624 17186 rpcz_store.cc:276] 0709 12:09:58.388158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.428429 (+ 40271us) service_pool.cc:224] Handling call
0709 12:10:01.243834 (+2815405us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":843,"reported_tablets":1}
I20260709 12:10:01.263243 18894 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.274412 18878 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.276230 18829 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.276638 18906 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.247213 18898 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.258495 18895 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.254348 18911 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.287225 18789 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.286842 18894 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.295763 18915 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.288825 18909 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.294313 18908 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.297338 18898 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.316015 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.312829 18766 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.306398 18904 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:01.320538 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 55113.1us
I20260709 12:10:01.309682 18909 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.323505 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.333608 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.334308 17292 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:01.337515 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.318761 18766 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.349931 17291 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:10:01.282518 18907 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.298825 18911 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.324286 18905 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.352658 18829 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.335888 18909 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.368273 18895 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.371172 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.374430 18012 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:01.307833 18915 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.379966 18895 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.381892 18900 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.379362 18918 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.373009 18829 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:01.386986 17462 debug-util.cc:398] Leaking SignalData structure 0x7b080017ade0 after lost signal to thread 17224
I20260709 12:10:01.395092 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.387912 18878 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.353358 18904 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.400291 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.396953 18898 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.391314 18894 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:01.395653 17462 debug-util.cc:398] Leaking SignalData structure 0x7b080017af20 after lost signal to thread 17238
I20260709 12:10:01.401445 18013 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:01.406402 18913 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.406955 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.375854 18905 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.407126 18913 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.409405 18913 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.410341 18894 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.410470 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.411044 18919 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.397142 18916 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.414407 18925 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.402204 18878 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.392880 18900 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.413866 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.413866 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.416682 18911 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.409935 18905 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.392961 18895 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:01.430481 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.410549 18901 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.411285 18908 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.410589 18920 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.428620 18909 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.418054 18829 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.429234 18907 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.412459 18898 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.432063 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.427454 18916 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.414983 18925 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.411077 18894 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.426973 18913 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.436957 18013 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:01.433162 18920 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.443311 18915 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.433367 18912 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.445235 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.398499 18918 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.451287 18921 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.426703 18926 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.428243 18878 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.454314 17441 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:01.448264 18766 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.451247 18910 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.451182 18923 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.461107 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.461836 17285 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.462131 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.467571 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.468392 17284 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:01.469185 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.426362 18919 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:01.464226 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.436821 18898 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.473532 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.446475 18901 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.450495 18913 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.476788 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.473346 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.478672 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.478307 17433 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:01.479346 17285 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:01.463640 18915 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.481071 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.482695 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.482800 17362 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:01.482177 18903 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.487829 18920 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.474581 18905 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.490613 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.491037 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.484795 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.479640 18924 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.497383 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.497932 17359 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:01.494270 17362 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:01.475023 18910 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.455185 18921 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.502565 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.505271 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.505888 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.469797 18926 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:01.509797 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.510504 17359 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:01.513190 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.510274 18918 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.493026 18903 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.516894 18901 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.516755 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.494562 18905 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.518170 18903 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.503307 18917 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.501700 18916 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.476267 18923 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.526091 17434 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.526865 18878 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.527329 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.527637 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.458861 18912 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.503152 18895 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.491052 18915 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.521039 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.531663 18909 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.502548 18894 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.520552 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.522347 18925 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.519771 18905 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.530179 18911 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.551182 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.531366 18012 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:01.532599 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.543807 18918 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:10:01.531651 18917 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.518400 18924 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.554663 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.546655 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:01.534219 17432 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:01.496732 18929 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.530511 18913 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.555835 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.558852 18766 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:10:01.567078 18919 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.533387 18909 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.562057 18921 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.556748 18911 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.562491 18930 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.562873 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.564755 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.557688 18009 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:01.569181 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:01.567374 18906 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.576773 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.577643 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:01.573767 18912 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.572712 18898 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.582468 18923 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.582912 18926 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.586432 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.587153 17361 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:01.587554 17258 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:01.586081 18885 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.584543 18930 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.583184 18911 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.584045 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.588244 18885 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.579011 18906 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.586388 18919 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.601681 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.591516 18915 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.601994 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.591346 18889 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.598474 18906 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.584064 18910 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.599335 18918 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.599419 18919 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:01.604339 18889 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.595909 18909 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.598905 18885 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.615891 18889 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.600528 18766 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:01.608317 18924 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.608085 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.616753 18919 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.643327 18010 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
W20260709 12:10:01.740192 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 143462us
I20260709 12:10:01.756699 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.756343 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.757395 17362 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
W20260709 12:10:01.760215 17978 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.618s (SENT)
I20260709 12:10:01.764468 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.576521 18929 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.616513 18918 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.643934 18766 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.767220 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.764866 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.772172 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.675448 18930 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.785506 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.781208 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.780769 17363 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:01.781751 17437 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:01.781860 18929 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.787185 18918 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:01.786194 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 187027us
I20260709 12:10:01.787206 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.788580 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:01.787701 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:01.780611 17462 debug-util.cc:398] Leaking SignalData structure 0x7b0800278260 after lost signal to thread 17316
I20260709 12:10:01.782331 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.789444 18902 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.789909 18902 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.789968 17362 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:10:01.790373 18933 ts_tablet_manager.cc:933] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:10:01.789306 17364 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:01.790402 18902 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.792835 18882 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.793700 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:01.794713 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.794672 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:01.798458 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:01.802431 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:01.802309 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.797452 18882 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.789472 18766 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.797067 18934 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.812294 18935 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:01.822626 17256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.418s	user 0.002s	sys 0.085s
I20260709 12:10:01.822891 18934 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.826465 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.827219 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.827593 18904 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.838548 18919 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.839784 17361 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 3: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:01.840744 18919 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.835299 18934 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:01.841437 17256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.446s	user 0.004s	sys 0.085s
I20260709 12:10:01.845546 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.836736 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.853968 18902 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.855196 18933 tablet_copy_client.cc:323] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:10:01.855592 18909 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:01.856060 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 95875.5us
I20260709 12:10:01.856128 18909 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.856644 18902 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.858624 18909 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.859071 18885 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.860983 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.862396 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.861047 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.869196 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:01.879429 17363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:01.880103 17363 raft_consensus.cc:606] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:01.882409 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.884488 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.886476 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.886554 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.889430 18930 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.889935 18930 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.890362 18930 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.851380 18906 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.911309 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.912390 18906 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.913673 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.914554 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.915259 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.915482 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.917054 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.917948 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:01.919056 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.836966 18889 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.919489 17406 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:01.921934 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.922132 18924 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.922425 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.922587 18924 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.923123 18924 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.923040 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.923569 18905 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.924044 18905 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.924446 18905 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:01.927237 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 128820us
I20260709 12:10:01.927937 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:01.928982 17258 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:01.916468 18934 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:01.929764 18906 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.929872 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:01.929913 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.930241 18906 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:01.930755 18902 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.931120 18906 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.931200 18902 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.931727 18902 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.936091 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.937264 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.937562 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.937878 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:01.938439 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.938704 18015 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:01.925452 17462 debug-util.cc:398] Leaking SignalData structure 0x7b0800346340 after lost signal to thread 17391
I20260709 12:10:01.939064 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.938624 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:01.943382 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:01.945837 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.946231 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.950449 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.950776 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.951578 18015 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:01.953250 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.934643 18935 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.960301 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.960821 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.962064 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.959836 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.963539 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet 7912262477ba4fc0a074c658eed0d241 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:10:01.965231 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.964195 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet 7912262477ba4fc0a074c658eed0d241 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-7912262477ba4fc0a074c658eed0d241
I20260709 12:10:01.969736 18885 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:01.973238 18882 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.973574 18900 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:01.975764 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:01.977233 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:01.977972 17437 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:01.963150 18935 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:01.990118 18935 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.991998 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:01.993884 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.995661 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.995903 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.973779 18882 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:01.996801 18889 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:01.997596 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.998025 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:01.986950 17462 debug-util.cc:398] Leaking SignalData structure 0x7b0800332a60 after lost signal to thread 17465
I20260709 12:10:01.999641 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.000025 18907 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.000240 17440 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:01.998383 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.001667 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.002081 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.001796 18904 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:02.003381 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.004129 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.004921 18766 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.005893 18882 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:02.007335 17287 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.008049 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.008694 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.008829 18766 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.009192 18905 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.010206 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.011484 17439 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:02.013036 18902 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.018056 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.018440 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.018762 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.018925 17287 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:02.019340 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.020053 17291 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:02.020226 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.021590 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.022241 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.024014 17287 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.025949 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:01.988175 17302 tablet_copy_source_session.cc:215] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:02.028469 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:02.029826 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 59046us
I20260709 12:10:02.031073 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:02.031806 17284 raft_consensus.cc:606] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:01.996837 18917 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:02.035619 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.037659 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:02.039274 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:02.039882 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:02.042778 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.042778 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.043901 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:02.045852 17981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.281s	user 0.006s	sys 0.030s
I20260709 12:10:02.047873 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.048056 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.049114 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.049276 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.049589 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.049798 17439 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:10:02.052009 18902 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.052951 18909 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.053609 18909 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.054198 18909 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.055660 18905 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:02.058827 18934 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.057416 18906 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:02.062134 17981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.298s	user 0.007s	sys 0.030s
I20260709 12:10:02.063382 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.066298 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.070967 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.075187 17362 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.077096 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.078428 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.079542 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.085039 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.085590 18940 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:02.086505 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.086822 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.087325 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:02.091089 17462 debug-util.cc:398] Leaking SignalData structure 0x7b08001fb740 after lost signal to thread 18039
I20260709 12:10:02.091500 18930 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.093740 18930 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:02.093451 17189 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 2, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 1 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:10:02.095213 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.095979 18940 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.097186 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.097003 18924 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.098426 18940 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:02.099157 18924 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:02.099254 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.099701 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.100769 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.100795 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:02.101218 17441 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.102679 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.100769 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.117349 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:02.119360 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 69897.3us
I20260709 12:10:02.121332 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.122717 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:02.117864 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:02.129201 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.133545 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.136271 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.138172 17255 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.117257 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.142920 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.144122 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.144886 18798 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.145273 18798 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:02.145650 18798 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.132153 18912 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.146416 18912 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:02.146648 18906 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.147303 18906 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.149684 18912 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.150314 17435 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.151124 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:02.152292 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.153177 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.153451 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.154825 17287 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.155292 17288 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.156029 17292 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.157680 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.157907 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.158597 18014 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:02.159175 17255 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.160543 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.162844 17255 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.162988 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.146538 18933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7912262477ba4fc0a074c658eed0d241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:02.170938 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.136816 18766 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.156206 18919 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.177551 18939 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.174430 18902 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.181015 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:02.140710 18917 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:02.192869 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 145175us
I20260709 12:10:02.193783 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.164654 18889 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.173532 18904 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.197327 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.188138 18906 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.205948 17289 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.203994 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.185650 18935 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.186982 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.213270 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:02.193109 18917 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:02.223793 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 46167.7us
I20260709 12:10:02.191244 18939 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:02.172621 18920 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:10:02.225767 18939 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.199239 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.220443 18902 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.222028 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.221829 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:02.194042 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.202550 18940 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.204689 18909 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.202188 18904 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:02.219755 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 88989.8us
I20260709 12:10:02.231976 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.232748 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.240773 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.227418 18917 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.205921 18906 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:02.233534 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.242214 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.243523 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.251283 18012 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:02.251952 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.241672 18904 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.253250 18935 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.254437 17332 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.244599 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.257751 18942 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:02.238370 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.239017 18889 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:02.234203 18902 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:02.246678 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.247409 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.248219 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:02.245930 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:02.263689 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.231206 17436 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 1.
I20260709 12:10:02.269232 18919 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.266855 17406 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:02.271121 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.272583 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.273355 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:02.275655 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.278431 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.276105 18902 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.253733 18906 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.279850 17404 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:02.284247 18930 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.258664 18914 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.284535 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:02.298130 18930 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:02.298655 18930 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.281831 18943 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.269611 18889 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:02.269488 18905 consensus_queue.cc:1059] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:10:02.292271 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.292659 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.241003 18009 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:10:02.294840 18011 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.243901 18798 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.297488 17404 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:02.304883 18949 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:02.309576 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.291397 18947 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.295408 18919 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:02.312753 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 84890.7us
I20260709 12:10:02.314146 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.312492 18947 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:02.315876 18897 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:02.316431 18949 raft_consensus.cc:697] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:02.319516 17255 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.320308 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.321830 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:02.322172 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.317468 18907 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.302654 18889 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.303454 18915 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.306234 18924 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:02.330880 17290 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.347754 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.313514 18920 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.349586 17332 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.331444 18897 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:02.351094 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:02.351989 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 54606.8us
I20260709 12:10:02.350864 18909 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.388314 17404 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:02.323377 18955 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:02.330117 18947 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.346225 18915 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:02.347556 18932 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.348994 18924 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:02.391574 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 54160.3us
I20260709 12:10:02.392993 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.386698 18897 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.397038 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.398411 17255 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.394795 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:02.393329 18950 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:10:02.388862 18907 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.395730 18798 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.393419 18949 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.404100 18934 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.396243 18924 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.405841 18944 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.401842 18766 raft_consensus.cc:993] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: : Instructing follower e860f7e876b74ec589f447737822a4f6 to start an election
I20260709 12:10:02.390350 18919 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.410342 17981 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.389294 18939 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:02.423635 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 137500us
I20260709 12:10:02.427398 17981 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.428579 17286 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:02.397452 18915 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.415668 18890 raft_consensus.cc:993] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:10:02.430433 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.431385 18911 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.431818 18926 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.428905 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.432578 18007 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.431746 18934 raft_consensus.cc:1081] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:10:02.430390 18910 raft_consensus.cc:1081] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Signalling peer e860f7e876b74ec589f447737822a4f6 to start an election
I20260709 12:10:02.434867 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.446501 18926 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:02.449316 18906 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.429427 18932 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:02.452956 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 103472us
I20260709 12:10:02.461328 18907 consensus_queue.cc:1059] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:02.462435 18907 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.463605 18766 raft_consensus.cc:3055] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.463956 18766 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:02.464860 18766 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.466130 18766 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.454409 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:02.455387 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 67193.5us
I20260709 12:10:02.492679 17362 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.433408 18943 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.494153 17981 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:02.434443 18960 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.456723 18926 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.497751 18951 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.530718 18951 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.530869 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:02.531158 18951 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:02.531560 18951 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.527549 18958 consensus_queue.cc:1059] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.534755 18970 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.535380 18970 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:02.535813 18970 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.537588 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.538949 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.544723 18972 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.545487 18972 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.546689 17404 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:02.499421 18940 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:02.555886 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 157560us
I20260709 12:10:02.494203 18919 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.551769 17404 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.546985 18951 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.555469 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.557498 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.561911 18926 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.555848 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.565234 18567 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.558270 18919 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:02.566550 18919 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.566733 18889 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:02.567575 18919 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.565647 18567 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:02.568900 18889 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:02.571538 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.459995 18912 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.575531 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.576714 18912 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.572455 18889 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.578178 17366 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.580006 17255 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.586397 18964 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.584534 17291 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.522439 18911 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:10:02.574486 18949 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.520123 18904 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.595989 17365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48990
I20260709 12:10:02.592736 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.593581 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.591159 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.547982 18915 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.582867 18955 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.587687 18889 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.599471 17365 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.598417 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.611075 17365 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:02.600641 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 275535us
I20260709 12:10:02.589839 18912 raft_consensus.cc:3055] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:02.610167 18952 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:10:02.616274 17362 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.614374 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.622256 18957 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.613698 18906 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.598755 18964 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:02.628188 18951 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:02.626046 18007 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:02.634653 18009 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.599468 18011 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:02.614357 18912 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:02.648875 18953 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.643414 18917 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.648939 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.615228 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.658761 18951 consensus_queue.cc:1059] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:02.659312 18915 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:02.659821 18012 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.661648 18924 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.660054 18567 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.671825 18567 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.660735 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.673410 18924 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:02.660010 18900 raft_consensus.cc:3055] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.674679 18900 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:02.676478 18900 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.677793 18900 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.661326 18904 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:02.630031 18905 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.684791 18905 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:02.650998 18939 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.683907 18902 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.669044 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.632555 18964 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.686879 18905 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.687883 18912 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.665128 18942 consensus_queue.cc:1059] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:02.632278 18930 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.698969 18942 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.699493 18942 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:02.700670 18942 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.712265 17285 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.714399 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.714572 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.718573 18902 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.720618 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.720681 18912 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.721454 18940 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.683760 18897 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:02.725262 18897 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:02.726955 18798 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.728379 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.728713 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.729344 18926 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:02.747361 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.748457 17365 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.757866 17365 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.724417 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.735671 18940 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:02.764564 18942 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.731879 18934 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.764122 18940 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.731596 18953 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:02.712543 18905 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.787752 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.789093 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.766498 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.782883 18941 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:02.791375 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.783579 18798 consensus_queue.cc:1059] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:10:02.794488 17258 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.784911 18947 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.785959 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.786773 18007 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.796161 18953 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.796593 18953 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:02.796461 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.799660 18953 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.800061 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.805994 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.807277 17258 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.786064 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.814493 18966 consensus_queue.cc:1059] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:02.813828 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:02.804800 18953 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.823443 18015 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.808189 18957 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:02.823397 17333 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f950276bbbb4642872e9280fad2a766. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.811818 18949 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.765261 18914 consensus_queue.cc:1059] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:02.844347 18914 raft_consensus.cc:3055] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.809798 18902 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:02.824361 18960 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:02.821964 18889 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.839257 17333 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.801436 18933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52232 (request call id 460) took 1337 ms. Trace:
I20260709 12:10:02.809204 18941 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:02.843240 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:02.812177 18932 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.850708 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.844753 18914 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:02.856812 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.847666 18930 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:02.863998 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.865298 17333 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.866051 18920 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.857559 18904 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.852576 18902 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:02.851920 18960 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.855955 18917 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.871402 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:02.871865 17433 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.872231 18919 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.866084 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:02.874279 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.874954 18902 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.876143 18798 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:02.882153 17406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.024s
W20260709 12:10:02.886638 17406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.003s	sys 0.024s
W20260709 12:10:02.886984 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 562511us
W20260709 12:10:02.879259 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 385356us
I20260709 12:10:02.854839 18912 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.873680 18904 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:02.895906 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.883697 18977 ts_tablet_manager.cc:933] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:02.885731 17333 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.898355 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:02.901669 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 293585us
W20260709 12:10:02.877632 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 318406us
I20260709 12:10:02.902064 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.892710 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.890017 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.903483 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.904377 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.890691 18958 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.911505 18912 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.895246 18941 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.886327 18798 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:02.919368 17404 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.899788 18904 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.921506 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:02.922555 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.925136 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.932087 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.932436 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:02.932796 17288 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.933168 17288 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:02.933795 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.905544 18914 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.927402 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.925455 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.902091 18917 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.929294 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.938288 17292 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:02.938030 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.935529 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.932128 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:02.950984 17285 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.931960 18961 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.914594 18958 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:02.927851 18900 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.956406 18885 raft_consensus.cc:3055] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.949961 18010 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.932505 18798 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.964285 18766 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:10:02.930253 18926 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.970459 17291 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.917390 18919 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:10:02.976709 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 47580.2us
I20260709 12:10:02.967744 18958 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.979522 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.848829 18933 rpcz_store.cc:276] 0709 12:10:01.456134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.456580 (+   446us) service_pool.cc:224] Handling call
0709 12:10:01.790817 (+334237us) ts_tablet_manager.cc:934] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
0709 12:10:02.128704 (+337887us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:02.355601 (+226897us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:02.355729 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:02.694573 (+338844us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:02.713159 (+ 18586us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:02.791592 (+ 78433us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:02.792711 (+  1119us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19405,"tablet-copy.queue_time_us":307110,"thread_start_us":342221,"threads_started":2}
I20260709 12:10:02.970620 18885 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:02.988912 18906 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:02.989303 18919 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.989864 18919 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:02.991693 18920 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.991535 18919 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:02.993186 17333 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:02.993449 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.980670 18917 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.954685 18911 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:10:02.996078 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 74661.4us
I20260709 12:10:02.997869 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:02.998939 17407 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:02.979183 18947 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:02.997051 18972 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.999715 18907 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.007582 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:03.009581 18951 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.010144 18951 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:03.015934 17432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33826
I20260709 12:10:03.016573 17432 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.016973 17432 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.002200 18933 tablet_copy_client.cc:806] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:03.001987 18912 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.019695 17435 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:10:03.019965 18940 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.020632 18885 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.018389 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:03.023664 18912 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:03.011142 18951 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.026085 17438 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.026697 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:03.032754 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:03.013540 18960 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:03.052734 18970 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
I20260709 12:10:02.933943 17288 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.038614 18962 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:03.038955 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:03.043798 18885 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.044505 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:03.035068 18933 tablet_copy_client.cc:670] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:03.056038 17432 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:03.057359 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 58464.9us
I20260709 12:10:03.059340 18972 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.048686 18912 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.072624 18958 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.053305 18970 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.018507 18920 consensus_queue.cc:1059] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:10:03.080395 17359 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.083186 17432 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:03.036566 18907 consensus_queue.cc:1059] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:03.080899 18951 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.082006 17434 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.092983 17291 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:03.095918 17407 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:03.102553 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:03.077780 18964 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.103247 17367 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.087518 18958 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:03.104683 17407 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.103564 17367 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:03.077544 18962 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.098897 18920 raft_consensus.cc:3055] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.113973 17407 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:03.111995 17367 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.114640 18967 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.115091 17367 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:03.115775 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.116586 18967 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.117654 17407 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:03.124310 17407 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:03.124699 17367 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:03.103595 18905 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.129952 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:03.113682 18933 tablet_copy_client.cc:538] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.134558 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:03.136004 17407 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.124786 18976 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:10:03.202201 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.126272 18900 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.138383 17407 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:03.159878 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.112203 18904 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.130625 18972 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.155210 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:03.214596 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 76281.4us
I20260709 12:10:03.224015 17407 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.145629 18975 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:03.122484 18920 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:03.147153 18926 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.151988 18970 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:03.251156 17439 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.252014 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:03.244935 18975 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:03.254824 18981 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:03.256731 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:03.257474 17441 raft_consensus.cc:2393] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:03.255287 18975 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.255885 18967 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.265604 18954 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.270788 18980 ts_tablet_manager.cc:933] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:03.272150 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:03.283905 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.283946 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:03.286300 17441 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:03.262435 18920 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.287195 17437 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.288826 18920 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.288000 17361 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 2: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:03.298622 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:03.307756 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:03.308200 18906 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.310683 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:03.311514 17981 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:03.310249 18906 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.327934 17981 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:03.284983 18964 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:03.330672 18567 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.312845 18934 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.286983 18798 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.329074 18906 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.315400 18953 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.355840 18912 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.364022 17367 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.346967 18914 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.288062 18962 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:03.346469 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:03.349076 18934 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:03.364794 18904 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:03.358132 18889 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:03.376482 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:03.470299 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.401978 17407 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:03.479074 17406 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.480641 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.481995 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:03.486438 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 84585.3us
I20260709 12:10:03.487740 17407 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:03.507037 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.407660 18912 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:03.407083 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:03.487352 18967 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.487208 18962 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.486660 18897 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.488351 18976 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.506052 17434 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.503561 18977 tablet_copy_client.cc:323] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:10:03.505581 18970 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.525216 18932 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:03.526748 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:03.532507 18007 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:03.533418 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:03.487916 18934 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.552189 18932 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:03.554193 18011 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.546370 17407 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.567554 18976 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.568207 17450 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet ee22d4e5e05e423097297625d6158f21 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:10:03.568833 17450 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet ee22d4e5e05e423097297625d6158f21 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-ee22d4e5e05e423097297625d6158f21
I20260709 12:10:03.568931 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:03.562402 18942 consensus_meta.cc:287] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.002s
I20260709 12:10:03.569765 18976 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.576880 17186 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:03.578687 18919 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:03.582496 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 99269.8us
I20260709 12:10:03.593252 17440 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.593523 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.596511 18897 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.599179 17406 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.600980 18900 raft_consensus.cc:3055] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.601496 18900 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:03.606292 18933 tablet_bootstrap.cc:492] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:10:03.607681 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:03.609858 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.607892 18951 consensus_meta.cc:287] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 12:10:03.617271 18970 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:03.565627 18944 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:03.607342 18934 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.610203 18976 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.623169 18900 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:03.684998 17290 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.003s	sys 0.019s
W20260709 12:10:03.685520 17333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.011s	sys 0.012s
W20260709 12:10:03.685243 17332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.016s
I20260709 12:10:03.732784 18944 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:03.707922 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.736035 18015 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:03.736819 17332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.000s	sys 0.016s
W20260709 12:10:03.737339 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 639936us
I20260709 12:10:03.744969 18958 raft_consensus.cc:3055] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.745545 18958 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:03.709702 18798 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:03.752936 18798 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.634410 18766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34692 (request call id 11) took 5220 ms. Trace:
I20260709 12:10:03.754825 18766 rpcz_store.cc:276] 0709 12:09:58.406319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.406474 (+   155us) service_pool.cc:224] Handling call
0709 12:09:58.413640 (+  7166us) log.cc:844] Serialized 506 byte log entry
0709 12:10:03.623708 (+5210068us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62298,"raft.run_cpu_time_us":1240,"raft.run_wall_time_us":1250,"thread_start_us":2866568,"threads_started":2,"wal-append.queue_time_us":119100,"wal-append.run_cpu_time_us":1861,"wal-append.run_wall_time_us":1014893}
I20260709 12:10:03.756582 18798 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:03.758091 17333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.012s	sys 0.012s
W20260709 12:10:03.759017 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 697218us
I20260709 12:10:03.760649 18966 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:03.762575 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:03.762912 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:03.764616 17290 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.003s	sys 0.021s
W20260709 12:10:03.685911 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.767846 18900 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.652593 18980 tablet_copy_client.cc:323] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
W20260709 12:10:03.638193 18940 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.004s
I20260709 12:10:03.710943 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:03.771026 18014 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.771313 18935 consensus_queue.cc:1059] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:03.687237 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 67756.5us
W20260709 12:10:03.718433 18902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.011s	sys 0.030s
I20260709 12:10:03.780441 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.719060 18932 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:03.781854 18902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.012s	sys 0.031s
I20260709 12:10:03.782487 17433 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:03.651921 18956 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.030s	sys 0.046s
W20260709 12:10:03.783319 18956 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.030s	sys 0.047s
I20260709 12:10:03.787453 17450 tablet_copy_source_session.cc:215] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.761575 18966 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.792726 18966 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:03.804788 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 112743us
I20260709 12:10:03.808864 18953 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:03.810081 18953 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.734239 18944 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.713977 18889 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:03.757366 18798 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:03.821056 17407 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:03.822455 18766 consensus_queue.cc:1059] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:03.823740 18981 raft_consensus.cc:3055] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:03.824162 18981 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:03.825831 17286 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.834944 18953 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:03.836231 18958 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.838294 18932 raft_consensus.cc:3055] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.839058 18932 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:03.825467 18981 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:03.840642 18932 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.843811 18944 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:03.848322 18932 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.841217 18981 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.858498 18014 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:03.843815 18889 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:03.860292 18798 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:03.864230 17367 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.864733 18011 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:03.869307 18889 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:03.865620 18798 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:03.870133 18958 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.870601 18914 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.871120 18914 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:03.872471 18914 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.874126 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:03.874433 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:03.875272 17284 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:03.875454 17289 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:03.885182 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:03.878545 18943 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.886986 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:03.886749 18943 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.886581 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:03.889976 18943 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:03.890854 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:03.887410 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:03.890738 18974 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.894591 18974 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:03.894613 17366 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:03.900216 18974 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.903939 18974 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.905462 17978 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:03.895563 18914 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.907619 18011 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.910401 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:03.912307 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:03.914522 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:03.917090 17288 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.931649 18897 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:03.933440 17436 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.932646 18915 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:03.934778 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 154672us
I20260709 12:10:03.935856 17406 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:03.934057 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 113387us
I20260709 12:10:03.938925 17359 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:03.939414 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.941097 17359 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:03.942540 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:03.944056 18977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee22d4e5e05e423097297625d6158f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:03.938750 17450 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 1c41ebef06654a43a98e69d0c065bba4 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:10:03.939254 18947 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.936589 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:03.934175 18954 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.951139 17450 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 1c41ebef06654a43a98e69d0c065bba4 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-1c41ebef06654a43a98e69d0c065bba4
I20260709 12:10:03.934592 18930 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.949692 17440 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.949930 18915 raft_consensus.cc:3055] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.953841 18915 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:03.955029 18915 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.956576 18915 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.959293 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:03.959722 18012 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:03.964197 18953 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:03.965416 18953 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.965788 18953 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:03.966050 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:03.966874 18953 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.970685 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:03.967031 17436 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 2: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:03.969777 18953 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.971957 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:03.934067 18897 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:03.980273 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.983238 18947 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:03.979063 18897 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:03.989120 18897 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:03.990859 18897 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.006729 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.007634 17286 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:04.012079 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:04.013068 18943 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.013499 18943 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.013856 18943 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.020236 17288 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:04.032999 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1224) took 1095 ms. Trace:
I20260709 12:10:04.034535 17288 rpcz_store.cc:276] 0709 12:10:02.931630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.931788 (+   158us) service_pool.cc:224] Handling call
0709 12:10:03.916168 (+984380us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b580016a3d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225a770aa 00007f1225af9447 00007f1225b11fe7 00007f1225b137de 00007f1225b1f27c 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c
0709 12:10:04.026938 (+110770us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615015040}
I20260709 12:10:04.037744 18951 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:04.037369 18930 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:04.037324 18947 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:04.040614 18930 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:04.041049 18930 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:04.042191 18930 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.044200 18930 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:04.045769 19004 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.113s	user 0.000s	sys 0.002s
I20260709 12:10:04.056034 18971 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.056674 18971 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.061156 18971 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.065354 17441 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.068365 17450 tablet_copy_source_session.cc:215] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:04.072278 18980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c41ebef06654a43a98e69d0c065bba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:04.072361 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.072266 17255 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:04.077135 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.077257 18910 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.077927 18910 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.081192 18910 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:04.089174 19001 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.104017 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:04.104285 18919 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:04.105083 17441 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:04.107753 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.108690 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:04.109196 17189 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 4, term changed from 3 to 4, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to <none>, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:10:04.115620 18919 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:04.096654 19001 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.116596 19001 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:04.117043 19001 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.117158 18919 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.136700 18798 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:04.137825 18798 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.139971 18798 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.141666 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.136178 18980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52246 (request call id 439) took 1352 ms. Trace:
W20260709 12:10:04.146965 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.150815 18943 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.146379 18980 rpcz_store.cc:276] 0709 12:10:02.783967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.790199 (+  6232us) service_pool.cc:224] Handling call
0709 12:10:03.271206 (+481007us) ts_tablet_manager.cc:934] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
0709 12:10:04.070798 (+799592us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:04.127907 (+ 57109us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:04.128072 (+   165us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:04.135307 (+  7235us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:04.135622 (+   315us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:04.135943 (+   321us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:04.136073 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":310,"tablet-copy.queue_time_us":454283,"thread_start_us":593199,"threads_started":2}
I20260709 12:10:04.153487 18943 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:04.153767 18980 tablet_copy_client.cc:806] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:04.154201 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:04.154554 18980 tablet_copy_client.cc:670] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:04.154961 17290 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.156283 17364 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:04.159020 17255 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.160300 18959 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.160668 18959 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:04.161000 18980 tablet_copy_client.cc:538] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:04.161010 18959 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:04.161572 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 60843.6us
I20260709 12:10:04.167716 18977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52246 (request call id 431) took 1493 ms. Trace:
I20260709 12:10:04.195261 17332 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.200456 18014 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.205035 17288 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.205431 18934 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.205964 18934 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.208076 18934 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:04.210484 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.211263 17365 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:04.216042 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.217563 17440 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:04.219183 18956 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.219807 18956 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:04.217598 17290 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:04.229262 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:04.220839 18956 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.235005 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:04.236042 18953 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:04.230844 18889 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.246399 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.240502 18953 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:04.252140 18953 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.253305 17290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:04.254087 17290 raft_consensus.cc:606] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.240779 18889 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.254535 17290 raft_consensus.cc:614] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:04.254985 19006 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:04.258253 18889 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.261569 19001 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:04.262284 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.266151 18889 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.269100 18889 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:04.262259 17291 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:04.277629 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:04.278424 17360 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.281725 17364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:04.282495 17364 raft_consensus.cc:606] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:04.179859 18977 rpcz_store.cc:276] 0709 12:10:02.610641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.610793 (+   152us) service_pool.cc:224] Handling call
0709 12:10:02.914323 (+303530us) ts_tablet_manager.cc:934] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
0709 12:10:03.942259 (+1027936us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:04.080701 (+138442us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:04.080933 (+   232us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:04.091946 (+ 11013us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:04.092335 (+   389us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:04.092856 (+   521us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:04.103542 (+ 10686us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":113366,"tablet-copy.queue_time_us":272203,"thread_start_us":616290,"threads_started":2}
I20260709 12:10:04.293579 18914 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.284214 18958 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:04.299005 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:04.296540 18914 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.295099 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:04.303606 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:04.304638 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:04.294209 18977 tablet_copy_client.cc:806] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:04.312194 17360 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:04.315659 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.310633 18977 tablet_copy_client.cc:670] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:04.318578 18889 consensus_queue.cc:1059] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.311586 18958 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.312862 19001 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.320816 19000 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:04.324160 18951 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:04.324431 19000 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:04.320852 18932 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:04.325029 18951 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:04.326781 19010 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:10:04.328361 18951 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:04.330256 18914 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:04.334045 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.334977 17290 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:04.339144 18932 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:04.348193 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:04.352568 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.353422 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:04.346567 19008 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:10:04.357004 18932 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.358091 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.359122 18974 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.359669 18959 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.360641 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.361214 17364 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:04.361447 18974 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.362171 18974 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:04.363005 17255 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.363621 18798 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.364053 19001 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:04.364203 18798 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:04.366796 19009 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:10:04.367235 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.367900 17362 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:04.369341 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.370355 19002 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:04.370699 18974 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:04.371132 18974 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:04.355942 18951 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.372332 18951 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.372579 18973 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.373374 18958 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.373274 18798 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:04.373262 18943 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.372150 18974 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.374667 18943 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.374948 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.375852 19002 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.376230 19002 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.376556 19002 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.377018 18943 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.379308 18974 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.380402 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.381563 18934 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.382077 18934 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.384238 18934 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:04.385187 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:04.389010 18914 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.389806 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.325805 19000 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.389642 18914 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.378373 17188 catalog_manager.cc:5697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 2 to 3, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 3 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.391098 19000 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:04.392563 18914 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.393335 19001 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:04.372732 18951 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.395187 17980 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.397516 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.398309 17290 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:04.398571 18959 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.357051 18956 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.399501 18914 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.369699 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.393673 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:04.405728 18974 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.405972 17440 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:04.406210 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:04.406994 18974 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.407523 18974 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:04.407661 17981 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:04.409381 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:04.408411 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.410023 17365 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.410136 17359 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:04.408514 18974 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.411403 17187 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55928 (request call id 322) took 1641 ms. Trace:
I20260709 12:10:04.408908 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.412228 19001 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.413327 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:04.408682 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.418478 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.425012 17365 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:04.420203 17362 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:04.406862 17188 catalog_manager.cc:5697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:04.405447 18951 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.414789 17187 rpcz_store.cc:276] 0709 12:10:02.769935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.770346 (+   411us) service_pool.cc:224] Handling call
0709 12:10:04.411042 (+1640696us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7}
I20260709 12:10:04.385576 19002 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.440171 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.443210 18889 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.425917 18943 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.445066 18943 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.445442 18943 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.445845 18798 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:04.452270 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.452529 19002 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:04.453038 17291 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:04.454382 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:04.454970 17366 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.456197 18980 tablet_bootstrap.cc:492] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:10:04.459867 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:04.464318 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:04.465449 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.467041 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:04.469601 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:04.471131 17440 raft_consensus.cc:2393] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:04.475199 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.473892 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:04.476593 18933 tablet_bootstrap.cc:492] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:04.477286 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.478003 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.478677 17360 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:04.483459 18960 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.483966 18960 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:04.484169 17291 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:04.484768 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:04.477645 18933 tablet_bootstrap.cc:492] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:10:04.488267 18933 ts_tablet_manager.cc:1403] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.882s	user 0.033s	sys 0.009s
I20260709 12:10:04.477922 17290 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:04.490701 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:04.488840 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:04.492221 17438 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:04.468708 19020 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.494607 17332 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.499593 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:04.493943 19020 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:04.493754 18977 tablet_copy_client.cc:538] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:04.505103 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:04.505606 18947 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.506001 17435 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 2: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:04.496529 19002 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.508143 19002 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.509095 17332 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.509989 18958 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.492136 18960 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.511169 17332 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.495599 17364 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:04.534390 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.503455 18971 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.502286 19020 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.527788 18958 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.529986 18981 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:04.567526 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 78799.3us
I20260709 12:10:04.557267 17255 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:04.510900 19000 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:04.582229 19001 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.582888 19001 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.546136 18973 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.555859 18958 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.549983 19002 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:04.585007 19001 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.543092 18971 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.587812 19001 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.592294 17406 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:04.556129 18981 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:04.601562 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:04.608071 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.580840 18897 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:04.579490 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:04.591713 18971 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:04.623742 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 109640us
W20260709 12:10:04.625962 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 81444.8us
W20260709 12:10:04.646647 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 78305.2us
I20260709 12:10:04.629082 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:04.612865 18981 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.628870 18947 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.639470 17360 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
W20260709 12:10:04.628528 19017 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:04.638242 18897 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.600188 19001 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:04.667936 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:04.624660 18006 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:04.669319 17290 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.674490 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:04.675360 18010 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:04.676012 18947 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:04.677176 18947 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.684574 17255 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.689216 17366 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:04.692982 18933 raft_consensus.cc:359] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:04.696425 18932 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.697070 18932 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.697439 18932 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.703305 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.713568 19002 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:04.670498 18914 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.693958 18933 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:10:04.696502 18951 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:04.698834 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:04.734242 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:04.734706 18011 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:04.734961 17440 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:04.734161 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:04.738008 17437 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:04.734138 18914 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.740070 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:04.741055 18951 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.724176 18971 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:04.726328 18952 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:10:04.728559 19001 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:04.730208 19018 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:10:04.731004 19002 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:04.733325 18897 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:04.758807 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.759473 17360 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:04.758919 19002 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.765753 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:04.766481 17361 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.766832 17290 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:04.755846 18977 tablet_bootstrap.cc:492] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:10:04.749778 18958 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.800007 18932 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.797840 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.802484 17361 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:04.802968 17362 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:04.789785 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:10:04.805599 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 81238.1us
I20260709 12:10:04.806830 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.756569 18981 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.814007 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:04.805239 17364 raft_consensus.cc:2368] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4.
I20260709 12:10:04.815605 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:04.789815 18914 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:04.812644 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:04.824560 17258 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:04.826695 18971 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.829748 18932 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.831343 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:04.837095 17361 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.835227 17288 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:04.857173 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:04.857792 17433 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.768376 18933 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:04.862543 18932 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.807432 19020 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.838152 19000 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.871016 19028 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.871483 19028 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.876816 19024 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:04.880168 18015 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:04.882066 17361 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:04.868697 19000 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.873755 19028 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.891947 19000 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.870334 18932 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.892990 18012 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:04.855086 18960 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.868019 18943 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.882540 19024 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:04.910750 18011 raft_consensus.cc:1217] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:04.912091 18960 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:04.913120 19034 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:04.914937 18933 ts_tablet_manager.cc:1434] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.426s	user 0.009s	sys 0.000s
I20260709 12:10:04.890921 17255 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:04.892114 18006 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.903136 18914 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:10:04.906257 17433 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:04.926764 19033 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:04.927317 19033 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:04.928274 19033 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:04.930071 17288 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:04.931218 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:04.932247 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:04.934068 17284 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:04.939997 18958 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:04.958480 19038 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:04.958835 19037 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.959182 19038 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.962145 18981 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.962746 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:04.963343 18015 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.963625 18932 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:04.965121 18943 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:04.966220 19038 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:04.966547 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.967407 19024 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:04.968420 18971 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.973641 18015 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:04.976212 17440 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:04.939285 18919 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:04.978317 17440 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.978190 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:04.979481 17441 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.983850 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:04.984560 17440 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.985165 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:04.985759 17365 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:04.987098 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:04.987557 17364 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.987931 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:04.988766 17433 raft_consensus.cc:2393] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:04.968968 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-7912262477ba4fc0a074c658eed0d241 received from {username='slave'} at 127.0.0.1:36408
I20260709 12:10:04.987854 17366 raft_consensus.cc:2368] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3.
I20260709 12:10:04.993583 17404 leader_election.cc:400] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4.
I20260709 12:10:04.994541 17404 leader_election.cc:403] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:04.996193 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:04.996930 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:05.001845 17333 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:05.015188 17441 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:04.965754 18943 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:04.963351 19020 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:05.019729 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 83426us
I20260709 12:10:05.028889 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:05.033878 17288 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:05.018293 18919 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:05.038489 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 59487.8us
I20260709 12:10:05.037456 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:05.041478 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:05.042124 17289 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.024026 18947 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4.
I20260709 12:10:05.034214 18959 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.052591 17361 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:05.053897 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:05.054649 18010 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:05.041280 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-7912262477ba4fc0a074c658eed0d241 on tablet 7912262477ba4fc0a074c658eed0d241 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:05.037688 18934 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:05.046859 18959 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.049436 18919 raft_consensus.cc:697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:05.069430 19032 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:05.071907 19032 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.074954 19028 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.077317 19028 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:05.048519 19038 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:05.078536 18919 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.078856 19038 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.080734 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:05.068946 17440 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:05.081830 17188 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55944 (request call id 308) took 1063 ms. Trace:
I20260709 12:10:05.094463 17978 leader_election.cc:400] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3.
I20260709 12:10:05.094830 17978 leader_election.cc:403] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:05.095824 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:05.081903 19038 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:05.101315 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:05.102020 17441 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:05.102058 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:05.102373 17360 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:05.104604 17289 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:05.083401 18959 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.107553 19040 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.104813 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:05.105774 17980 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:05.110181 18981 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:05.111617 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:05.130493 17362 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:05.113953 19044 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:10:05.115056 19020 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.118892 19037 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.135998 19049 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3.
I20260709 12:10:05.101315 19032 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:05.106403 18971 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:05.139494 19039 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.093963 17188 rpcz_store.cc:276] 0709 12:10:04.018508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.018678 (+   170us) service_pool.cc:224] Handling call
0709 12:10:05.081747 (+1063069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:04.488596 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:04.510652 (+ 22056us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:04.518429 (+  7777us) write_op.cc:435] Acquired schema lock
0709 12:10:04.528577 (+ 10148us) tablet.cc:662] Decoding operations
0709 12:10:04.585577 (+ 57000us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:04.585633 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:04.585661 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:04.588090 (+  2429us) tablet.cc:701] Row locks acquired
0709 12:10:04.588108 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:04.588283 (+   175us) write_op.cc:270] Start()
0709 12:10:04.588406 (+   123us) write_op.cc:276] Timestamp: P: 1783599004588233 usec, L: 0
0709 12:10:04.588428 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:04.607125 (+ 18697us) log.cc:844] Serialized 919 byte log entry
0709 12:10:04.915835 (+308710us) op_driver.cc:464] REPLICATION: finished
0709 12:10:05.074380 (+158545us) write_op.cc:301] APPLY: starting
0709 12:10:05.074476 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:05.074612 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:05.074734 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:05.075109 (+   375us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:05.075268 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:05.075308 (+    40us) write_op.cc:312] APPLY: finished
0709 12:10:05.075522 (+   214us) log.cc:844] Serialized 29 byte log entry
0709 12:10:05.075708 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.075792 (+    84us) write_op.cc:454] Released schema lock
0709 12:10:05.075829 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:05.076580 (+   751us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.076615 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14444,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":153646,"apply.run_cpu_time_us":1987,"apply.run_wall_time_us":1985,"num_ops":2,"prepare.queue_time_us":167,"prepare.run_cpu_time_us":4077,"prepare.run_wall_time_us":118820,"replication_time_us":311326,"thread_start_us":101834,"threads_started":1}]]}
I20260709 12:10:05.141211 19020 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:05.167227 19020 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.122284 17360 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:05.133466 18953 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.192379 17189 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.197304 18953 raft_consensus.cc:697] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:05.203655 19000 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.211076 18932 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:05.216766 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 103339us
I20260709 12:10:05.225404 17288 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:05.225521 17189 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 3, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 3 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.232431 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:05.232815 18953 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.233911 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:05.238076 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:05.244872 17360 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:05.239490 17189 catalog_manager.cc:5697] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.247937 17291 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.255542 18897 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:05.259544 19024 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.260028 19024 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:05.260393 19024 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.263583 18010 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.279276 18013 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.239682 19039 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:05.290630 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:05.306933 18981 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:05.307751 18009 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.308665 19000 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:05.308816 18971 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:05.309430 18971 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.291806 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:05.310494 18012 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:05.311704 18971 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:05.313341 19055 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.157s	user 0.000s	sys 0.004s
W20260709 12:10:05.270728 18980 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 12:10:05.294167 17285 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:05.295045 18958 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:05.342434 18958 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.347918 18980 tablet_bootstrap.cc:492] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:05.348946 18980 tablet_bootstrap.cc:492] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:10:05.349697 18980 ts_tablet_manager.cc:1403] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.894s	user 0.037s	sys 0.003s
I20260709 12:10:05.325708 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:05.350898 17364 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.329136 19039 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:05.329378 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:05.362716 17435 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:05.363345 17286 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:05.364336 18958 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:05.334728 17291 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:05.291922 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:05.339049 18959 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.333825 18013 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:05.376397 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 79186.2us
I20260709 12:10:05.377378 17436 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.385615 19029 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.386303 18915 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.386247 19029 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:05.387086 18915 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:05.390511 18900 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.353359 18009 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:05.396134 17359 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:05.396231 17407 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:05.381800 17364 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:05.443109 17332 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:05.451195 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:05.452209 18012 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:05.394016 18980 raft_consensus.cc:359] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:05.438033 18947 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.463958 17433 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:05.464560 18915 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:05.465876 18919 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.466326 19037 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:05.466444 18919 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:05.466886 19037 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.417376 18900 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.467360 18919 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:05.468997 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:05.469435 18900 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:05.462857 18947 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:05.470347 18947 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.473730 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:05.461714 18980 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:10:05.485508 17367 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:05.485805 18980 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:05.488762 18980 ts_tablet_manager.cc:1434] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.139s	user 0.006s	sys 0.000s
I20260709 12:10:05.490435 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:05.452317 19043 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.491375 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:05.495868 17367 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:05.499348 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:05.501173 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:05.501590 19030 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:05.503279 19030 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.503759 19030 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:05.504654 19030 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.514941 17291 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:05.519840 18015 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:05.523089 19045 raft_consensus.cc:2764] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:05.496225 17436 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:05.492524 18007 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:05.530365 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:05.547762 18012 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.557017 19001 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:05.557837 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:05.558385 19025 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.558578 17359 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.560621 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:05.515443 18943 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:05.529922 19037 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:05.602350 19001 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.607012 19026 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.521377 19043 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:05.558960 19025 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:05.618599 19026 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:05.619654 17436 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:05.620517 18010 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:05.598747 18900 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.624083 19024 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.605195 18954 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.634153 18900 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:05.635195 18798 raft_consensus.cc:1064] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:10:05.640848 17359 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:05.632237 18960 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:05.649189 18954 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.649585 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:05.650422 17366 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:05.650697 18947 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.634243 19001 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:05.651778 18954 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:05.652247 19001 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.652874 18947 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:05.654371 19026 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:05.638698 19049 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.641966 18959 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:05.658530 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:05.660351 17450 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-1c41ebef06654a43a98e69d0c065bba4 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:10:05.660882 17450 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-1c41ebef06654a43a98e69d0c065bba4 on tablet 1c41ebef06654a43a98e69d0c065bba4 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:05.666308 19029 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:05.667024 19049 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.668548 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:05.669237 18006 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:05.618151 18932 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:05.659261 17433 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:05.638016 18900 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:05.676142 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:05.682534 18900 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.683102 18900 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.682673 18007 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:05.684333 18900 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.652886 19032 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.665899 19025 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:05.689689 19032 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:05.688107 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:05.693514 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:05.697203 19038 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.697644 19038 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:05.698037 19038 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.698534 19043 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:05.701035 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:05.707298 19025 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.707898 19025 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:05.708276 19025 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.716939 18012 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:05.719049 19032 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:05.720558 19024 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:05.725126 18798 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:05.738919 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 44133us
I20260709 12:10:05.740000 19049 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:05.752310 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:05.754276 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 60099.9us
I20260709 12:10:05.755744 18910 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:05.760063 17436 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:05.797838 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:05.804155 17255 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:05.765193 17441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.009s
I20260709 12:10:05.766404 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:05.813742 17441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.011s	sys 0.009s
I20260709 12:10:05.808506 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:05.824311 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 414630us
W20260709 12:10:05.769217 19020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.018s
I20260709 12:10:05.769130 17286 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.772540 18977 tablet_bootstrap.cc:492] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:05.772409 18956 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:05.860662 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:05.861742 17359 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:05.753538 19025 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.757344 19038 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.782550 18006 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:05.786150 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 345772us
I20260709 12:10:05.768460 18900 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:05.846951 17366 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:05.843946 17362 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
W20260709 12:10:05.772909 17361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.012s	sys 0.010s
W20260709 12:10:05.940348 17361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.012s	sys 0.010s
I20260709 12:10:05.865159 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:05.848791 19041 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:05.887912 17189 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.039s	sys 0.018s
W20260709 12:10:05.943929 17189 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.039s	sys 0.018s
W20260709 12:10:05.897883 17360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.021s	sys 0.018s
W20260709 12:10:05.944623 17360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.021s	sys 0.018s
I20260709 12:10:05.898799 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:05.860103 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:05.849145 18919 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:05.848678 19068 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.938334 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:05.955706 17433 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
W20260709 12:10:05.859315 19020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.000s	sys 0.019s
I20260709 12:10:05.910472 19033 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.939483 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:05.947669 18953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.017s	sys 0.010s
I20260709 12:10:05.936004 19028 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.967183 17359 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.982100 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:05.982933 17367 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:05.943661 19041 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.968114 17363 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:05.994258 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:05.976102 18953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.017s	sys 0.010s
I20260709 12:10:05.988436 18977 tablet_bootstrap.cc:492] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:10:06.006125 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:06.006946 17359 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:05.978420 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:06.010017 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:05.995035 17367 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:06.016125 17440 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:06.016125 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:05.979926 18915 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.997274 19041 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:06.066044 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 201934us
W20260709 12:10:06.066676 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 122749us
I20260709 12:10:06.066953 18015 raft_consensus.cc:1217] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:06.002308 19020 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.979476 18959 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:10:05.971971 18919 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:06.063803 19059 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:05.978878 19068 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.085636 17358 raft_consensus.cc:2410] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:06.079471 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:05.987730 19028 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.065265 18953 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:06.072425 19033 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:06.089779 19001 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.104573 18953 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:06.106245 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:06.111723 17367 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.107952 17359 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:06.106884 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:06.113348 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:06.042282 18934 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:10:06.085712 18977 ts_tablet_manager.cc:1403] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 1.367s	user 0.043s	sys 0.001s
I20260709 12:10:06.124886 17441 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:06.075587 18915 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.098866 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:06.175633 17407 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:06.121719 18953 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:06.129997 19069 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.148013 18954 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.197288 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:06.197966 18015 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.165911 18900 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:06.188979 19066 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:10:06.127887 19001 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.220764 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:06.222558 17978 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:06.197368 19069 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.199733 18954 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.185410 17436 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:06.201701 19025 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:06.267099 19069 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.307302 18977 raft_consensus.cc:359] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:06.309823 18919 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:06.310916 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2054) took 1044 ms. Trace:
I20260709 12:10:06.325384 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:06.326187 17289 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:06.312548 19001 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:06.266965 18954 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.321476 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:06.316922 18015 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:06.324265 17360 rpcz_store.cc:276] 0709 12:10:05.266473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.266645 (+   172us) service_pool.cc:224] Handling call
0709 12:10:05.266954 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:05.267316 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.267342 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:05.267870 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:10:05.945110 (+677240us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:05.945149 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.945223 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.310672 (+365449us) raft_consensus.cc:1685] finished
0709 12:10:06.310692 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.310845 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":191,"thread_start_us":676727,"threads_started":1,"wal-append.queue_time_us":671005}
I20260709 12:10:06.255798 19094 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:10:06.327454 18932 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:06.336105 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:06.336934 17287 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:06.337553 19095 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.337858 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:06.344164 17284 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.346347 17286 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:06.347546 17283 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:06.348881 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:06.353144 17288 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:06.351364 19028 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:06.350088 19095 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:06.355626 17255 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:06.360247 17367 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:06.316438 18977 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
W20260709 12:10:06.361457 19089 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:10:06.344980 18932 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.367393 17290 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:06.367887 19095 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.298568 19033 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.363401 19001 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:06.368638 18932 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:06.382601 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 250203us
I20260709 12:10:06.341081 19068 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:06.381675 19020 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:06.389700 18977 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:06.390942 19020 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.391868 18977 ts_tablet_manager.cc:1434] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.243s	user 0.004s	sys 0.003s
I20260709 12:10:06.383351 19043 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.382156 18915 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:06.369388 18959 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:06.398372 19043 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.420998 18954 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.412139 19043 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.499601 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:06.514436 17433 raft_consensus.cc:2368] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4.
I20260709 12:10:06.518630 18973 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:06.522607 18973 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.527359 18954 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:06.610930 17284 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:06.611918 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 436365us
I20260709 12:10:06.647554 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:06.651362 17404 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:06.654304 18015 raft_consensus.cc:1217] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 12:10:06.658756 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:06.663164 18015 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.665594 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:06.658572 19094 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:06.674937 19102 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:06.675534 19102 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.675902 19102 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:06.678723 19105 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:06.679458 19105 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.661518 18954 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:06.671262 17450 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-ee22d4e5e05e423097297625d6158f21 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:10:06.695739 18015 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:06.699477 19099 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:10:06.700734 18973 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:06.700604 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:06.706562 17439 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:06.712148 19038 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:06.681890 19105 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:06.698202 17450 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-ee22d4e5e05e423097297625d6158f21 on tablet ee22d4e5e05e423097297625d6158f21 with peer 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:06.739269 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 81938.6us
I20260709 12:10:06.741179 19093 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.741034 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:06.725096 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:06.687454 19094 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.743788 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:06.744146 18954 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:06.759079 19041 consensus_meta.cc:287] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.003s
I20260709 12:10:06.762604 19041 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.749913 18953 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.844848 19068 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:06.860102 19038 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:06.844429 18006 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:10:06.860700 19038 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.855036 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1302) took 1346 ms. Trace:
I20260709 12:10:06.870401 18951 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:06.860035 19068 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.857160 19020 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:06.858397 18953 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.873488 19038 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:06.865238 19069 consensus_meta.cc:287] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.538s	user 0.003s	sys 0.015s
I20260709 12:10:06.879959 19119 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:06.897748 18973 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:06.898373 18973 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:06.899139 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.899753 19041 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:06.900386 18973 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:06.895346 19120 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:06.881112 18951 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.902870 18973 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:06.900367 19041 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:06.921129 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 180261us
I20260709 12:10:06.900938 19020 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.880303 18954 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:06.927742 19109 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.100s	user 0.000s	sys 0.009s
I20260709 12:10:06.927634 19041 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.929898 19041 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:06.926859 19110 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.101s	user 0.005s	sys 0.004s
W20260709 12:10:06.937814 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 61111.9us
I20260709 12:10:06.902582 19069 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:06.947271 19069 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:06.948048 17436 raft_consensus.cc:2368] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4.
I20260709 12:10:06.926600 18973 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:06.955772 18973 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:06.957721 18973 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.958272 18973 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.960366 18973 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:06.964285 17406 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:06.924384 19043 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:06.972503 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:06.953132 18951 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:06.977169 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:06.978084 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:06.977389 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:06.913744 19120 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:06.977157 19121 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.982456 17290 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:06.975298 18915 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.985267 17286 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.085796 19125 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:07.086612 19125 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:06.989748 19068 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:06.874974 17364 rpcz_store.cc:276] 0709 12:10:05.504167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.504385 (+   218us) service_pool.cc:224] Handling call
0709 12:10:05.504747 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:05.946667 (+441920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.954316 (+  7649us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.062732 (+108416us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.614114 (+551382us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:06.640429 (+ 26315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.648037 (+  7608us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.750071 (+102034us) raft_consensus.cc:1685] finished
0709 12:10:06.752698 (+  2627us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.841725 (+ 89027us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4343,"raft.queue_time_us":46537,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":4678,"thread_start_us":827689,"threads_started":2,"wal-append.queue_time_us":609047}
W20260709 12:10:07.167320 19123 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:10:07.171972 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:07.087917 19121 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.152721 19117 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:07.244511 19102 consensus_meta.cc:287] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.000s
I20260709 12:10:07.170126 19020 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:07.044958 18915 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:07.284713 19002 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:07.287185 19128 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:10:07.288096 19126 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:10:07.263547 19041 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:07.305148 19020 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:07.305850 19020 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.305229 19041 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.263911 19117 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:07.300910 19127 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:10:07.245054 19102 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:07.250114 19121 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:07.301048 19002 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.326089 17432 raft_consensus.cc:2393] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:07.332559 19121 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:07.333740 17286 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:07.334936 19002 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:07.331759 19117 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:07.367285 17406 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:07.358214 19020 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:07.373504 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:07.375782 18006 raft_consensus.cc:2410] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:07.374385 19079 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.373292 18954 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.376469 18015 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:07.359423 19102 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:07.379405 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:07.379091 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:07.370221 19002 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:07.380079 17288 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:07.380923 17283 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.384215 19002 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.386512 19002 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:07.381500 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:07.370172 18960 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:07.376572 19024 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:07.377434 18954 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:07.376485 19079 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:07.378456 19041 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:07.393347 17406 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:07.365821 19125 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:07.381927 19120 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:07.394930 19043 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:07.406574 17289 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:07.394760 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:07.409945 18009 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:07.396243 19024 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.426091 17283 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:07.394275 18960 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.458976 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:07.464006 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2079) took 1109 ms. Trace:
I20260709 12:10:07.464143 19102 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:07.476974 19102 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:07.478986 19111 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.578s	user 0.019s	sys 0.030s
I20260709 12:10:07.475741 19101 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.467739 17291 rpcz_store.cc:276] 0709 12:10:06.321778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.321892 (+   114us) service_pool.cc:224] Handling call
0709 12:10:07.429544 (+1107652us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b58000b0498. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:07.429831 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.430042 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:07.430085 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:07.430666 (+   581us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:07.430705 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.430773 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.430915 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10894080}
I20260709 12:10:07.499136 19120 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:07.488129 19032 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:07.503297 19120 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:07.503741 19032 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.504369 19094 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:07.504555 19101 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.505019 19101 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.506462 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1321) took 1012 ms. Trace:
I20260709 12:10:07.504441 19120 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:07.507126 17433 rpcz_store.cc:276] 0709 12:10:06.494492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.499258 (+  4766us) service_pool.cc:224] Handling call
0709 12:10:07.506255 (+1006997us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5400271354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:07.506397 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31843712}
I20260709 12:10:07.509496 19024 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:07.510535 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:07.511375 17292 raft_consensus.cc:2393] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:07.511433 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:07.511881 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2083) took 1188 ms. Trace:
I20260709 12:10:07.512203 17292 rpcz_store.cc:276] 0709 12:10:06.323034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.323153 (+   119us) service_pool.cc:224] Handling call
0709 12:10:07.510267 (+1187114us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b58000b0498. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:07.511821 (+  1554us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11366784}
I20260709 12:10:07.518543 19101 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:07.521001 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:07.522254 19104 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:07.523741 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 1.1688e+06us
I20260709 12:10:07.523612 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1262) took 1427 ms. Trace:
I20260709 12:10:07.536008 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:07.536033 17440 rpcz_store.cc:276] 0709 12:10:06.096053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.097327 (+  1274us) service_pool.cc:224] Handling call
0709 12:10:06.867484 (+770157us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:06.867707 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.903406 (+ 35699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.903443 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.903488 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:06.903519 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.523174 (+619655us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b540006ed54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:07.523264 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.523485 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87122176}
I20260709 12:10:07.559012 19039 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.563233 19039 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.564527 18971 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:07.565119 18971 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:07.565441 19039 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:07.566339 19025 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:07.567070 18919 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:07.566882 19025 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.567590 18919 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:07.568001 18974 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:07.568509 18974 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:07.568866 19025 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:07.567106 19045 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:07.570515 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:07.570700 19045 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.571673 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:07.572582 17362 raft_consensus.cc:2410] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:07.569896 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:07.573424 17361 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.571170 17365 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
W20260709 12:10:07.576596 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 50542.2us
I20260709 12:10:07.578549 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:07.506402 18960 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:07.859932 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:07.605504 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 1.38675e+06us
I20260709 12:10:07.906554 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:07.738312 19032 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:07.738511 17256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.003s	sys 0.018s
W20260709 12:10:07.933416 17256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.003s	sys 0.024s
I20260709 12:10:07.749076 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1273) took 1044 ms. Trace:
I20260709 12:10:07.677771 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 248) took 1543 ms. Trace:
I20260709 12:10:07.935189 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:07.913172 17361 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:07.918068 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:07.914799 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.566017 19039 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:07.944435 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:07.934909 17432 rpcz_store.cc:276] 0709 12:10:06.704800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.707102 (+  2302us) service_pool.cc:224] Handling call
0709 12:10:07.748811 (+1041709us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400270954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:07.748992 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326781312}
I20260709 12:10:07.935256 17366 rpcz_store.cc:276] 0709 12:10:06.134861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.164612 (+ 29751us) service_pool.cc:224] Handling call
0709 12:10:06.195226 (+ 30614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.195466 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:06.202990 (+  7524us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.520271 (+1317281us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b18003a7c80. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f1222a30a40 00007f1222a2b4e4 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:10:07.677345 (+157074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:07.677419 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:07.677466 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.677545 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.677694 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":651,"prepare.queue_time_us":16570,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":1303762,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":3069312,"thread_start_us":156775,"threads_started":1}
W20260709 12:10:07.828469 19116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.022s	sys 0.042s
I20260709 12:10:07.912523 18919 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:07.598184 19104 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.965056 18919 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:07.921401 18974 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:07.965631 18919 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:07.966603 17407 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:07.967739 18919 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:07.959077 19102 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:07.959317 19069 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.859632 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:07.959602 19139 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:10:07.968971 18012 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 12:10:07.951749 17258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.651s (SENT) [suppressed 2 similar messages]
I20260709 12:10:07.942162 19101 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:07.975445 19094 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:07.598644 18915 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:07.771605 19079 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:07.959911 18960 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:07.946375 19140 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:07.955075 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1265) took 1252 ms. Trace:
I20260709 12:10:07.958946 19095 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.904681 18958 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:08.001966 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 423463us
I20260709 12:10:08.022792 18012 pending_rounds.cc:85] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 5
I20260709 12:10:07.943907 18959 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:07.968576 19116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.024s	sys 0.045s
I20260709 12:10:08.017894 19082 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:08.024374 18960 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.034092 19082 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.034670 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:08.035777 18960 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:08.036378 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:08.039287 19045 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.039872 19124 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:08.040483 19124 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.040817 19028 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:08.041422 19028 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.043817 19028 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:07.975957 19040 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.046295 19040 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.046808 17290 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:08.045630 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:08.039626 18798 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:08.050940 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 113747us
I20260709 12:10:07.955716 18956 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:08.039969 19082 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.027345 18012 pending_rounds.cc:107] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:08.050007 18798 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.007578 18971 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:08.079300 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 52263.9us
I20260709 12:10:08.048485 17284 raft_consensus.cc:606] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:08.013665 19117 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.078536 18012 raft_consensus.cc:2889] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:08.022466 19069 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.026849 19094 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.087230 19094 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:08.028103 18958 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.951788 19039 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.091177 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:08.056259 19053 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:08.110523 18798 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.095156 17333 leader_election.cc:400] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4.
I20260709 12:10:07.739235 18954 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.028141 18915 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.095638 18010 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:08.055933 19041 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:08.024708 19144 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.108682 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:08.028616 19101 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:08.113651 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:08.081440 19117 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.081543 19029 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:08.116837 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 148142us
I20260709 12:10:08.088025 19024 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.048923 18959 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.093858 19069 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.143510 17333 leader_election.cc:403] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.144075 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.109941 18958 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.108827 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:08.146945 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 195216us
I20260709 12:10:08.139072 18007 raft_consensus.cc:2410] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:08.143584 19094 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:08.149950 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:08.152120 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 59329.5us
I20260709 12:10:08.183745 17359 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:08.165670 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.148142 18919 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:08.081446 18956 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.151265 18897 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.141633 19045 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:10:08.150648 19040 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.152932 19144 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.144917 19053 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.151789 18915 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.426671 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 544) took 1010 ms. Trace:
I20260709 12:10:08.571565 17404 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:10:08.287889 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 192859us
W20260709 12:10:08.292706 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 104114us
I20260709 12:10:08.286947 17287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:08.155798 17187 catalog_manager.cc:5697] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:08.601750 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:08.183703 17441 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.269182 17283 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:08.184361 18798 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:08.227239 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.022792 17435 rpcz_store.cc:276] 0709 12:10:06.698122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.713365 (+ 15243us) service_pool.cc:224] Handling call
0709 12:10:07.662537 (+949172us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:07.662791 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.726584 (+ 63793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:07.726621 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:07.726688 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:07.726728 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.931508 (+204780us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.949967 (+ 18459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4297472}
I20260709 12:10:08.185797 17438 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:08.321882 17189 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55932 (request call id 325) took 3464 ms. Trace:
I20260709 12:10:08.602368 17187 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:08.601091 17287 raft_consensus.cc:606] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:08.618871 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47408.4us
I20260709 12:10:08.619922 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:08.173666 19073 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.610700 18974 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.610823 18959 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.610980 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:08.642150 17366 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.173971 19029 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.605011 17439 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
W20260709 12:10:08.316176 19146 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:10:08.489565 19151 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:08.630053 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.618743 18798 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.697505 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.595511 18015 rpcz_store.cc:276] 0709 12:10:07.416551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.416710 (+   159us) service_pool.cc:224] Handling call
0709 12:10:07.664651 (+247941us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:07.664877 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.665099 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:07.931265 (+266166us) log.cc:844] Serialized 14 byte log entry
0709 12:10:08.401040 (+469775us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b18003dec40. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f1222a30a40 00007f1222a2b4e4 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:10:08.426270 (+ 25230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:08.426341 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:08.426388 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:08.426460 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:08.426607 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34506,"prepare.queue_time_us":478503,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2647,"raft.queue_time_us":476367,"spinlock_wait_cycles":12085760,"thread_start_us":384070,"threads_started":2,"wal-append.queue_time_us":243859}
I20260709 12:10:08.622237 19040 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.591177 19124 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.181775 19119 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.452996 19153 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:08.181097 19024 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.234331 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.571203 19104 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.155665 19041 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.288120 19140 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4.
I20260709 12:10:08.288141 19139 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:08.416383 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.716684 19151 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.772315 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.772962 17434 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:08.773166 19151 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.267700 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:08.774657 17359 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:08.774283 19139 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.775492 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:08.776075 17359 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:08.776543 19139 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.648129 17441 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:08.224716 19095 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:08.768599 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:08.777606 19150 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.777869 19095 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.778208 19150 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.780341 19150 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.488497 19120 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.781188 19120 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:08.648872 17331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.057s	sys 0.069s
I20260709 12:10:08.781729 19143 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:08.782135 17331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.058s	sys 0.069s
I20260709 12:10:08.782352 17438 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:08.783506 19120 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.318722 19039 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.164036 19117 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.757918 19153 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.788618 19153 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.425098 19102 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:08.626717 17287 raft_consensus.cc:614] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:08.605894 19144 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.789367 19102 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.452231 19152 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:08.230439 19025 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.632392 18958 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:08.800616 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.180965 19101 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.630746 18900 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.723697 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:08.725107 18798 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:08.727396 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 564329us
I20260709 12:10:08.649895 18974 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.266223 19094 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.758235 17366 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:08.615482 18897 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.622398 18919 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.615969 17189 rpcz_store.cc:276] 0709 12:10:04.802123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.802326 (+   203us) service_pool.cc:224] Handling call
0709 12:10:08.266817 (+3464491us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:05.888373 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:05.889008 (+   635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:05.889046 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:10:05.889073 (+    27us) tablet.cc:662] Decoding operations
0709 12:10:05.889696 (+   623us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:05.889826 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:05.889856 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:05.946620 (+ 56764us) tablet.cc:701] Row locks acquired
0709 12:10:05.954261 (+  7641us) write_op.cc:260] PREPARE: finished
0709 12:10:05.976349 (+ 22088us) write_op.cc:270] Start()
0709 12:10:05.995814 (+ 19465us) write_op.cc:276] Timestamp: P: 1783599005970615 usec, L: 0
0709 12:10:05.999317 (+  3503us) op_driver.cc:348] REPLICATION: starting
0709 12:10:06.172776 (+173459us) log.cc:844] Serialized 1302 byte log entry
0709 12:10:07.174497 (+1001721us) op_driver.cc:464] REPLICATION: finished
0709 12:10:07.395145 (+220648us) write_op.cc:301] APPLY: starting
0709 12:10:07.399047 (+  3902us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:07.406728 (+  7681us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:07.440794 (+ 34066us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:07.757287 (+316493us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:07.827670 (+ 70383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:07.850884 (+ 23214us) write_op.cc:312] APPLY: finished
0709 12:10:07.904873 (+ 53989us) log.cc:844] Serialized 35 byte log entry
0709 12:10:07.938918 (+ 34045us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:07.947281 (+  8363us) write_op.cc:454] Released schema lock
0709 12:10:07.952288 (+  5007us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:08.018426 (+ 66138us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:08.020786 (+  2360us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3187,"reported_tablets":5,"spinlock_wait_cycles":35712,"child_traces":[["op",{"apply.queue_time_us":206977,"apply.run_cpu_time_us":4550,"apply.run_wall_time_us":607042,"num_ops":3,"prepare.queue_time_us":632376,"prepare.run_cpu_time_us":59493,"prepare.run_wall_time_us":804332,"raft.queue_time_us":62830,"raft.run_cpu_time_us":15987,"raft.run_wall_time_us":381077,"replication_time_us":1149492,"thread_start_us":1378249,"threads_started":4,"wal-append.queue_time_us":557269}]]}
I20260709 12:10:08.764961 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.760210 19161 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.769025 17436 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:08.770169 18910 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:08.770373 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:08.818305 19166 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:08.818691 17363 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:08.818847 19166 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.770824 19074 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.819459 19117 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.820019 19074 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.821040 19166 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.781234 19158 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:08.636476 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.741461 18971 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.822316 18915 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:08.822697 18971 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.823652 19138 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:08.824153 19138 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.824688 18971 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.759595 19119 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.825448 19124 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:08.652832 19032 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.826248 19138 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.826380 19032 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.826810 19119 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:08.827287 18971 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.827813 18971 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.828105 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.773955 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.828727 17433 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 1.
I20260709 12:10:08.726025 18960 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:08.757619 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:08.641444 19073 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.809862 17439 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 1.
I20260709 12:10:08.766623 18981 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:08.811033 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.811184 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:08.811806 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:08.793013 18947 raft_consensus.cc:2764] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:08.741825 19040 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.815356 17978 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:08.816586 18910 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.816897 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:08.817795 18974 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.806233 19160 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:08.782372 19143 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.767642 19104 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:08.877780 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:08.829535 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:09.024847 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 200680us
I20260709 12:10:08.848361 17287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:08.955989 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:09.087146 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:09.362576 17289 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.910272 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2099) took 1429 ms. Trace:
W20260709 12:10:09.065436 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.049s	sys 0.090s
W20260709 12:10:09.363292 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.053s	sys 0.094s
I20260709 12:10:09.363221 17283 rpcz_store.cc:276] 0709 12:10:07.481302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.481476 (+   174us) service_pool.cc:224] Handling call
0709 12:10:08.910011 (+1428535us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54001b6f54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:08.910200 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743951744}
I20260709 12:10:09.247102 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1279) took 1105 ms. Trace:
I20260709 12:10:09.369275 17440 rpcz_store.cc:276] 0709 12:10:08.141293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.147916 (+  6623us) service_pool.cc:224] Handling call
0709 12:10:08.148229 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:08.625855 (+477626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:08.625886 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:08.625931 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:08.625960 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.246852 (+620892us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b5400037354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:09.246910 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:09.247041 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097943808}
I20260709 12:10:09.360157 17287 raft_consensus.cc:606] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:09.373154 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:09.360198 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:09.357403 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 542080us
I20260709 12:10:09.357585 17361 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:09.361678 17438 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:09.355571 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:09.372611 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:09.364951 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 1.18064e+06us
I20260709 12:10:09.366849 17255 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:09.370615 19169 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.423398 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.422343 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:09.024986 17364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.007s	sys 0.001s
I20260709 12:10:09.428588 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 242) took 1134 ms. Trace:
I20260709 12:10:09.440140 17362 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:09.431198 17441 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:08.829450 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:09.425823 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.444576 17366 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:09.432916 17440 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:09.252581 19101 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:09.434376 17433 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:08.910035 18897 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:08.912734 19164 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:10:09.423024 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1286) took 1156 ms. Trace:
I20260709 12:10:09.454347 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:09.435724 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:09.340730 19069 consensus_meta.cc:287] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.106s	user 0.004s	sys 0.007s
W20260709 12:10:09.366838 18959 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.005s	sys 0.005s
I20260709 12:10:09.421574 18910 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:09.442230 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:08.807060 19025 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:09.440712 17438 rpcz_store.cc:276] 0709 12:10:08.294070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.427824 (+1133754us) service_pool.cc:224] Handling call
0709 12:10:09.428110 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.428269 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:09.428292 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:09.428332 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:09.428360 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.428410 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:09.428512 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:09.443121 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:09.318017 19151 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.005s
I20260709 12:10:09.434269 17432 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 1.
I20260709 12:10:08.954087 19159 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.245193 19024 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:08.885313 19074 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.915361 19094 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.923260 18958 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.920893 18956 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.920200 19041 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:09.144731 19045 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:09.300312 19157 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.371160 18981 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:09.501159 18971 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:09.477195 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.502821 18981 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:09.503126 18009 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:09.449410 19176 raft_consensus.cc:993] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:10:09.504210 19176 raft_consensus.cc:1081] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:10:09.504432 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:09.433501 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 66730.4us
I20260709 12:10:09.449771 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.450263 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:09.450655 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:09.505201 18009 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:09.048043 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 551) took 1018 ms. Trace:
I20260709 12:10:09.450843 17404 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:09.506470 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 55711.4us
I20260709 12:10:09.506399 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.509940 17255 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:09.450963 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.086196 19147 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:09.241993 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 547) took 1421 ms. Trace:
I20260709 12:10:09.498222 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.451578 17289 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:09.015763 19119 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:08.884755 19032 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:08.803349 19152 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:08.919086 19029 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.921932 19102 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:09.019306 19053 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:08.841377 19138 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:09.362294 18919 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:09.452399 17433 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:09.246198 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1285) took 1016 ms. Trace:
I20260709 12:10:08.841272 19117 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:09.440275 17364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.011s	sys 0.007s
I20260709 12:10:09.454430 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:09.454444 17439 rpcz_store.cc:276] 0709 12:10:08.266375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.422243 (+1155868us) service_pool.cc:224] Handling call
0709 12:10:09.422547 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.422726 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:09.422750 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:09.422789 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:09.422818 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.422868 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:09.422958 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:09.375860 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.456259 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:09.377221 18974 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:09.460337 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:08.848750 17358 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:09.462646 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:09.463837 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.370887 19153 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:09.466970 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.528805 19124 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.548918 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.438395 19175 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.548988 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:09.249719 19144 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:09.450333 19131 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:09.465337 18959 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.006s	sys 0.006s
I20260709 12:10:09.550649 18974 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:09.381134 18960 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:09.471927 19151 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.004s	sys 0.008s
I20260709 12:10:09.482913 17367 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:09.470170 19069 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:09.377012 19158 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:09.496076 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:09.497319 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.565376 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:09.566027 18011 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.567373 18974 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:09.567957 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1321) took 1075 ms. Trace:
I20260709 12:10:09.479331 19159 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:09.371554 19160 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:09.505107 19025 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:09.505980 19157 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:09.515589 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.506079 18010 rpcz_store.cc:276] 0709 12:10:08.029208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.032151 (+  2943us) service_pool.cc:224] Handling call
0709 12:10:09.047815 (+1015664us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b540024ead4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:09.047961 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117177088}
W20260709 12:10:09.475162 17258 connection.cc:256] RPC call timeout handler was delayed by -1.460584001999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 12:10:09.521363 17255 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:09.522964 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.526535 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 84042.8us
I20260709 12:10:09.578060 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:09.527550 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 100960us
I20260709 12:10:09.530357 17406 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:09.528020 18947 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.517030 18007 rpcz_store.cc:276] 0709 12:10:07.820727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.827359 (+  6632us) service_pool.cc:224] Handling call
0709 12:10:09.241738 (+1414379us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5400740254. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:09.241903 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59399552}
I20260709 12:10:09.543377 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.542065 17437 rpcz_store.cc:276] 0709 12:10:08.230149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.266611 (+ 36462us) service_pool.cc:224] Handling call
0709 12:10:08.610608 (+343997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:08.910494 (+299886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:08.910545 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:08.910601 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:08.910656 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.245909 (+335253us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400037854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:09.245962 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:09.246127 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506846592}
W20260709 12:10:09.543320 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 115971us
I20260709 12:10:09.469903 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.550248 17359 raft_consensus.cc:2393] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:09.529795 19119 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:09.550812 19175 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:09.551117 19040 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:08.816234 19161 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:09.529136 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.552078 17366 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:10:09.556532 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.532990 19147 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:09.559018 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:09.560196 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 51995.4us
I20260709 12:10:09.560941 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:09.531886 18006 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:09.555346 19153 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:09.562350 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:09.562729 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:09.564038 19158 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:09.569134 18014 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:10:09.572292 17365 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:09.528507 19045 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:09.532071 19041 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:09.560647 19073 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:09.556871 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:09.548141 19138 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:09.965092 19102 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.965607 19102 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:09.903745 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 382281us
I20260709 12:10:09.578387 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:09.861290 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.730988 18015 raft_consensus.cc:2368] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4.
W20260709 12:10:09.714905 17367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1319) took 1423 ms (client timeout 1793 ms). Trace:
I20260709 12:10:09.968189 17255 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:09.970511 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:09.986754 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2083) took 1202 ms. Trace:
W20260709 12:10:09.978186 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 400199us
W20260709 12:10:09.966820 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 437228us
I20260709 12:10:09.990965 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1330) took 1172 ms. Trace:
I20260709 12:10:09.991516 17980 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:09.987373 17361 rpcz_store.cc:276] 0709 12:10:08.783971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.556259 (+772288us) service_pool.cc:224] Handling call
0709 12:10:09.986679 (+430420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:09.991900 17359 rpcz_store.cc:276] 0709 12:10:08.818584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.548680 (+730096us) service_pool.cc:224] Handling call
0709 12:10:09.990873 (+442193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36096}
I20260709 12:10:09.998502 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.019032 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.019557 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2085) took 1235 ms. Trace:
I20260709 12:10:10.020915 17362 rpcz_store.cc:276] 0709 12:10:08.784441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.843380 (+1058939us) service_pool.cc:224] Handling call
0709 12:10:10.019482 (+176102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.023416 17439 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.749066 17434 raft_consensus.cc:2393] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:09.965803 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.020409 18012 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:10.028162 17980 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:09.931595 19144 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:10.031279 19073 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:10.032420 19025 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:09.864174 19176 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:09.928617 19160 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:10.037235 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.038861 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:09.568331 17358 rpcz_store.cc:276] 0709 12:10:08.492295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.507919 (+ 15624us) service_pool.cc:224] Handling call
0709 12:10:08.770169 (+262250us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:09.567762 (+797593us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b540006fed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:09.567871 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60044928}
I20260709 12:10:09.929490 19152 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:09.749612 19095 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:09.852789 19053 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.669860 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1312) took 1493 ms. Trace:
I20260709 12:10:09.966020 19102 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.576175 19143 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:10.040601 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 107533us
I20260709 12:10:10.024775 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:10.070030 18960 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:10.035431 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 54575.8us
I20260709 12:10:09.859994 18958 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:09.909457 19157 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:10.041325 17363 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
W20260709 12:10:09.979689 17367 rpcz_store.cc:269] 0709 12:10:08.291318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.291564 (+   246us) service_pool.cc:224] Handling call
0709 12:10:09.714678 (+1423114us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54003f0054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:09.714829 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026469888}
I20260709 12:10:09.975750 19175 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.105686 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1289) took 1494 ms. Trace:
I20260709 12:10:09.975733 18947 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:10.112104 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.210498 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1335) took 1390 ms. Trace:
I20260709 12:10:10.210914 17362 rpcz_store.cc:276] 0709 12:10:08.819929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.037705 (+1217776us) service_pool.cc:224] Handling call
0709 12:10:10.210430 (+172725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.113547 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1339) took 1292 ms. Trace:
I20260709 12:10:10.211741 17361 rpcz_store.cc:276] 0709 12:10:08.820974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.038072 (+1217098us) service_pool.cc:224] Handling call
0709 12:10:10.113479 (+ 75407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:09.576205 19159 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:10.067970 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:10.088811 17365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1318) took 1797 ms (client timeout 2239 ms). Trace:
W20260709 12:10:10.068656 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 80022.1us
I20260709 12:10:10.089715 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2088) took 1304 ms. Trace:
W20260709 12:10:10.029435 17435 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.042s	sys 0.072s
W20260709 12:10:10.220321 17435 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.049s	sys 0.072s
I20260709 12:10:10.220214 17366 rpcz_store.cc:276] 0709 12:10:08.785197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.450769 (+665572us) service_pool.cc:224] Handling call
0709 12:10:10.089544 (+638775us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b54003a0cd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:10.089652 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94389120}
I20260709 12:10:10.223598 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.225000 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.040946 19124 raft_consensus.cc:697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:10.190387 17258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.042s	sys 0.034s
I20260709 12:10:10.026012 18008 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:10.035679 19039 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.027462 19180 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:10.226387 17258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.043s	sys 0.034s
I20260709 12:10:10.050997 19040 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:10.226735 17258 connection.cc:256] RPC call timeout handler was delayed by -1.0766778589998012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 12:10:09.561491 19131 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.227646 19039 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.226845 19124 consensus_queue.cc:237] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:10.228111 19039 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:10.198182 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 173471us
I20260709 12:10:10.229403 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.229821 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.229938 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:09.573896 19104 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:10.231189 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.162640 19069 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:10.235589 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.235791 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.106557 17359 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:10.221067 18947 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.236644 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1336) took 1416 ms. Trace:
I20260709 12:10:10.209542 17441 rpcz_store.cc:276] 0709 12:10:08.611254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.447386 (+836132us) service_pool.cc:224] Handling call
0709 12:10:09.447673 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.062616 (+614943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.062646 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.062688 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:10.062718 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.105409 (+ 42691us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400161054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:10.105457 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:10.105622 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413740928}
W20260709 12:10:10.213923 17365 rpcz_store.cc:269] 0709 12:10:08.290995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.291093 (+    98us) service_pool.cc:224] Handling call
0709 12:10:08.768408 (+477315us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:10.088570 (+1320162us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b5400081e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:10.088729 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831075456}
I20260709 12:10:10.236285 17283 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:10.231739 17981 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:10.230984 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.239305 17981 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:10.232663 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.241154 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2099) took 1443 ms. Trace:
I20260709 12:10:10.241532 17367 rpcz_store.cc:276] 0709 12:10:08.798076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.232421 (+1434345us) service_pool.cc:224] Handling call
0709 12:10:10.241078 (+  8657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.159092 19151 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.233381 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.237051 17359 rpcz_store.cc:276] 0709 12:10:08.820235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.036862 (+1216627us) service_pool.cc:224] Handling call
0709 12:10:10.236470 (+199608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.226687 19180 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:10.255673 17981 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:10.209892 19152 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:10.279559 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 251474us
I20260709 12:10:10.256106 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.251415 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.236371 17362 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:10.259474 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.260257 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.165400 19025 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:10.200840 19144 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:10.234436 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.263656 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1290) took 1652 ms. Trace:
W20260709 12:10:10.263921 19189 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:10.264405 17432 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:10.264637 17289 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:10.265002 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.266970 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.267578 19138 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:10.323652 17286 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:10.323819 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.267933 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.324708 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:10.325017 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.306185 17434 rpcz_store.cc:276] 0709 12:10:08.611553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.829185 (+217632us) service_pool.cc:224] Handling call
0709 12:10:10.263339 (+1434154us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400116554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:10.263561 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302183296}
I20260709 12:10:10.268841 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.271019 19131 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:10.276273 19094 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.196049 19095 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.272540 19161 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:10.274155 19045 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:10.275346 19040 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.165582 19176 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.281302 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1329) took 1463 ms. Trace:
I20260709 12:10:10.370337 17362 rpcz_store.cc:276] 0709 12:10:08.818305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.233852 (+1415547us) service_pool.cc:224] Handling call
0709 12:10:10.281228 (+ 47376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.242786 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.371511 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1328) took 1553 ms. Trace:
I20260709 12:10:10.371874 17367 rpcz_store.cc:276] 0709 12:10:08.817934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.242339 (+1424405us) service_pool.cc:224] Handling call
0709 12:10:10.371442 (+129103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.279893 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:10.244271 19181 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:10.244899 18007 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:10.285743 17363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1337) took 1465 ms (client timeout 1667 ms). Trace:
I20260709 12:10:10.230692 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.234607 19053 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.244872 19119 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:10.327925 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.323256 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:10.272215 18011 consensus_meta.cc:287] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.706s	user 0.004s	sys 0.004s
I20260709 12:10:10.267971 18006 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:10.276369 19152 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:10.355698 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:10.355912 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:10.276770 19180 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.325624 19039 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.392714 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.362386 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.307729 19144 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.362881 19040 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:10.362879 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.331202 19151 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.378880 19053 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:10.331310 17358 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:10:10.367444 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.238565 18958 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:10.374197 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 406418us
W20260709 12:10:10.375362 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 95552.7us
W20260709 12:10:10.373585 17363 rpcz_store.cc:269] 0709 12:10:08.820473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.423037 (+602564us) service_pool.cc:224] Handling call
0709 12:10:10.285575 (+862538us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54003d04d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:10.285680 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393251072}
I20260709 12:10:10.381693 17286 raft_consensus.cc:2368] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6.
I20260709 12:10:10.440475 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:10.374742 19190 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:10:10.442756 17365 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:10.421372 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.422616 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.444229 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 253) took 1075 ms. Trace:
I20260709 12:10:10.423647 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2093) took 1637 ms. Trace:
W20260709 12:10:10.424475 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 138504us
W20260709 12:10:10.431531 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 217323us
W20260709 12:10:10.444882 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 164062us
I20260709 12:10:10.434161 17284 raft_consensus.cc:2393] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:10.444588 17366 rpcz_store.cc:276] 0709 12:10:09.368345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.422323 (+1053978us) service_pool.cc:224] Handling call
0709 12:10:10.444160 (+ 21837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.436965 17291 raft_consensus.cc:2393] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:10.383313 19153 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:10.434123 19040 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.436599 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:10.420698 19152 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.436177 17359 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:10.333377 19094 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:10.441075 17362 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.440989 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.434288 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.446395 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.444820 17361 rpcz_store.cc:276] 0709 12:10:08.786484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.307896 (+1521412us) service_pool.cc:224] Handling call
0709 12:10:10.423569 (+115673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.389523 18011 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:10.449584 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.451930 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.504906 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.449558 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.454735 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2103) took 1101 ms. Trace:
I20260709 12:10:10.425781 19203 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.455428 17255 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:10.454718 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.538126 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.538671 17438 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:10.447576 18919 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:10.449771 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.436077 19053 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.386155 19181 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.438648 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2101) took 1597 ms. Trace:
I20260709 12:10:10.479518 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.458618 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1332) took 1663 ms. Trace:
I20260709 12:10:10.435576 19151 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.476205 19094 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.443197 18897 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:10.536569 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 257) took 1101 ms. Trace:
I20260709 12:10:10.536787 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.455533 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:10.543192 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.545279 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:10.538803 19193 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:10:10.506318 17359 rpcz_store.cc:276] 0709 12:10:09.353351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.326269 (+972918us) service_pool.cc:224] Handling call
0709 12:10:10.454672 (+128403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.506456 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1330) took 1749 ms. Trace:
I20260709 12:10:10.547552 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.539529 19203 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:10.542435 17432 rpcz_store.cc:276] 0709 12:10:08.795493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.475291 (+679798us) service_pool.cc:224] Handling call
0709 12:10:10.264228 (+788937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.334046 (+ 69818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.458420 (+124374us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b5400116550. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:10.458554 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813665024}
I20260709 12:10:10.552008 17366 rpcz_store.cc:276] 0709 12:10:09.435326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.446139 (+1010813us) service_pool.cc:224] Handling call
0709 12:10:10.536474 (+ 90335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.553679 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:10.554112 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:10.555126 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.555272 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.572297 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:10.573983 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 117675us
I20260709 12:10:10.574443 18012 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:10.571246 17333 leader_election.cc:400] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4.
W20260709 12:10:10.559156 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 173358us
I20260709 12:10:10.546881 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.537484 18011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 492) took 1044 ms. Trace:
I20260709 12:10:10.457015 19041 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:10:10.578128 17439 raft_consensus.cc:2393] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:10.578223 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.563535 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.548741 19151 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.582626 18011 rpcz_store.cc:276] 0709 12:10:09.493433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.565090 (+ 71657us) service_pool.cc:224] Handling call
0709 12:10:10.537406 (+972316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.584975 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.589726 17363 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:10.585367 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.476944 19192 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:10:10.591037 18012 raft_consensus.cc:2410] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:10.591701 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.589464 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.597978 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.598771 17438 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:10.570339 19024 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.544775 17358 rpcz_store.cc:276] 0709 12:10:08.841131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.234137 (+1393006us) service_pool.cc:224] Handling call
0709 12:10:10.438577 (+204440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.613462 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.570065 19203 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.549894 18919 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:10.615825 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.584493 18910 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.617740 17359 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:10.589066 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.558496 18897 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.612823 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:10.590068 19147 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:10.629666 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 174310us
I20260709 12:10:10.612092 19024 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:10.651170 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.617683 19025 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:10.653540 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.640847 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.619637 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.621150 18910 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:10.660674 17363 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:10.638365 17255 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:10.632081 18008 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:10.705060 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:10.690267 17980 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:10.705216 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.707590 17363 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:10.651538 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.709647 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.193864 17364 rpcz_store.cc:276] 0709 12:10:08.163551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.170794 (+  7243us) service_pool.cc:224] Handling call
0709 12:10:08.318888 (+148094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:08.319155 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:08.319463 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 12:10:09.552098 (+1232635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:09.558243 (+  6145us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:09.561726 (+  3483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.571603 (+  9877us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:09.657177 (+ 85574us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3167,"prepare.queue_time_us":1232,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":6587,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5207,"thread_start_us":1222161,"threads_started":1,"wal-append.queue_time_us":1044494,"wal-append.run_cpu_time_us":1147,"wal-append.run_wall_time_us":1009685}
I20260709 12:10:10.653376 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.676698 18010 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:10.744813 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.786131 17404 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:10.739840 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:10.755232 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:10.755155 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 113586us
W20260709 12:10:10.683236 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44977.4us
I20260709 12:10:10.852607 17363 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:10.809435 17362 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:10.762091 19175 consensus_meta.cc:287] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.505s	user 0.014s	sys 0.007s
W20260709 12:10:10.770696 19209 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:10:10.851866 17359 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:10.862963 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 76930.6us
I20260709 12:10:10.755663 18958 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:10.855819 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2080) took 2072 ms. Trace:
I20260709 12:10:10.733659 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.800889 17407 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:10.888983 17362 rpcz_store.cc:276] 0709 12:10:08.783246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.426130 (+1642884us) service_pool.cc:224] Handling call
0709 12:10:10.855753 (+429623us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.736826 19211 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:10.725684 19204 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:10:10.874260 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.895990 18014 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:10.875257 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.657317 19024 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.879417 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.705627 19213 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.871073 17434 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
W20260709 12:10:10.712625 19200 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:10:10.705415 19201 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:10.684082 19176 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:10.753991 19220 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.663976 18910 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.745970 19095 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:10.778321 19181 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:10:10.705474 19191 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.881181 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.913792 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.914500 18010 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:10.915505 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.916704 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.704931 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.703711 19195 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.221s
I20260709 12:10:10.880177 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:10.562052 17435 rpcz_store.cc:276] 0709 12:10:08.757146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.480734 (+723588us) service_pool.cc:224] Handling call
0709 12:10:09.492039 (+ 11305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.492293 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:10.220847 (+728554us) log.cc:844] Serialized 14 byte log entry
0709 12:10:10.435068 (+214221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.436559 (+  1491us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:10.441863 (+  5304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.450803 (+  8940us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:10.479747 (+ 28944us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58653,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":3580,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4418,"spinlock_wait_cycles":13083904,"thread_start_us":908876,"threads_started":2,"wal-append.queue_time_us":349081}
W20260709 12:10:10.792544 19212 log.cc:927] Time spent T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:10:10.884775 17258 leader_election.cc:400] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4.
I20260709 12:10:10.933182 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.855960 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:10.749046 19124 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.934340 17363 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:10.891461 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2089) took 2106 ms. Trace:
W20260709 12:10:10.891964 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 91200.7us
W20260709 12:10:10.755434 19197 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.211s	user 0.001s	sys 0.001s
I20260709 12:10:10.894062 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2090) took 2108 ms. Trace:
I20260709 12:10:10.751057 19039 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:10.936920 17359 rpcz_store.cc:276] 0709 12:10:08.785446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.890588 (+2105142us) service_pool.cc:224] Handling call
0709 12:10:10.890963 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.891150 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.891175 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.891217 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:10.891243 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.891295 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:10.891406 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.937690 17407 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:10.879312 19161 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:10.725204 19192 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.169s
I20260709 12:10:10.938920 19161 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:10.939364 19161 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.939445 17407 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:10.923715 18009 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:10.883044 19180 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.770668 19152 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.889065 18919 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:10.898171 17358 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
W20260709 12:10:10.903115 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 212902us
I20260709 12:10:10.895495 19153 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.909541 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.897481 18897 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:10.933506 17258 leader_election.cc:403] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:10.886116 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:10.951550 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.952242 18013 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:10:10.787451 19183 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:10.748864 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.912285 19191 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:10.895377 19211 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.941112 17362 rpcz_store.cc:276] 0709 12:10:08.785691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.890736 (+2105045us) service_pool.cc:224] Handling call
0709 12:10:10.893560 (+  2824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.893741 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.893766 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.893806 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:10.893839 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.893892 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:10.894000 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.963562 17362 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:10.964094 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2098) took 2176 ms. Trace:
I20260709 12:10:10.964380 17362 rpcz_store.cc:276] 0709 12:10:08.787778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.962934 (+2175156us) service_pool.cc:224] Handling call
0709 12:10:10.963265 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.963871 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.964043 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.965759 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1327) took 2156 ms. Trace:
I20260709 12:10:10.944710 17359 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:10.935540 19227 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.003s
I20260709 12:10:10.946503 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.945818 18014 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
W20260709 12:10:10.950333 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 72107.5us
I20260709 12:10:10.887120 19175 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:10.945358 19153 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:10.959372 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:10.943295 19187 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.960853 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:10.941655 19095 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.904022 19213 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.966069 17362 rpcz_store.cc:276] 0709 12:10:08.809394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.965064 (+2155670us) service_pool.cc:224] Handling call
0709 12:10:10.965317 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.965471 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.965496 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.965536 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:10.965565 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.965614 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:10.965708 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.969072 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1320) took 2543 ms. Trace:
I20260709 12:10:10.992422 17360 rpcz_store.cc:276] 0709 12:10:08.417710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.417956 (+   246us) service_pool.cc:224] Handling call
0709 12:10:09.087975 (+670019us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:09.088198 (+   223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:09.602341 (+514143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:09.602378 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:09.752660 (+150282us) log.cc:844] Serialized 26 byte log entry
0709 12:10:10.238404 (+485744us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:10.238468 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.264595 (+ 26127us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540040c9d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:10.264651 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:10.960393 (+695742us) raft_consensus.cc:1685] finished
0709 12:10:10.960414 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:10.960564 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10132,"raft.queue_time_us":3576,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":37852,"spinlock_wait_cycles":1132041600,"thread_start_us":335408,"threads_started":1,"wal-append.queue_time_us":578516}
I20260709 12:10:10.955443 19183 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:10.989467 18015 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.961987 19191 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.962247 19223 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:10.984887 19153 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.000334 19124 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4.
I20260709 12:10:11.009613 19223 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:10.996814 19094 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:10.990590 19187 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:10.957520 19201 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:11.012349 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 126332us
I20260709 12:10:11.011274 18015 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:11.026641 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 86293us
I20260709 12:10:11.029362 19095 raft_consensus.cc:1064] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:10:11.032073 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.028698 17407 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:11.030580 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 241) took 2777 ms. Trace:
I20260709 12:10:11.035044 19095 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.016206 19105 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.025625 19187 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.060735 19094 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.037736 19222 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:10:11.038594 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.022749 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2096) took 2235 ms. Trace:
I20260709 12:10:11.040697 19213 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.043365 19175 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.065613 19105 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.053210 19151 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.048462 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2081) took 2265 ms. Trace:
I20260709 12:10:11.050349 19183 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.074790 19183 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.076386 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.076581 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:11.052456 19180 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.054543 19144 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:11.055945 19152 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.022272 19223 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.057740 19217 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.075889 19222 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.058040 19201 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.049958 18910 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:11.059824 19102 consensus_meta.cc:287] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.852s	user 0.012s	sys 0.000s
I20260709 12:10:11.063978 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.064704 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.045738 19053 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.060194 19211 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.046478 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2097) took 2258 ms. Trace:
I20260709 12:10:11.071625 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.072793 18015 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:11.073921 17366 rpcz_store.cc:276] 0709 12:10:08.783487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.047641 (+2264154us) service_pool.cc:224] Handling call
0709 12:10:11.047990 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.048173 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.048196 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.048233 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:11.048259 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.048307 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.048405 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:11.113449 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 75324.2us
I20260709 12:10:11.079059 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2091) took 2293 ms. Trace:
I20260709 12:10:11.079202 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:11.034475 17436 rpcz_store.cc:276] 0709 12:10:08.252938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.146853 (+893915us) service_pool.cc:224] Handling call
0709 12:10:09.147219 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.995746 (+848527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.026200 (+ 30454us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.042766 (+ 16566us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:10.063466 (+ 20700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.030325 (+966859us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54001473d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:11.030380 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.030521 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883684224}
I20260709 12:10:11.111433 19102 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.119416 18011 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:11.119829 18910 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:11.120182 19102 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.121165 19151 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.123610 19161 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.123737 19203 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.080569 19233 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:11.080020 18947 consensus_meta.cc:287] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.000s
W20260709 12:10:11.110226 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 81974.8us
I20260709 12:10:11.112880 17358 rpcz_store.cc:276] 0709 12:10:08.787532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.960114 (+2172582us) service_pool.cc:224] Handling call
0709 12:10:11.007988 (+ 47874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.023497 (+ 15509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.024862 (+  1365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.031914 (+  7052us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:11.037910 (+  5996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.046239 (+  8329us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.046388 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.114689 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.071362 19105 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.129813 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.136371 17366 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:10:11.132131 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.065837 17364 rpcz_store.cc:276] 0709 12:10:08.787269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.942248 (+2154979us) service_pool.cc:224] Handling call
0709 12:10:10.962530 (+ 20282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.986790 (+ 24260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.988593 (+  1803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.991165 (+  2572us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:10.998629 (+  7464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.007406 (+  8777us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.018612 (+ 11206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.126253 18009 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:11.114172 17363 rpcz_store.cc:276] 0709 12:10:08.785921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.936044 (+2150123us) service_pool.cc:224] Handling call
0709 12:10:10.936347 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.936538 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:11.021274 (+ 84736us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.077693 (+ 56419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.077746 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:11.077789 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.077853 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.078996 (+  1143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130833,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2025,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":2312,"thread_start_us":125679,"threads_started":2}
W20260709 12:10:11.117921 19040 consensus_meta.cc:287] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.004s
I20260709 12:10:11.125849 19161 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.139176 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.073930 19024 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.125931 19203 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.129024 19201 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.143131 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.132953 19233 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:11.138509 18007 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.141957 19222 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:11.214612 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 59708.4us
I20260709 12:10:11.134292 18947 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.223233 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.145269 19235 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.228462 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:11.229604 17978 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.147107 17437 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:11.213712 19237 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.223856 17255 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:11.227006 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.235443 18014 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.215701 17366 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:11.233017 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:11.236653 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 96102us
I20260709 12:10:11.237345 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.144315 19241 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.148126 18959 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.238418 17255 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.237839 17333 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.214056 19233 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.239403 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:11.213881 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.250075 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:11.242050 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.297765 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.298520 17438 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:11.214148 19201 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:11.146595 19040 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.231107 19213 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.235270 19237 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.237746 17407 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.251793 19152 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.235415 19155 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:11.302235 19180 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.339556 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.340235 17367 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:11.341144 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.341747 17367 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
W20260709 12:10:11.343026 17365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2102) took 1990 ms (client timeout 1935 ms). Trace:
W20260709 12:10:11.343453 17365 rpcz_store.cc:269] 0709 12:10:09.352608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.237519 (+884911us) service_pool.cc:224] Handling call
0709 12:10:11.342820 (+1105301us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54002df354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:11.342957 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371569536}
I20260709 12:10:11.215731 19161 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:11.239187 19203 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.232285 19235 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.238593 18910 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.332008 19237 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.251047 19211 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.254829 19225 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.297224 17366 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:11.252077 19223 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.255077 19220 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:11.332883 17332 leader_election.cc:400] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6.
I20260709 12:10:11.261891 19222 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:11.333669 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 95998.5us
I20260709 12:10:11.298954 19094 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.305406 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:11.299695 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:11.232568 19239 consensus_queue.cc:1059] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:10:11.365391 19239 raft_consensus.cc:3055] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:11.365501 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:11.365778 19239 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:11.366842 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:11.366696 19239 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.367462 18011 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:10:11.367969 19239 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.324448 18919 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.371940 19222 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:11.361579 18910 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.324798 19201 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.346715 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:11.328254 19236 raft_consensus.cc:2764] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:11.347777 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:11.301057 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 155494us
I20260709 12:10:11.398945 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:11.351874 19246 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:11.344805 19243 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:11.355532 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2095) took 2568 ms. Trace:
I20260709 12:10:11.402279 17359 rpcz_store.cc:276] 0709 12:10:08.787024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.938409 (+2151385us) service_pool.cc:224] Handling call
0709 12:10:10.944356 (+  5947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.967194 (+ 22838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.355265 (+388071us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b5400030050. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:11.355450 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13012352}
I20260709 12:10:11.345570 19180 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:11.358072 19244 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:11.359162 17332 leader_election.cc:403] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:10:11.413596 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 80863.8us
I20260709 12:10:11.301671 19039 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 12:10:11.350090 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 96241.3us
I20260709 12:10:11.417779 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.363623 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:11.335264 19155 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.361198 19220 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.382797 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.384943 17432 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:11.368425 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:11.426571 17333 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.428573 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.429265 17366 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:11.429708 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.429972 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 250) took 2077 ms. Trace:
I20260709 12:10:11.430419 17366 rpcz_store.cc:276] 0709 12:10:09.352346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.428745 (+2076399us) service_pool.cc:224] Handling call
0709 12:10:11.429045 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.429694 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.429917 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.431888 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 251) took 2079 ms. Trace:
I20260709 12:10:11.432209 17366 rpcz_store.cc:276] 0709 12:10:09.364324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.431130 (+2066806us) service_pool.cc:224] Handling call
0709 12:10:11.431417 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.431587 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.431612 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.431651 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:11.431681 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.431729 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.431837 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.425442 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:11.435395 17432 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.437126 17366 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.437772 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 252) took 2069 ms. Trace:
I20260709 12:10:11.438076 17366 rpcz_store.cc:276] 0709 12:10:09.368148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.433034 (+2064886us) service_pool.cc:224] Handling call
0709 12:10:11.433321 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.437538 (+  4217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.437719 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.439558 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2106) took 2017 ms. Trace:
I20260709 12:10:11.439869 17366 rpcz_store.cc:276] 0709 12:10:09.421768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.438826 (+2017058us) service_pool.cc:224] Handling call
0709 12:10:11.439101 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.439255 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.439280 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.439320 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:11.439348 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.439396 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.439505 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.441337 17366 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:11.441886 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2107) took 2019 ms. Trace:
I20260709 12:10:11.428081 17333 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:11.391151 18910 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.392844 19191 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.394829 19040 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.399677 18012 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:11.359818 19235 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.356458 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:11.359555 18010 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.351199 19203 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:11.409868 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.410418 17291 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:11.411006 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.459084 17359 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:11.434525 18011 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.337934 19152 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.415256 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1334) took 2595 ms. Trace:
I20260709 12:10:11.463711 17365 rpcz_store.cc:276] 0709 12:10:08.819643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.412076 (+2592433us) service_pool.cc:224] Handling call
0709 12:10:11.414783 (+  2707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.414954 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.414979 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.415021 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:11.415050 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.415102 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.415200 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.361856 19223 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:11.421852 17287 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.379729 18919 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.422892 17367 raft_consensus.cc:2393] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:11.372027 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:11.424257 17289 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:11.442421 17366 rpcz_store.cc:276] 0709 12:10:09.422822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.440745 (+2017923us) service_pool.cc:224] Handling call
0709 12:10:11.441023 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.441678 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.441840 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.425415 19180 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:11.443086 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 43600.2us
I20260709 12:10:11.444023 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.422341 18958 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.487183 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:11.487563 19237 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.488955 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2111) took 1979 ms. Trace:
I20260709 12:10:11.425829 19220 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.460476 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.455152 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.446113 19155 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.490077 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.462937 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2108) took 2027 ms. Trace:
I20260709 12:10:11.492092 17359 rpcz_store.cc:276] 0709 12:10:09.435218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.459745 (+2024527us) service_pool.cc:224] Handling call
0709 12:10:11.460030 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.462645 (+  2615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.462671 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.462710 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:11.462737 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.462790 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.462889 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.468895 19223 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.446943 19183 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.471942 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.494735 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2110) took 1985 ms. Trace:
I20260709 12:10:11.424862 19105 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.483371 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.484586 19152 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.485035 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.459656 19024 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.495062 17365 rpcz_store.cc:276] 0709 12:10:09.509041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.493939 (+1984898us) service_pool.cc:224] Handling call
0709 12:10:11.494257 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.494441 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.494464 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.494501 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:11.494526 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.494573 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.494681 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:11.498328 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.470604 17284 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.499111 17407 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.463310 18910 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.513178 18910 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.513619 18910 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.464744 19203 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.502573 17286 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.434844 19187 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.469393 19246 raft_consensus.cc:697] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:11.454075 19241 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:10:11.523067 19246 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.472044 18919 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.531941 19187 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:11.507417 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.500901 17292 raft_consensus.cc:2376] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5. Re-sending same reply.
I20260709 12:10:11.508539 19253 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.509227 18011 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:11.511050 19105 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.532286 18958 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6.
I20260709 12:10:11.512049 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:11.489382 17358 rpcz_store.cc:276] 0709 12:10:09.509303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.488142 (+1978839us) service_pool.cc:224] Handling call
0709 12:10:11.488455 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.488629 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.488656 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.488700 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:11.488736 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.488793 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.488898 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.458249 18947 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.516104 17404 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:11.518005 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.545130 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.503360 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:11.535174 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.537122 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:11.548331 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 45042.9us
I20260709 12:10:11.548758 17404 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:11.549608 17407 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:11.489760 19237 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.514587 17434 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:11.511700 19207 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.891s	user 0.003s	sys 0.000s
I20260709 12:10:11.552810 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.554399 19191 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.555260 19155 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.555822 19217 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:11.556293 19217 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.537824 19253 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.552022 19161 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.558015 17404 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:11.577720 17407 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.581740 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.582290 17404 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:11.583330 19237 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.578739 19253 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:11.580152 19153 consensus_meta.cc:287] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.565s	user 0.001s	sys 0.008s
I20260709 12:10:11.579327 17366 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:11.558842 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.605858 17187 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60632 (request call id 217) took 6919 ms. Trace:
I20260709 12:10:11.567402 17432 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
W20260709 12:10:11.576768 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.585975 17407 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.573194 19241 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.583005 18947 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.585255 19105 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.624558 19245 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.638738 19250 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.639290 19250 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.645038 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.635607 18947 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.646659 18947 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.630255 19241 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.581305 19161 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:11.657296 19161 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.657586 19225 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.660672 19203 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.641374 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:11.663363 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:11.664630 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:11.625022 19243 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:11.627707 19242 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:10:11.628130 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:11.668735 17433 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.630797 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.636747 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.626598 17187 rpcz_store.cc:276] 0709 12:10:04.666630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.666768 (+   138us) service_pool.cc:224] Handling call
0709 12:10:11.585882 (+6919114us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.479848 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.515114 (+ 35266us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.515186 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:10:09.515209 (+    23us) tablet.cc:662] Decoding operations
0709 12:10:09.515623 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.515703 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.515731 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:09.516070 (+   339us) tablet.cc:701] Row locks acquired
0709 12:10:09.516088 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:09.516243 (+   155us) write_op.cc:270] Start()
0709 12:10:09.516359 (+   116us) write_op.cc:276] Timestamp: P: 1783599009516201 usec, L: 0
0709 12:10:09.516380 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.517098 (+   718us) log.cc:844] Serialized 919 byte log entry
0709 12:10:09.547723 (+ 30625us) op_driver.cc:464] REPLICATION: finished
0709 12:10:10.165700 (+617977us) write_op.cc:301] APPLY: starting
0709 12:10:10.196901 (+ 31201us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:10.211187 (+ 14286us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:10.258892 (+ 47705us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:10.423803 (+164911us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:10.443341 (+ 19538us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:10.452778 (+  9437us) write_op.cc:312] APPLY: finished
0709 12:10:10.533950 (+ 81172us) log.cc:844] Serialized 29 byte log entry
0709 12:10:10.544523 (+ 10573us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.548421 (+  3898us) write_op.cc:454] Released schema lock
0709 12:10:10.552579 (+  4158us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:10.604943 (+ 52364us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.613004 (+  8061us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":126475,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":511483,"apply.run_cpu_time_us":3854,"apply.run_wall_time_us":420477,"num_ops":2,"prepare.queue_time_us":815310,"prepare.run_cpu_time_us":13246,"prepare.run_wall_time_us":82717,"raft.queue_time_us":1870,"raft.run_cpu_time_us":6838,"raft.run_wall_time_us":378894,"replication_time_us":31200,"thread_start_us":735492,"threads_started":4,"wal-append.queue_time_us":26488,"wal-append.run_cpu_time_us":3874,"wal-append.run_wall_time_us":2042357}]]}
I20260709 12:10:11.652482 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:11.640666 19155 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.680620 19217 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.685549 19217 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:11.656697 17364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48990
I20260709 12:10:11.690801 19250 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.703986 17364 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:11.704097 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 501) took 1119 ms. Trace:
I20260709 12:10:11.632426 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.704466 17364 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.704985 18011 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:11.696208 19161 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.708168 19161 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:11.710716 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 78395.2us
I20260709 12:10:11.712653 17362 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:11.713385 17364 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.715085 19235 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.715819 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:11.716100 17364 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:11.716540 17186 catalog_manager.cc:5697] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 2 to 3, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:11.722807 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 541) took 1147 ms. Trace:
I20260709 12:10:11.713325 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1332) took 2894 ms. Trace:
I20260709 12:10:11.640909 19105 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.666272 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.643172 19237 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.585589 19187 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.750655 19235 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:11.751217 17361 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:11.751885 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2112) took 1676 ms. Trace:
I20260709 12:10:11.752192 17361 rpcz_store.cc:276] 0709 12:10:10.075471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.750522 (+1675051us) service_pool.cc:224] Handling call
0709 12:10:11.750867 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.751640 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.751834 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.753790 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1350) took 1512 ms. Trace:
I20260709 12:10:11.713040 18910 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:11.755049 17365 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.755901 18910 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.655020 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:11.630503 19153 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.756378 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1345) took 1771 ms. Trace:
I20260709 12:10:11.692412 19180 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.756765 17365 rpcz_store.cc:276] 0709 12:10:09.984935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.511479 (+1526544us) service_pool.cc:224] Handling call
0709 12:10:11.511817 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.755407 (+243590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.756165 (+   758us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54003c4e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:11.756319 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558884224}
I20260709 12:10:11.703048 19233 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.757946 19153 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:11.666046 19241 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.759438 19233 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:11.760850 17434 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:11.698256 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 90109.5us
I20260709 12:10:11.762490 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:11.763319 17434 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:11.764163 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:11.686897 17288 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:11.731963 17362 rpcz_store.cc:276] 0709 12:10:08.819130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.991977 (+2172847us) service_pool.cc:224] Handling call
0709 12:10:11.712163 (+720186us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:11.712326 (+   163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.713066 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.713267 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17805568}
I20260709 12:10:11.723285 18014 rpcz_store.cc:276] 0709 12:10:10.575170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.991751 (+416581us) service_pool.cc:224] Handling call
0709 12:10:11.007215 (+ 15464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.238387 (+231172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.722512 (+484125us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400633154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:11.722725 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524422912}
I20260709 12:10:11.718343 17186 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 3, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:11.744554 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2109) took 2302 ms. Trace:
I20260709 12:10:11.768782 17366 rpcz_store.cc:276] 0709 12:10:09.442364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.467662 (+2025298us) service_pool.cc:224] Handling call
0709 12:10:11.467951 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.626239 (+158288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.744282 (+118043us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400081e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:11.744482 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255325952}
I20260709 12:10:11.694998 19220 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.773097 17361 rpcz_store.cc:276] 0709 12:10:10.241630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.752990 (+1511360us) service_pool.cc:224] Handling call
0709 12:10:11.753300 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.753476 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.753502 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.753560 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:11.753590 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.753640 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.753738 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.776993 17361 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.716600 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:48990 (request call id 1348) took 1729 ms. Trace:
I20260709 12:10:11.756294 19187 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.741173 19105 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.700083 17433 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:11.765530 19155 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.779754 19250 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:10:11.740712 19237 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:11.704525 18009 rpcz_store.cc:276] 0709 12:10:10.584659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.957362 (+372703us) service_pool.cc:224] Handling call
0709 12:10:11.703872 (+746510us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b5400631ad4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:11.704035 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205472640}
I20260709 12:10:11.811491 19220 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.812974 19180 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.813946 18014 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.814241 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 538) took 1256 ms. Trace:
I20260709 12:10:11.815922 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:11.826519 17980 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.816205 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:11.856624 19155 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:11.863942 19246 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:11.863973 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:11.864241 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:11.874743 19155 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.876942 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.864130 19241 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:11.859575 18010 rpcz_store.cc:276] 0709 12:10:10.564298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.971843 (+407545us) service_pool.cc:224] Handling call
0709 12:10:11.009224 (+ 37381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.458284 (+449060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.813962 (+355678us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400573fd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:11.814176 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757180288}
I20260709 12:10:11.877578 17363 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:11.878847 17404 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.878999 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:11.820889 19237 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.896047 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:11.880451 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 452391us
I20260709 12:10:11.880748 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:11.870311 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.869174 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:11.792484 17364 rpcz_store.cc:276] 0709 12:10:09.986795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.656560 (+1669765us) service_pool.cc:224] Handling call
0709 12:10:11.716518 (+ 59958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.900200 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.900813 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:11.877804 19213 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.900352 17363 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:11.928555 17361 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:11.931016 17333 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:11.859967 19153 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:11.902175 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:11.940248 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:11.943636 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.948076 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.899847 19254 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:11.934265 19203 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:11.947754 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:11.980980 18012 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.005s	sys 0.031s
W20260709 12:10:12.007346 18012 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.006s	sys 0.031s
I20260709 12:10:11.945744 19180 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:11.946130 19183 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:12.007473 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:11.936113 17433 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:11.901080 19201 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:11.946370 19039 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:12.013752 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.015974 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:11.951622 19254 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.014773 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:12.018440 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.020814 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:12.023003 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:12.022601 19254 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:12.024624 19259 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:10:12.027251 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:12.027900 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:12.028995 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.031556 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:12.032550 18013 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:12.010272 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:12.034531 17432 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:10:12.010701 19223 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.035650 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:12.037130 19223 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:12.037526 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 251) took 2516 ms. Trace:
I20260709 12:10:12.037822 19223 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.038398 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1342) took 2055 ms. Trace:
I20260709 12:10:12.018963 19219 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.036791 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:12.038985 19219 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.056905 19254 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.057622 19102 raft_consensus.cc:1064] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
W20260709 12:10:12.058276 17332 leader_election.cc:336] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.597s (SENT)
I20260709 12:10:12.058758 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.032706 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.061190 17283 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:12.038805 17359 rpcz_store.cc:276] 0709 12:10:09.982857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.493051 (+1510194us) service_pool.cc:224] Handling call
0709 12:10:11.493368 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.493689 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.493718 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.494193 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.878410 (+384217us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:11.878447 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.878515 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.038062 (+159547us) raft_consensus.cc:1685] finished
0709 12:10:12.038084 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.038334 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6603,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10640,"thread_start_us":383838,"threads_started":1,"wal-append.queue_time_us":447229}
I20260709 12:10:12.014081 18009 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:12.043812 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.022917 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:12.064829 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.068114 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.069319 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.029044 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.071017 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.072532 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:12.074339 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:12.075553 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 52725.2us
I20260709 12:10:12.065245 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:12.018368 19039 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:12.037914 17440 rpcz_store.cc:276] 0709 12:10:09.521517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.996310 (+474793us) service_pool.cc:224] Handling call
0709 12:10:09.996623 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.041827 (+ 45204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:10.163522 (+121695us) log.cc:844] Serialized 14 byte log entry
0709 12:10:10.307144 (+143622us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.307205 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:10.307250 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.129730 (+822480us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b18002af2e0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229fc2a6 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419
0709 12:10:12.037304 (+907574us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54000ff5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:12.037352 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.037471 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3639,"prepare.queue_time_us":121503,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":2968,"raft.queue_time_us":101,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":23257,"spinlock_wait_cycles":153993856,"thread_start_us":143155,"threads_started":1,"wal-append.queue_time_us":261425,"wal-append.run_cpu_time_us":10377,"wal-append.run_wall_time_us":1474257}
W20260709 12:10:12.080379 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 494435us
I20260709 12:10:12.081845 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 263) took 1831 ms. Trace:
I20260709 12:10:12.034579 19192 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.021642 19180 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:12.078687 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:12.069857 17433 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:12.103415 17359 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 2: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:12.079912 17333 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:12.102280 17440 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:12.106135 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.106778 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.063220 19254 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:12.111984 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.069036 19201 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:12.108670 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.116935 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:12.117579 17286 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.118057 17286 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:12.073858 18006 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:12.115118 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.118219 17288 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:12.109167 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.121295 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.121430 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.122779 17359 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.072664 19203 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:12.125384 18013 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:12.112178 18919 consensus_meta.cc:287] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.002s
I20260709 12:10:12.104226 19039 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.128311 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.128274 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.171352 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:12.068648 19222 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:10:12.109234 19256 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.113283 19183 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.166062 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:12.181859 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.180473 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.158579 17286 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.183153 17366 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.176761 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:12.187443 17283 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.178524 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:12.108803 19192 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:12.175295 18910 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.174492 19219 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:12.128840 19254 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:10:12.174922 19203 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.127225 19255 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.122220 19246 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:10:12.226419 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.177826 18919 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.232793 19237 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.221469 19102 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.215397 19180 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:12.242395 18947 consensus_meta.cc:287] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.004s
I20260709 12:10:12.242960 18947 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.243559 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:12.245031 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:12.189306 19258 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.245751 19258 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:12.246188 19258 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.214860 19192 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.250650 17434 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:12.252321 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 559) took 1006 ms. Trace:
I20260709 12:10:12.256922 17366 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:12.262809 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.267666 17407 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:12.256525 18012 rpcz_store.cc:276] 0709 12:10:11.245822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.449879 (+204057us) service_pool.cc:224] Handling call
0709 12:10:11.450203 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.452933 (+  2730us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:12.017015 (+564082us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.251973 (+234958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.252024 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:12.252069 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.252136 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.252257 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18089,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"thread_start_us":785030,"threads_started":2}
I20260709 12:10:12.191097 17288 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.197652 17359 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:12.273942 17360 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.275535 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.275840 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:12.276330 17366 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:12.209615 19270 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:12.180797 19183 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:12.177735 18006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 526) took 1624 ms (client timeout 1763 ms). Trace:
I20260709 12:10:12.207264 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:12.245287 18947 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:12.223798 17437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1297) took 2670 ms (client timeout 2192 ms). Trace:
I20260709 12:10:12.224995 19203 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:12.225381 17441 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.277966 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:12.331305 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 53393.9us
I20260709 12:10:12.275434 19256 raft_consensus.cc:2764] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:10:12.280738 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.280375 18015 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:12.318701 19183 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:12.280076 19264 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:10:12.216326 19241 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:12.326033 17367 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:12.343307 17361 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:12.340556 18009 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:12.332659 19144 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:12.295481 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.278985 19187 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.337497 17366 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:12.319954 18012 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:12.338178 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:12.336885 19248 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.334273 19246 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.323263 19105 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.352674 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1351) took 2110 ms. Trace:
I20260709 12:10:12.358858 17365 rpcz_store.cc:276] 0709 12:10:10.241923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.757745 (+1515822us) service_pool.cc:224] Handling call
0709 12:10:11.758075 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.758925 (+   850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.758953 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.759406 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.889929 (+130523us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:11.889979 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.890070 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.352482 (+462412us) raft_consensus.cc:1685] finished
0709 12:10:12.352501 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.352618 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1037,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":129658,"threads_started":1,"wal-append.queue_time_us":263294}
I20260709 12:10:12.353428 17255 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:12.361513 17255 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:12.363272 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:12.330143 17437 rpcz_store.cc:269] 0709 12:10:09.553519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.965383 (+411864us) service_pool.cc:224] Handling call
0709 12:10:12.223523 (+2258140us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001482d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:12.223708 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443038976}
I20260709 12:10:12.364110 19233 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:12.350793 19144 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:12.320339 18006 rpcz_store.cc:269] 0709 12:10:10.552420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.556059 (+  3639us) service_pool.cc:224] Handling call
0709 12:10:11.937548 (+1381489us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:12.176266 (+238718us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34895744}
I20260709 12:10:12.358917 19223 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:12.372946 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 107770us
W20260709 12:10:12.377600 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 195828us
I20260709 12:10:12.379971 17255 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:12.364738 18919 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:12.364964 19124 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.352088 19267 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:12.360215 19241 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:12.368623 19233 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:12.377004 19223 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:12.381649 19222 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.384945 19194 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.384817 19124 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:12.398749 19253 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.000s
I20260709 12:10:12.402714 19253 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.395484 19187 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:12.403765 19187 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:12.396178 19194 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:12.405524 19194 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.406018 19105 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:12.406684 19124 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.395325 18919 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:12.399910 19201 consensus_queue.cc:1059] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:10:12.404951 19253 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:12.404826 19187 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.410228 19187 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:12.412533 19274 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:10:12.413343 19273 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:10:12.414441 19194 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.391546 17436 raft_consensus.cc:2393] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:12.418705 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:12.420367 18012 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.391278 19233 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:12.396467 17333 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:12.393360 19223 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.404711 19039 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:12.426916 19222 raft_consensus.cc:3055] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:12.443250 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.444766 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.429981 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:12.459405 19194 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:12.460000 19053 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:12.461344 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1333) took 3642 ms. Trace:
I20260709 12:10:12.483844 17360 rpcz_store.cc:276] 0709 12:10:08.819404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.994213 (+2174809us) service_pool.cc:224] Handling call
0709 12:10:11.711586 (+717373us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:11.711763 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.274419 (+562656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.461087 (+186668us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400149bd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:12.461271 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363099776}
I20260709 12:10:12.463451 19124 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.461604 19233 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:12.468407 17437 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:12.393015 19144 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.471398 19039 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:12.473235 17435 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:12.473940 17438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1349) took 1822 ms (client timeout 2248 ms). Trace:
W20260709 12:10:12.475311 19262 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.406s	user 0.005s	sys 0.006s
I20260709 12:10:12.448479 19222 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:12.482115 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 99337.8us
I20260709 12:10:12.469591 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 558) took 1225 ms. Trace:
W20260709 12:10:12.494475 17438 rpcz_store.cc:269] 0709 12:10:10.652012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.652275 (+   263us) service_pool.cc:224] Handling call
0709 12:10:12.473756 (+1821481us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400037354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:12.473882 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374280960}
I20260709 12:10:12.489848 18012 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:12.492461 18910 raft_consensus.cc:2764] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:12.500140 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 256) took 1120 ms. Trace:
I20260709 12:10:12.501022 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1302) took 1120 ms. Trace:
I20260709 12:10:12.500674 17435 rpcz_store.cc:276] 0709 12:10:11.379367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.384183 (+  4816us) service_pool.cc:224] Handling call
0709 12:10:12.472814 (+1088631us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:12.473014 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.496342 (+ 23328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.500068 (+  3726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6979328}
I20260709 12:10:12.503147 19228 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:12.504046 19228 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.504365 19228 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:12.505250 19228 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.506017 18011 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:12.506762 18011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 564) took 1258 ms. Trace:
I20260709 12:10:12.506557 19222 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.507134 18011 rpcz_store.cc:276] 0709 12:10:11.247923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.707569 (+459646us) service_pool.cc:224] Handling call
0709 12:10:12.505637 (+798068us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b54006037a8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aabfebc 00007f122aaf508c 00007f122aadf93b 00007f122aadf3d2 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c
0709 12:10:12.505763 (+   126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.506477 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.506702 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56534784}
I20260709 12:10:12.508633 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2117) took 1100 ms. Trace:
W20260709 12:10:12.511355 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 87700us
I20260709 12:10:12.512205 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:12.509019 17289 rpcz_store.cc:276] 0709 12:10:11.408628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.408737 (+   109us) service_pool.cc:224] Handling call
0709 12:10:11.409005 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.467204 (+ 58199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.508394 (+1041190us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b54003f9b54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:12.508571 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31280384}
I20260709 12:10:12.501569 17439 rpcz_store.cc:276] 0709 12:10:11.380657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.380764 (+   107us) service_pool.cc:224] Handling call
0709 12:10:11.381020 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.458904 (+ 77884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.458941 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.496014 (+ 37073us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.800547 (+304533us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:11.800583 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.800655 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.474734 (+674079us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:12.500707 (+ 25973us) raft_consensus.cc:1685] finished
0709 12:10:12.500741 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.500951 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42425,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":18940,"spinlock_wait_cycles":3316480,"thread_start_us":333784,"threads_started":2,"wal-append.queue_time_us":435078}
I20260709 12:10:12.500692 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 527) took 1947 ms. Trace:
I20260709 12:10:12.499171 19144 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.531637 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.532954 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.535621 17360 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.536471 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:12.531877 17332 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.742s (SENT)
I20260709 12:10:12.497052 18008 rpcz_store.cc:276] 0709 12:10:11.243951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.251053 (+  7102us) service_pool.cc:224] Handling call
0709 12:10:11.328755 (+ 77702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.486355 (+157600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.486389 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.486439 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:11.486474 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.469311 (+982837us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400613854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:12.469363 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.469505 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355092352}
I20260709 12:10:12.538719 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.537974 17332 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:12.538973 17406 leader_election.cc:336] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.612s (SENT)
I20260709 12:10:12.521536 19222 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.531268 19228 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.518220 19194 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:12.101991 17362 rpcz_store.cc:276] 0709 12:10:10.250053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.767045 (+1516992us) service_pool.cc:224] Handling call
0709 12:10:11.767323 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.767508 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:11.953512 (+186004us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.081515 (+128003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.081571 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:12.081614 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.081677 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.081787 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31287,"thread_start_us":273513,"threads_started":2}
I20260709 12:10:12.553154 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:12.553751 17362 raft_consensus.cc:2410] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:12.555172 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 510) took 1057 ms. Trace:
I20260709 12:10:12.555568 18014 rpcz_store.cc:276] 0709 12:10:11.497484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.030206 (+532722us) service_pool.cc:224] Handling call
0709 12:10:12.030596 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.065598 (+ 35002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.065628 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.068944 (+  3316us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.418843 (+349899us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:12.418886 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.418953 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.554965 (+136012us) raft_consensus.cc:1685] finished
0709 12:10:12.554984 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.555115 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34572,"raft.queue_time_us":35923,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":31021,"thread_start_us":292884,"threads_started":1,"wal-append.queue_time_us":425815}
I20260709 12:10:12.521404 19278 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:12.558632 17360 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:12.561894 19231 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:10:12.564530 19194 consensus_queue.cc:1059] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:12.542006 18910 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.520494 19258 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.567934 17255 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:12.534615 19176 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:12.571661 19287 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.573096 19258 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:12.573228 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.573885 17363 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.533361 18007 rpcz_store.cc:276] 0709 12:10:10.552801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.555999 (+  3198us) service_pool.cc:224] Handling call
0709 12:10:11.062696 (+506697us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:11.062930 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.225087 (+162157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.500436 (+1275349us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b5400573354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:12.500621 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177275136}
I20260709 12:10:12.584414 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.587248 19233 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:12.588462 19233 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:12.588912 19233 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:12.590385 19124 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:12.590852 19285 raft_consensus.cc:3055] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.591236 19285 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:12.591593 17363 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:12.593114 17284 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:12.576186 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.574909 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1349) took 2583 ms. Trace:
W20260709 12:10:12.590649 19284 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:12.601787 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:12.604902 17978 leader_election.cc:336] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.843s (SENT)
I20260709 12:10:12.607178 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:12.608063 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.609385 17363 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:10:12.609846 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:12.615829 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:12.616532 18014 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.617321 19119 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.617727 19119 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:12.618224 19258 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.566689 19278 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:12.618582 19119 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.618760 19258 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.619784 19287 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.620503 19119 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.574536 18910 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:12.622076 18910 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.582917 19039 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:12.568861 19290 consensus_queue.cc:1059] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:10:12.625751 17359 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:12.630894 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.631949 18014 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:12.632388 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:12.656541 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 124664us
I20260709 12:10:12.657536 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:12.659065 17332 leader_election.cc:336] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.749s (SENT)
I20260709 12:10:12.660984 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:12.661060 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:12.665231 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 97281.8us
I20260709 12:10:12.624712 19155 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.668751 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.668793 17255 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:12.589861 19233 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.653712 19203 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:12.674324 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 59413.8us
I20260709 12:10:12.660050 19157 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.663574 18919 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.664273 19180 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:12.686887 17406 leader_election.cc:336] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.741s (SENT)
I20260709 12:10:12.592103 19285 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.689106 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:12.690447 19192 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.692139 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.692970 19155 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.703786 19241 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.710253 17365 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.711891 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:12.713492 17283 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.715500 19192 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:12.716818 19258 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:12.719486 19183 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.720711 19255 raft_consensus.cc:3055] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.721354 19255 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:12.724077 19278 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:12.725467 19278 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.696827 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.726794 18014 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:12.733170 19291 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 12:10:12.735987 19288 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:10:12.740965 19295 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:12.597312 17358 rpcz_store.cc:276] 0709 12:10:09.987951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.708580 (+1720629us) service_pool.cc:224] Handling call
0709 12:10:11.708887 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.709095 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:12.125318 (+416223us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.468509 (+343191us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b18003298c0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb23a 00007f1225b25a2a
0709 12:10:12.542910 (+ 74401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.547806 (+  4896us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:12.557070 (+  9264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.562518 (+  5448us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.570861 (+  8343us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26712,"prepare.queue_time_us":399712,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":22686,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9982,"spinlock_wait_cycles":32323456,"thread_start_us":448146,"threads_started":2,"wal-append.queue_time_us":440731}
I20260709 12:10:12.742996 17363 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:12.743795 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.744653 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.742168 19295 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:12.766525 18014 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.776180 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:12.795126 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 134135us
I20260709 12:10:12.754014 19285 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.765600 19176 raft_consensus.cc:3055] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.799705 17406 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:12.747797 19192 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:12.803546 17292 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:12.807307 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1282) took 1102 ms. Trace:
I20260709 12:10:12.768659 19241 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:12.797140 19255 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.808123 19105 consensus_queue.cc:1059] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:12.809005 19255 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.809443 19192 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:12.809873 19294 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:10:12.809125 19241 raft_consensus.cc:3055] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.810510 19241 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:12.800853 19287 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.811502 19241 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.810398 19192 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.812778 19241 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.814285 19246 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:12.814378 19105 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.814925 19246 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.803918 17978 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.815897 19105 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.817471 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.818082 19228 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.818326 19105 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:12.811560 17406 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:12.796360 19144 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:10:12.819983 18958 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.820353 18958 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:12.821151 18958 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.817590 19246 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:12.822865 19213 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:12.822961 19105 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:12.823519 19213 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:12.823794 19105 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:12.824443 19213 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.824869 19105 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.828423 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.829991 19228 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.830571 19228 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:12.807874 17292 rpcz_store.cc:276] 0709 12:10:11.704803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.730292 (+ 25489us) service_pool.cc:224] Handling call
0709 12:10:12.775552 (+1045260us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b58000b0498. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:12.807244 (+ 31692us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321474432}
I20260709 12:10:12.831799 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:12.797617 19187 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:10:12.804618 19176 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:12.807684 19250 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.840046 17439 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:12.840390 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 181948us
I20260709 12:10:12.842844 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:12.852561 17332 leader_election.cc:336] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.598s (SENT)
I20260709 12:10:12.853916 17332 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:12.833523 18919 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:12.850853 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 164326us
I20260709 12:10:12.834784 19231 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:12.855681 17332 leader_election.cc:336] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.536s (SENT)
I20260709 12:10:12.855399 17407 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:12.859232 17406 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:12.861635 17332 leader_election.cc:336] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.655s (SENT)
W20260709 12:10:12.864842 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.867755 17433 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.867908 17438 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.866156 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:12.870630 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.860728 19308 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.871884 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.874023 17440 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.878621 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.878507 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:12.867792 19053 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:12.883200 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 195331us
I20260709 12:10:12.868916 19253 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.908588 17978 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.879540 17433 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.907538 17440 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.870766 18947 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:12.909822 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.913268 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:12.867043 19246 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:12.879523 17435 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.875439 19187 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.853909 19228 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.917809 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:12.918226 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:12.920200 17332 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.920938 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:12.872720 19299 consensus_queue.cc:1059] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:10:12.864634 19223 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:12.923120 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1284) took 1217 ms. Trace:
I20260709 12:10:12.908399 19053 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:12.913769 17437 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.926074 17285 rpcz_store.cc:276] 0709 12:10:11.705407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.710219 (+  4812us) service_pool.cc:224] Handling call
0709 12:10:12.917658 (+1207439us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b58000b0498. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:12.923050 (+  5392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367506176}
I20260709 12:10:12.914685 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:12.913762 19155 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.925741 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.920081 19308 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.877338 19176 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.938089 17332 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.953208 17332 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.884995 19222 consensus_queue.cc:1059] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:12.912010 19213 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:10:12.958825 19213 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:12.959264 19213 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:12.960116 19213 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.961287 19213 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.942022 19313 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.942198 19300 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.916429 19310 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.934746 19306 raft_consensus.cc:2764] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:12.942947 19304 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.943867 19223 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:12.927192 19255 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.934850 18919 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.949272 19053 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:12.964638 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:12.965773 17439 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
W20260709 12:10:12.975996 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.981238 17366 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:12.984937 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 109011us
I20260709 12:10:12.963078 19187 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.989262 17332 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:12.990932 17332 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.070s (SENT) [suppressed 50 similar messages]
I20260709 12:10:12.965660 19256 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.993537 17367 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.965576 19308 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:12.995303 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.992115 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 132989us
I20260709 12:10:12.994010 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:12.962960 19192 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:13.000602 17361 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.001256 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:13.003015 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:13.003822 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:12.991469 19187 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:13.010576 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.991532 18910 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:12.999308 17436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 257) took 1611 ms (client timeout 2080 ms). Trace:
I20260709 12:10:13.011998 19119 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:13.013793 19316 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.014083 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1345) took 2434 ms. Trace:
I20260709 12:10:13.017510 17441 rpcz_store.cc:276] 0709 12:10:10.579728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.583735 (+  4007us) service_pool.cc:224] Handling call
0709 12:10:12.225196 (+1641461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.330447 (+105251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.013822 (+683375us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54001482d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:13.013975 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3774222080}
I20260709 12:10:12.986711 18947 raft_consensus.cc:697] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:13.013734 17436 rpcz_store.cc:269] 0709 12:10:11.387691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.664353 (+276662us) service_pool.cc:224] Handling call
0709 12:10:12.987165 (+1322812us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54000ca154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:12.998572 (+ 11407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624987008}
W20260709 12:10:13.013691 19303 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:10:13.012907 19105 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.016965 19250 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.033124 17361 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:13.030604 19302 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:13.035781 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 157227us
I20260709 12:10:13.053366 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:13.030630 19187 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.056731 19187 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.061419 19219 consensus_queue.cc:1059] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:13.062707 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.050432 19317 consensus_queue.cc:1059] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 12:10:13.069089 19311 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:10:13.050973 19233 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:10:13.051426 19223 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:13.074690 19313 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.085728 19322 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.087532 19302 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.100211 17258 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:13.092473 19219 raft_consensus.cc:3055] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.093324 19317 raft_consensus.cc:3055] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:13.057510 18947 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.108520 19248 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:13.109184 19248 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.103655 19219 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.104681 19317 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.120442 19313 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:13.121441 19313 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:13.122571 19313 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.123029 19313 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.123929 19313 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.127523 19233 consensus_queue.cc:1059] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:13.129721 19233 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.130223 19233 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.131197 19233 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.132682 19233 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.134912 17286 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.141384 17365 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:13.141875 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.142638 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:13.144918 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.142076 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:13.146605 17361 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 2: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:13.145609 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:13.147029 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:13.143678 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.147524 17433 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.148109 19324 consensus_queue.cc:1059] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:13.148715 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:13.150468 17440 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:13.147549 17439 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:13.149986 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:13.152509 17367 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:13.155841 17286 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:13.156539 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1305) took 1130 ms. Trace:
I20260709 12:10:13.158613 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:13.159545 17433 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:13.159843 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:13.156867 17286 rpcz_store.cc:276] 0709 12:10:12.026402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.116704 (+ 90302us) service_pool.cc:224] Handling call
0709 12:10:12.691700 (+574996us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b58000f53d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225a770aa 00007f1225af9447 00007f1225b11fe7 00007f1225b137de 00007f1225b1f27c 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c
0709 12:10:13.134450 (+442750us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b5400158720. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225a90a1d 00007f1225a771a4 00007f1225af9447 00007f1225b11fe7 00007f1225b137de 00007f1225b1f27c 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591
0709 12:10:13.156460 (+ 22010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842625792}
I20260709 12:10:13.162057 17365 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:13.162025 17432 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.166191 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:13.168012 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 67906.9us
I20260709 12:10:13.159405 19285 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.149621 19105 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:13.149897 19250 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:13.243276 17440 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:13.244268 17439 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.169581 18947 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.171219 19201 raft_consensus.cc:3055] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.169390 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:13.246631 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:13.212455 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:13.211660 19285 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.261417 19318 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.167501 19316 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
W20260709 12:10:13.296293 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.324889 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.307747 17286 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.368141 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.370977 17286 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.248797 19201 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.242172 19105 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.297850 18919 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.243701 19250 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.380059 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.299363 19332 raft_consensus.cc:3055] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.383230 17286 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:13.389070 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 146858us
I20260709 12:10:13.391048 17404 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:13.392117 17292 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.382968 17436 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:13.367306 19223 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:13.249393 19317 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:13.403241 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.252133 19219 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.387166 19332 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.389457 18919 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:13.394483 19330 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:13.413367 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.408123 19187 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:13.417493 17359 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.418907 17365 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.412117 19317 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.382701 19285 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.406605 19223 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.415603 19330 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.429778 19330 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:13.432344 19333 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:10:13.408891 19201 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.434336 19201 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.436853 19324 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.437448 19324 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.438555 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:13.439448 18007 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:13.439548 19324 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.442344 17440 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:13.446722 17440 pending_rounds.cc:85] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 5
I20260709 12:10:13.446980 17440 pending_rounds.cc:107] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:13.445840 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1308) took 2029 ms. Trace:
I20260709 12:10:13.447749 17432 rpcz_store.cc:276] 0709 12:10:11.416117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.072409 (+656292us) service_pool.cc:224] Handling call
0709 12:10:12.991185 (+918776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.163368 (+172183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.444920 (+281552us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54000ca154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:13.445627 (+   707us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54000ca150. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:13.445768 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498540672}
I20260709 12:10:13.447206 17440 raft_consensus.cc:2889] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:13.451283 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.440199 19305 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.495s	user 0.007s	sys 0.000s
I20260709 12:10:13.454387 17981 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:13.423441 19187 raft_consensus.cc:697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:13.456238 19187 consensus_queue.cc:237] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.453169 19285 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.460811 19327 raft_consensus.cc:3055] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.461273 19327 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.441159 19317 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:13.462868 19237 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:13.463109 19105 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:13.463635 19317 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.464181 18919 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.444042 17434 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:13.427450 19241 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:13.466619 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.470669 17255 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:13.441915 19183 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:13.449319 19180 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.448994 19330 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.484874 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.451061 18958 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.519603 17367 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:13.453874 19213 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.529387 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.530257 17367 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:13.535481 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.538885 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 68315.5us
I20260709 12:10:13.478662 19152 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:13.545660 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:13.539129 19339 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:13.481086 19241 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:13.525833 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.557358 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:13.563009 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.518541 19180 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.569625 19180 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.570832 19223 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.523113 19330 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.575297 19330 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.562328 19250 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:13.440601 19332 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.556033 19295 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.542346 19213 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.484773 19327 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.588249 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.591543 17358 raft_consensus.cc:3055] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.592010 17358 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:13.580838 19330 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.592832 17358 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.592994 19330 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.580390 19180 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.578851 19324 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:13.597327 19344 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:13.603906 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.589152 19295 raft_consensus.cc:697] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.594092 17358 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.594775 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.552865 19152 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.600698 19327 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:13.626953 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.631703 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.603341 19241 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.607759 19344 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.650967 19344 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.636037 19317 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.648046 19241 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.660281 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:13.657779 19330 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.668406 19295 consensus_queue.cc:237] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:13.680019 19233 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.004s
I20260709 12:10:13.682005 17286 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:13.683420 19326 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.550s	user 0.000s	sys 0.001s
I20260709 12:10:13.698305 19213 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:13.701190 19309 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.758s	user 0.005s	sys 0.008s
I20260709 12:10:13.702507 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1373) took 1136 ms. Trace:
I20260709 12:10:13.702967 17363 rpcz_store.cc:276] 0709 12:10:12.566137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.612963 (+ 46826us) service_pool.cc:224] Handling call
0709 12:10:12.613296 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.743436 (+130140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.702216 (+958780us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54001130d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:13.702426 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297810816}
I20260709 12:10:13.704880 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1303) took 1679 ms. Trace:
I20260709 12:10:13.705348 17283 rpcz_store.cc:276] 0709 12:10:12.025625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.215102 (+189477us) service_pool.cc:224] Handling call
0709 12:10:12.291385 (+ 76283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.713936 (+422551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.704613 (+990677us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54001c0554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:13.704805 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970313472}
W20260709 12:10:13.709997 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.712704 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.715070 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.716324 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.717121 17284 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:13.718672 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.719480 17284 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:13.720820 17289 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.721881 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.709962 17364 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:13.720834 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.723590 19152 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:13.723752 19248 consensus_meta.cc:287] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.006s
I20260709 12:10:13.728430 17289 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.729524 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.730198 17285 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:13.731282 17291 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:13.731786 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.733718 17291 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.733870 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:13.734211 17291 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:13.728456 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.735097 17291 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.732506 17287 raft_consensus.cc:2376] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2. Re-sending same reply.
I20260709 12:10:13.737315 17291 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.741786 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:13.742144 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 287790us
I20260709 12:10:13.722812 17364 pending_rounds.cc:85] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 2
I20260709 12:10:13.742973 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.745659 17287 raft_consensus.cc:2410] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:13.743305 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.746632 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.744499 17284 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.724304 19248 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.747799 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.750465 18015 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:10:13.750401 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:13.723610 17358 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:13.750976 19347 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:13.771481 18015 pending_rounds.cc:85] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 4
I20260709 12:10:13.771310 17291 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:13.771827 18015 pending_rounds.cc:107] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:10:13.757261 19155 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:13.757742 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.757421 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.772620 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.773007 17285 raft_consensus.cc:2410] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:13.757403 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.773993 18015 raft_consensus.cc:2889] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:13.774708 18012 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.773072 17332 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:13.776688 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.777824 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.778527 17291 raft_consensus.cc:2393] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:13.778800 17332 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:13.779276 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.783118 17332 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:13.780375 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.738714 19285 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.780723 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1370) took 1217 ms. Trace:
W20260709 12:10:13.784384 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.781652 18958 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:13.745204 17364 pending_rounds.cc:107] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:13.784029 17332 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:13.784499 17366 rpcz_store.cc:276] 0709 12:10:12.563005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.563872 (+   867us) service_pool.cc:224] Handling call
0709 12:10:12.564186 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.988213 (+424027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.780483 (+792270us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400242cd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:13.780652 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958600576}
I20260709 12:10:13.787808 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:13.793079 17441 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.789947 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.789906 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.790977 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:13.791473 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 95651.5us
I20260709 12:10:13.799264 18012 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:13.798393 17283 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:13.799552 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.800357 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.800678 17291 raft_consensus.cc:2410] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:13.801607 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.803012 17284 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:13.804184 17365 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.804864 17291 raft_consensus.cc:1240] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:13.806331 17291 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:13.770771 19336 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.812501 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:13.812837 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.813205 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:13.814693 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.816232 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:13.782630 18919 consensus_queue.cc:1059] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:13.817574 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:13.818656 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:13.781816 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:13.773670 19180 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:13.785923 19144 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.824048 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:13.839886 17406 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:13.820286 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:13.773298 19314 consensus_queue.cc:1059] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 12:10:13.790794 19258 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:10:13.781800 19347 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.789847 19183 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.798707 17364 raft_consensus.cc:2889] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:13.741863 19233 consensus_queue.cc:1059] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:10:13.843065 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:13.852728 19228 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.786592 19299 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:13.832116 19235 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.791870 19330 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:13.837909 18958 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.835916 19102 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.835718 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:13.847842 19253 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.869216 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:13.862221 18009 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 2: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:13.818063 19292 consensus_queue.cc:1059] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:13.846632 19187 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.877611 19250 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.858779 19144 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.884637 19144 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:13.856137 19183 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:13.846585 17441 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:13.868798 19228 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.866806 19153 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.864262 18919 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.844888 19180 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.824765 19336 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.894294 19296 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.904752 19296 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:13.868335 19237 consensus_queue.cc:1059] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:13.880002 19213 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:13.896224 19183 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.902479 19292 consensus_queue.cc:1243] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer e860f7e876b74ec589f447737822a4f6 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:13.907217 19299 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.879166 19246 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:13.905992 19336 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.896579 19124 consensus_queue.cc:1059] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 12:10:13.850672 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.976109 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.977201 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.977792 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.952908 17283 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:13.894038 19144 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:13.981173 19144 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.982542 19302 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:13.988129 19310 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.957763 17284 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:13.915580 19180 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.993345 17285 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.912946 19213 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.995314 17285 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.996801 19213 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.923583 19228 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:13.927691 19235 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.921985 19248 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:13.905646 19296 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.916051 19299 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:13.922433 19332 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.989185 19310 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.919780 19347 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:13.965169 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 144807us
W20260709 12:10:13.965335 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 181256us
W20260709 12:10:13.992304 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.002364 17283 raft_consensus.cc:3055] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.000988 19246 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.010974 19296 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.012948 17332 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:14.014446 19246 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.014025 19255 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:14.017338 19246 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.018359 19255 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:14.025410 19255 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:14.006475 17283 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:14.002756 19299 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.037357 19299 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:14.042503 19360 consensus_queue.cc:1175] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "868a5e341d0a41b4ac0927342c8cd598" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 12:10:14.048338 17404 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:14.050091 19237 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.050585 19318 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.051054 19237 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.056444 19152 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:14.056995 19176 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.058890 17404 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:14.063638 19235 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.065465 19219 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.066541 19235 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.067440 19235 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.068262 19241 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:14.068734 19241 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:14.070083 19235 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.065955 17404 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:14.072186 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 52307.1us
I20260709 12:10:14.054080 19237 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.078773 17437 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:14.081890 19235 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.098943 19183 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:14.099937 19320 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.119s	user 0.007s	sys 0.007s
I20260709 12:10:14.081866 19241 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.102713 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:14.103302 19254 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:14.105620 19241 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:14.090461 19235 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:14.112377 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.114576 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.114959 17435 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.111274 17283 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.117446 19183 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:14.116818 19255 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:14.118398 19302 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.118861 19302 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.122844 17283 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.123505 19144 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:14.123898 17288 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:14.126361 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:14.108845 19235 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.142136 19370 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:14.148653 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:14.156349 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:14.148999 19360 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:14.164109 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 73393.7us
I20260709 12:10:14.165489 17365 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.168712 19267 raft_consensus.cc:3055] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.170228 17441 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:14.170463 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:14.171489 18919 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.171741 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.172115 17358 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:14.173683 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.174018 19248 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:14.175495 19312 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 1.230s	user 0.002s	sys 0.010s
I20260709 12:10:14.177524 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.208380 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:14.208665 19364 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.209231 17434 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 2: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:14.178511 19322 raft_consensus.cc:3055] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:14.209420 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.209718 19322 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:14.184621 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:14.211129 19310 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.211922 19248 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.209439 17286 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:14.213992 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.190542 18958 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.192157 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:14.157647 18008 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.199820 17291 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:14.202953 17440 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:14.199208 17441 pending_rounds.cc:85] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 5
I20260709 12:10:14.140412 19302 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:14.208168 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.173568 19298 raft_consensus.cc:3055] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:14.216084 17441 pending_rounds.cc:107] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:14.209173 19364 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:14.199115 19267 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:14.225103 17284 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:14.223590 17441 raft_consensus.cc:2889] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:14.211033 19322 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.224964 18014 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 2: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:14.242515 19356 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:14.243716 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.243242 19356 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.246512 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:14.251245 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 102786us
I20260709 12:10:14.252933 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:14.223425 19298 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:14.270045 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.231436 19248 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.295254 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:14.295712 17286 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:14.296696 19356 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:14.253513 17432 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:14.300458 17283 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:14.218767 19144 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:14.302722 17365 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.308943 17359 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.308602 18947 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:14.309684 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:14.325556 18947 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.326562 19298 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:14.334074 19298 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.316813 17333 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:14.319669 19228 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.320166 19152 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:14.343976 19152 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.344981 19144 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.347302 19228 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:14.320798 19324 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:10:14.321399 19213 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:14.309811 17358 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:14.327911 19254 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:14.334421 17365 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.334753 19328 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.334471 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:14.336109 19053 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.378460 19152 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:14.334687 19336 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.380110 19336 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:14.343982 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.375617 19248 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.376694 19299 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:14.377554 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 79683.5us
I20260709 12:10:14.315969 19322 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:14.383494 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 55166.9us
I20260709 12:10:14.382160 17188 catalog_manager.cc:5697] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:14.303438 19364 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:13.656005 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:14.379720 19356 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.387427 18014 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:14.390199 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 49955.1us
I20260709 12:10:14.386504 19346 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.297145 19347 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:14.393044 19346 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.404696 19346 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:14.399461 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.401726 19187 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:14.403209 18007 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:14.403468 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:14.413095 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.414017 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.395977 19302 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:14.383517 19248 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.422142 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.422994 17365 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.396364 19254 consensus_queue.cc:1243] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:14.339159 19267 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.382195 19328 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.428788 17289 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:14.434229 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.413491 19228 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:14.440147 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.435873 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:14.443270 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:14.444218 18009 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:14.443822 19336 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.427439 19253 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:10:14.447763 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 49344.8us
I20260709 12:10:14.419348 19356 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.449674 17432 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:14.415951 19347 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.459743 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.435763 19235 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.461337 19314 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 12:10:14.466591 19376 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
I20260709 12:10:14.466914 19314 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:14.467372 19314 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:14.468395 19314 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.467140 19213 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:14.460191 18910 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.473031 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:14.473927 17358 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:14.469838 19314 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:14.475565 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.477176 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:14.478135 17360 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:14.478924 18919 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.460630 19152 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.466073 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:14.484760 17441 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:14.488582 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:14.487432 19248 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.495934 17981 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:14.498412 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.501245 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44147.5us
I20260709 12:10:14.503822 19339 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:14.505501 19228 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.505026 19332 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:10:14.505752 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:14.470407 19364 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.507833 17291 raft_consensus.cc:2376] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3. Re-sending same reply.
I20260709 12:10:14.482897 19347 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:14.510716 19313 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:14.475219 18910 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:14.504382 17255 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:14.519374 17288 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:14.514330 19228 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:14.532513 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.541632 18919 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:14.542445 18919 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:14.544860 18919 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:14.546044 17186 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55928 (request call id 323) took 9554 ms. Trace:
I20260709 12:10:14.546593 17186 rpcz_store.cc:276] 0709 12:10:04.986748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.990232 (+  3484us) service_pool.cc:224] Handling call
0709 12:10:05.038928 (+ 48696us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54000762d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a85090 00007f1225b23f3a 00007f122b8d9e9c 00007f122b9d804e 00007f1229e992a4 00007f1229e99232 00007f1229e99161 00007f1229e990dc 00007f1229e98392 00007f1223e5648c 00007f1223e558c6
0709 12:10:14.541132 (+9502204us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:12.068346 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:12.206690 (+138344us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:12.208060 (+  1370us) write_op.cc:435] Acquired schema lock
0709 12:10:12.208884 (+   824us) tablet.cc:662] Decoding operations
0709 12:10:12.209436 (+   552us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:12.209499 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:12.209531 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:12.234451 (+ 24920us) tablet.cc:701] Row locks acquired
0709 12:10:12.234473 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:10:12.234642 (+   169us) write_op.cc:270] Start()
0709 12:10:12.234766 (+   124us) write_op.cc:276] Timestamp: P: 1783599012234588 usec, L: 0
0709 12:10:12.234788 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:12.235547 (+   759us) log.cc:844] Serialized 924 byte log entry
0709 12:10:12.909025 (+673478us) op_driver.cc:464] REPLICATION: finished
0709 12:10:13.026155 (+117130us) write_op.cc:301] APPLY: starting
0709 12:10:13.026249 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:13.026369 (+   120us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:13.026498 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:13.036790 (+ 10292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:13.036988 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:13.037034 (+    46us) write_op.cc:312] APPLY: finished
0709 12:10:13.037278 (+   244us) log.cc:844] Serialized 29 byte log entry
0709 12:10:13.038032 (+   754us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:13.038143 (+   111us) write_op.cc:454] Released schema lock
0709 12:10:13.042115 (+  3972us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:13.066265 (+ 24150us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:13.066300 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":808629,"reported_tablets":7,"spinlock_wait_cycles":71991040,"child_traces":[["op",{"apply.queue_time_us":114483,"apply.run_cpu_time_us":2867,"apply.run_wall_time_us":27552,"num_ops":2,"prepare.queue_time_us":223249,"prepare.run_cpu_time_us":17054,"prepare.run_wall_time_us":345955,"raft.queue_time_us":189418,"raft.run_cpu_time_us":31239,"raft.run_wall_time_us":158659,"replication_time_us":638508,"thread_start_us":503736,"threads_started":4,"wal-append.queue_time_us":259155,"wal-append.run_cpu_time_us":10431,"wal-append.run_wall_time_us":1569225}]]}
I20260709 12:10:14.528252 17288 pending_rounds.cc:85] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 2
I20260709 12:10:14.566439 17288 pending_rounds.cc:107] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:14.566757 17288 raft_consensus.cc:2889] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:14.551220 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 46997.5us
I20260709 12:10:14.527680 19313 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:14.562868 19248 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.528954 19228 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.557013 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:14.563192 17407 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:14.564318 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:14.564653 17360 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.556324 19356 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:14.574982 17290 raft_consensus.cc:2410] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:14.563568 19267 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.572371 19339 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.581125 19254 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.582461 19292 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.582871 19254 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.583057 19292 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.584342 19295 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:14.585187 19254 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.585935 19194 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:14.586311 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 171221us
I20260709 12:10:14.587424 19213 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.588085 19378 consensus_queue.cc:1059] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:14.588914 19213 consensus_queue.cc:1059] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:14.589885 19378 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:14.591600 19313 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.592715 19313 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.594027 19124 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.594691 19124 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.595721 19336 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:14.598476 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 69216.5us
I20260709 12:10:14.598764 17292 raft_consensus.cc:2410] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 12:10:14.599628 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.581705 17287 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
W20260709 12:10:14.608362 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 149339us
I20260709 12:10:14.585860 19235 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.601298 17255 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:14.564002 19152 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:14.611358 19379 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:10:14.607702 19328 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.599268 19346 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.599792 18008 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:14.616360 19246 raft_consensus.cc:3055] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.616802 19347 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:14.636847 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:14.610165 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:14.639011 17286 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:14.618618 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.620267 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:14.621222 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 284) took 1256 ms. Trace:
W20260709 12:10:14.639745 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.640202 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:14.640842 17360 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:14.600010 19213 raft_consensus.cc:3055] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.642001 19213 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:14.626027 17365 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:14.613121 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:14.601523 19254 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.581128 19339 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:14.634624 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 53301.3us
W20260709 12:10:14.621239 19377 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 12:10:14.636315 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 47776.3us
I20260709 12:10:14.581568 18919 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:14.639813 17290 rpcz_store.cc:276] 0709 12:10:13.365150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.365404 (+   254us) service_pool.cc:224] Handling call
0709 12:10:14.620988 (+1255584us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400200dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:14.621143 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760737536}
I20260709 12:10:14.638136 19347 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:14.656935 19347 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.658351 19347 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.642305 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:14.663695 19152 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:14.674467 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:14.677594 19253 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:14.636569 19246 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:14.624660 18947 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:14.638782 19328 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.668220 19235 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.682168 17980 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:14.650314 19339 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.609520 18910 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.690912 19328 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.709575 18006 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:14.692735 19235 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:14.696118 19310 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.682245 19241 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:14.694458 17358 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.718264 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:14.710961 19266 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.692045 19322 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:10:14.687084 18919 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:14.736372 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 123377us
I20260709 12:10:14.719203 19328 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.717721 18910 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.741693 17287 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:14.726770 19235 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.744812 17283 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.732419 19266 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.750793 19334 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.750993 17365 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.751996 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:14.756021 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 102304us
I20260709 12:10:14.759783 17362 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:14.763685 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:14.750622 19384 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.773658 17365 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:14.773869 19346 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:14.774232 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.776311 18919 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:14.776589 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.780665 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 157452us
I20260709 12:10:14.750698 19374 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.770766 19313 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.786226 19334 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.788532 19292 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.750661 19391 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.793807 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:14.819763 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.758666 19266 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.793201 17366 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
W20260709 12:10:14.824967 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 55914.4us
I20260709 12:10:14.755923 19180 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.833861 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:14.838866 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:14.756912 19124 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:14.840095 17404 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:14.844415 17407 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:14.741209 19246 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:14.853868 19314 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:14.856936 19395 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.857547 19395 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.857962 19395 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.870400 17290 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:14.873466 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46274.8us
I20260709 12:10:14.874204 19391 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:14.875789 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:14.876502 19391 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:14.839579 19180 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:14.877991 19393 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.883260 17980 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:14.890717 17366 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:14.826408 19152 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:14.841907 19053 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:14.826195 19356 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:14.835466 18947 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:14.873921 19248 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.828686 19310 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:14.836660 19313 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:14.920315 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.913491 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:14.765940 19213 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.851089 19292 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.894721 17332 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:14.890866 19384 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.901295 19322 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.922456 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:14.927649 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 87174us
I20260709 12:10:14.927711 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:14.919063 19298 consensus_meta.cc:287] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.526s	user 0.002s	sys 0.009s
W20260709 12:10:14.930164 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46995.8us
W20260709 12:10:14.932806 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 93839.5us
I20260709 12:10:14.915683 19237 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.914546 19124 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.914572 19393 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:14.930755 17404 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:14.934741 19180 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.924754 19176 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.936158 18919 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.936666 19356 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.937009 19213 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:14.938202 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.917044 19053 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.938611 17290 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:14.941267 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46529.8us
I20260709 12:10:14.944465 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:14.934762 19385 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:10:14.942447 19246 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.948441 19384 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.953145 19393 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:14.904671 19339 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:14.915088 19253 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:14.933137 17980 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:14.967468 18014 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:10:14.960966 19176 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.989177 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:14.962635 19356 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:14.986636 17292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1308) took 1275 ms (client timeout 1527 ms). Trace:
I20260709 12:10:14.962360 18947 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:14.964931 19347 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.943596 19228 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:14.942911 19292 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:14.967411 19237 raft_consensus.cc:697] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:14.984131 19314 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.996881 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.998319 17283 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:14.998549 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.003316 17365 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
W20260709 12:10:14.996628 17292 rpcz_store.cc:269] 0709 12:10:13.711444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.711568 (+   124us) service_pool.cc:224] Handling call
0709 12:10:14.968379 (+1256811us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54001c0f54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:14.986557 (+ 18178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2011967232}
I20260709 12:10:15.002615 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:15.003813 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 70763.7us
I20260709 12:10:15.005115 17980 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:14.984567 19364 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:14.967199 19322 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:15.006472 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 62119.7us
I20260709 12:10:14.991019 18919 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:15.009155 17366 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:14.995488 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:14.997807 19176 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:15.010121 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 114469us
I20260709 12:10:14.999392 19356 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.012506 17285 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:14.987726 19299 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:15.024610 19152 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.011350 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 45021us
I20260709 12:10:15.011468 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:14.985713 19124 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.030313 19152 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.032325 19124 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.025796 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.032967 19152 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:14.999557 19347 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:15.027269 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.033669 19347 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.030489 18014 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:15.041960 17440 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:15.043179 19347 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.047281 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:15.050622 17359 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:15.001098 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.045794 19347 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.060421 18007 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:15.066277 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:15.068271 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.067932 17362 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:15.070034 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:15.051499 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.076035 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.082628 19334 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.083930 17434 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.084227 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.084795 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.086118 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.086897 17439 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:15.068531 18919 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.086226 19405 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.059365 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.028100 19314 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.072546 19152 raft_consensus.cc:2764] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:15.079053 17359 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:15.103420 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.057247 19144 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:15.058380 19364 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.071372 18947 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:15.095460 19253 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.115480 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.118379 17366 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:15.122512 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:15.123874 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 64510.8us
I20260709 12:10:15.123289 17432 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:15.126375 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.126945 17433 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.127544 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.128608 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.129133 17439 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:15.112319 19347 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.130080 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.135406 17439 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:15.104955 19310 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:15.115350 19267 consensus_meta.cc:287] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.515s	user 0.002s	sys 0.009s
I20260709 12:10:15.077646 19400 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:15.134793 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.144311 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.130486 19152 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.151209 17436 raft_consensus.cc:2410] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:10:15.151769 19392 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:10:15.153227 19314 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:15.154454 18011 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:15.156584 19292 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:15.159516 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.159876 19336 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.004s
W20260709 12:10:15.160081 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.160485 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.161650 19053 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.103420 19237 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.138933 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.163546 19144 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.136022 19411 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.165496 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.156452 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.167443 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:15.176133 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.173630 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 126407us
I20260709 12:10:15.167882 18015 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.170958 19144 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.182310 19411 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.184355 19144 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.185807 18919 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:15.186183 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.186496 19228 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.187974 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.188572 19414 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.188709 17433 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:15.189178 19414 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.191220 19364 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.191377 19414 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:15.191998 19414 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.192504 19414 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.194403 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.195932 17439 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.197093 17439 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.161787 19328 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.199313 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.199896 19334 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:15.200444 19328 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.200567 19334 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.201098 17441 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.165305 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.202932 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.203375 19339 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.166194 19313 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.168468 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.171571 19384 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.144372 19394 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.167694 18007 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.228304 19334 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.168834 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.169998 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.230196 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.175750 19248 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.231314 19248 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:15.232424 19248 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.202934 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.204552 19235 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:15.234918 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 128626us
I20260709 12:10:15.236918 19235 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.238232 19235 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.238761 19235 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:15.239675 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.168562 19322 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.175163 19254 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.205519 17433 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:15.225308 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 52039us
I20260709 12:10:15.240890 19235 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:15.224992 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 121636us
I20260709 12:10:15.242945 17333 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.238678 19414 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:15.240216 19411 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:15.228353 19266 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.243732 19415 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.245102 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.246416 19266 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:15.214896 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 144200us
I20260709 12:10:15.249006 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.255029 17441 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.256629 17333 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.254002 18015 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:15.278976 18015 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.225344 19347 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.254616 19415 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.256368 18910 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.279785 19255 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:15.287649 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.294723 17404 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.298429 17333 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:15.299265 17365 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:15.300415 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.300438 17978 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.307569 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.305738 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.309795 17433 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.292405 18910 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:15.316371 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 236481us
I20260709 12:10:15.300539 19411 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.319255 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.246577 18947 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.308447 19144 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.300395 19267 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.306052 19228 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:15.322028 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.277719 19394 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.337100 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:15.340514 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.351758 17363 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:15.352837 18919 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:15.353308 18919 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:15.353684 18919 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.358582 19394 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.359427 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.313382 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.337849 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.360594 17434 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:15.361164 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.361745 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:15.362977 19409 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.232s	user 0.003s	sys 0.000s
I20260709 12:10:15.349826 19144 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:15.366746 19144 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.367146 19420 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.367905 19420 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:15.362918 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.319877 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.370404 19213 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.370827 19213 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.371184 19213 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.371284 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.372714 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.366039 19152 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:15.373550 18007 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 2: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:15.375102 19292 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.375669 19292 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.376648 19255 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:15.300140 19418 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:15.378273 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.378499 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.379247 19322 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.378290 19228 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.380097 19328 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.380620 19328 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.381863 19228 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:15.313694 19415 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:10:15.350579 19267 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.382616 19328 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.382999 19267 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.379683 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.384239 19152 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:15.384683 19152 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.384825 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.385524 17288 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:15.334758 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.386972 19213 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.389150 19213 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.379209 17290 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:15.349064 17438 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
W20260709 12:10:15.403111 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.343129 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.343781 19416 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.318315 18910 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.298092 19364 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:15.243664 19395 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.389681 19253 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.408787 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.409143 17258 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.322497 19411 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.411393 17333 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.419601 19411 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.377873 19292 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.418088 17433 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:15.422529 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.424244 17291 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:15.363068 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.432092 18015 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:15.408787 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.433642 17440 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.435500 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.433099 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.437474 19364 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.442796 17290 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:15.451102 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.452473 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:15.455272 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 46231.5us
I20260709 12:10:15.455997 19401 raft_consensus.cc:3055] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.456399 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:15.456645 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 45357.1us
I20260709 12:10:15.457665 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.458508 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.462512 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.463297 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.498723 17366 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:15.463977 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.499789 17362 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.467995 19395 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.468636 19248 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.469162 17358 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.469058 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:15.469672 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.416489 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.470309 17434 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:15.472353 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.474058 19313 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:15.474975 19255 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.528332 19255 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.475431 19299 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:15.525452 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.457810 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.542445 18011 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:15.543457 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.476805 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.477545 19187 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:15.543761 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.544261 18010 raft_consensus.cc:2376] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5. Re-sending same reply.
I20260709 12:10:15.546452 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.547122 17292 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:15.546000 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.548498 18010 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:15.549201 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.550180 19255 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.550909 17436 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:15.483074 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.430891 19292 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.409775 19176 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.483868 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.379814 19322 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:15.409543 19356 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.484745 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.486199 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.475122 19418 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.586854 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.587085 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 129327us
I20260709 12:10:15.475603 18014 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:15.489006 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.441780 17981 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:15.588112 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 146433us
I20260709 12:10:15.489938 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.456458 19401 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:15.495568 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.453800 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.591109 17441 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.507733 17980 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:15.592233 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 84619us
I20260709 12:10:15.511927 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.495152 19364 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:15.522356 17437 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:15.616055 19364 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.617482 19364 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.527163 19411 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.619648 19411 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.620450 17435 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.623999 17287 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.518461 17291 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:15.519641 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:15.625326 19415 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.625386 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:15.524384 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.626549 17440 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.540359 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.540210 19299 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.514142 19248 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.630429 19248 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.631973 19299 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.617717 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:15.633539 17290 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:15.522588 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.634577 19378 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.635076 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.636313 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.636582 19384 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.521274 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.638574 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:15.639175 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 127352us
I20260709 12:10:15.544514 19187 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:15.640326 19187 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.641526 19187 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.641903 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.642745 17364 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.480015 19405 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.635083 19378 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:15.644061 19378 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.531042 17367 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:15.645457 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.646042 17367 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.472872 19267 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.646380 18013 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.614966 19180 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.648190 19267 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:15.648646 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.649262 18013 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:15.482951 19152 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:15.625264 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.550428 18011 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:15.578074 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:15.625973 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 106442us
I20260709 12:10:15.578543 19400 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.578740 19255 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.549381 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.580479 18910 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.582825 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:15.594347 19213 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:15.585758 19144 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.597440 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:15.688591 17288 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.598402 19401 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.598969 18919 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.599319 19418 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.599771 18012 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.603399 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.605384 19322 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.608161 19176 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.626057 19415 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.515929 19310 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.639348 18008 raft_consensus.cc:2393] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 3: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:15.539019 17362 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
W20260709 12:10:15.561813 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.691373 19255 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.636404 17432 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:15.650715 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.729828 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.730391 17255 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:15.655361 17980 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:15.731762 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 76466.8us
I20260709 12:10:15.732583 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:15.699316 19213 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:15.660430 17440 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:15.742178 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.743026 17440 raft_consensus.cc:2368] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3.
I20260709 12:10:15.674219 17438 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:15.685520 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.666031 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.690089 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.744634 18014 raft_consensus.cc:2393] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:15.595373 19356 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:15.703375 17363 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:15.747788 17288 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:15.705993 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:15.750118 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 44233.3us
I20260709 12:10:15.673738 19394 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.651722 19152 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.677598 18007 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.652508 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:15.718567 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.756212 17366 raft_consensus.cc:2410] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:10:15.650082 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.723902 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.725050 17365 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
W20260709 12:10:15.726223 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.653324 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:15.733907 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.758862 17360 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.733896 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:15.738682 17407 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:15.691552 18010 raft_consensus.cc:2376] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5. Re-sending same reply.
I20260709 12:10:15.759411 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.719955 19267 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.773747 18014 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.774467 18015 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:15.784422 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.794082 17438 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.751724 19228 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.752044 19420 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:15.804056 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 65485.9us
I20260709 12:10:15.773428 19346 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:15.808727 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 142760us
I20260709 12:10:15.784686 19416 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.751935 19322 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.803635 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.814985 17366 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.800930 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.787686 19356 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.714772 19400 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.785336 18011 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.786540 19053 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.817529 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.809604 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.785166 19401 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.793478 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:15.795997 19176 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.828902 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.846005 17365 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.804417 19420 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.829739 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.848412 17362 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:15.813944 19266 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.817479 19322 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.776062 19394 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:15.853744 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.854799 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.796901 19267 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.825336 19253 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.876444 18015 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:15.878738 17255 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:15.826166 19346 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:15.843425 19313 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.852662 19420 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.835110 19416 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:15.898469 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:15.899394 17363 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.899974 19310 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.899227 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.894928 18008 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:15.902520 17358 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:15.905328 17364 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:15.906396 18009 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:15.907168 19394 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.907323 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:15.908517 17404 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.909243 19187 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:15.894889 19346 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.876341 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.888761 19313 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.910092 19411 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.910638 17362 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:15.910740 19411 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:15.911587 19267 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:15.911775 19313 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.896309 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:15.900434 19310 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.873315 19213 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.912875 19310 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.913067 17434 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:15.912586 19187 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:15.914723 18012 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:15.899307 19416 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.911618 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.917675 17362 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:15.876127 19053 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:15.918654 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.919271 17362 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:15.921365 17366 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:15.855757 19322 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.927824 17359 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:15.931111 17363 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:15.932392 17365 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:15.933862 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.938360 17367 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:15.936244 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:15.878648 19393 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.949086 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:15.950273 19328 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:15.951021 19053 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.950927 19328 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.951622 19053 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.952325 19053 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:15.953153 19328 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.953392 19248 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.953715 19336 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:15.911772 19411 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.959537 19400 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:15.924296 19339 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:15.955152 19393 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.961038 19393 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.962568 19422 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.883702 19253 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.965436 19253 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.983317 17360 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
W20260709 12:10:15.966637 19432 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:10:15.966858 19266 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.968261 18910 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.914951 19187 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.970604 19415 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:15.973646 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.976879 18919 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:15.979292 17364 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.979399 18010 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.980356 17359 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:15.981204 19310 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:15.965163 19420 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.984838 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:15.953878 19053 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:15.987037 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 236119us
I20260709 12:10:15.955219 19394 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.994308 19266 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:15.939731 19144 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:15.997709 17361 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:16.234006 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:16.126411 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.306313 17441 consensus_meta.cc:287] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.000s
W20260709 12:10:16.465648 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 731773us
W20260709 12:10:16.465456 18013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.007s	sys 0.015s
W20260709 12:10:16.474360 18013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.015s
I20260709 12:10:16.474510 17360 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
W20260709 12:10:16.270241 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.105909 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.476888 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.478543 19397 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.210084 19313 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:16.479116 19397 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:16.138231 19339 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:16.480413 19339 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:16.475696 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.155577 19253 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.481227 19397 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:16.408766 19378 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.001s
W20260709 12:10:16.434353 17333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.016s
W20260709 12:10:16.473381 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.472136 17441 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
W20260709 12:10:16.344841 18007 consensus_meta.cc:287] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.001s
W20260709 12:10:16.455811 17330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.012s	sys 0.016s
W20260709 12:10:16.514853 17330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.012s	sys 0.016s
I20260709 12:10:16.516922 18012 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:16.519239 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:16.519922 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1350) took 1171 ms. Trace:
W20260709 12:10:16.483417 19346 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.016s
I20260709 12:10:16.476238 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:16.488417 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.484277 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1338) took 1336 ms. Trace:
W20260709 12:10:16.510980 17333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.012s	sys 0.019s
W20260709 12:10:16.499496 19364 consensus_meta.cc:287] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.882s	user 0.011s	sys 0.000s
I20260709 12:10:15.997166 19248 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:16.346808 19438 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
I20260709 12:10:16.461236 17358 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:16.075026 19418 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:16.486541 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 252622us
W20260709 12:10:16.526480 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 50335.3us
I20260709 12:10:16.081418 19336 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:16.520001 17359 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:16.523139 17441 rpcz_store.cc:276] 0709 12:10:15.339232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.453530 (+114298us) service_pool.cc:224] Handling call
0709 12:10:16.510593 (+1057063us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.495802 17407 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:16.524282 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 625104us
W20260709 12:10:16.523185 19416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.008s	sys 0.020s
W20260709 12:10:16.511459 19393 consensus_meta.cc:287] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.550s	user 0.000s	sys 0.011s
I20260709 12:10:16.049386 19176 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.522240 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:16.484112 19255 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:16.084558 19409 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:10:16.067870 19392 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:16.510317 19391 raft_consensus.cc:2764] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:10:16.511135 19384 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.004s
I20260709 12:10:16.483114 19266 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:16.522209 17258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.011s
W20260709 12:10:16.557654 17258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.005s	sys 0.011s
I20260709 12:10:16.535136 19397 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:16.524133 19346 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.007s	sys 0.020s
I20260709 12:10:16.286350 18947 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:16.510746 19237 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:16.483278 19394 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:16.360119 19401 consensus_meta.cc:287] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.002s
W20260709 12:10:16.521903 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.567394 17255 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:16.568261 17255 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:16.532780 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:16.519974 18919 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.563151 19384 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.574370 19442 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:16.575016 18014 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:16.576304 18006 consensus_meta.cc:287] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.508s	user 0.003s	sys 0.006s
I20260709 12:10:16.576728 18006 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:16.576838 18919 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:16.523599 17439 rpcz_store.cc:276] 0709 12:10:15.129055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.197746 (+ 68691us) service_pool.cc:224] Handling call
0709 12:10:15.206781 (+  9035us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:15.271791 (+ 65010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.271827 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:15.304113 (+ 32286us) log.cc:844] Serialized 532 byte log entry
0709 12:10:15.674192 (+370079us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.674237 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.674311 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.238692 (+564381us) raft_consensus.cc:1685] finished
0709 12:10:16.238714 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.465591 (+226877us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12021,"raft.queue_time_us":12137,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3443,"thread_start_us":264301,"threads_started":1,"wal-append.queue_time_us":454088}
I20260709 12:10:16.530333 17980 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:16.514050 19310 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:16.543493 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.545372 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:16.528893 19292 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.546267 19336 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:16.523030 18007 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:16.534189 19416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.008s	sys 0.020s
I20260709 12:10:16.514820 19241 consensus_queue.cc:1059] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:16.552191 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:16.528921 19152 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.529066 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:16.527184 19053 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:16.553622 17362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.017s
I20260709 12:10:16.580816 19237 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:16.594007 17362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.010s	sys 0.018s
I20260709 12:10:16.515292 19378 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:16.514539 19253 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:16.534576 19187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.011s	sys 0.021s
W20260709 12:10:16.558280 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 609220us
I20260709 12:10:16.528426 17404 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:16.560020 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.560034 17981 leader_election.cc:400] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3.
I20260709 12:10:16.541357 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:16.535778 19420 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:16.541929 19395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.019s
I20260709 12:10:16.551151 19404 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:16.549434 19176 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:16.569085 18015 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.569818 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1383) took 1186 ms. Trace:
W20260709 12:10:16.579998 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49735.1us
I20260709 12:10:16.607292 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:16.599197 19187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.012s	sys 0.021s
I20260709 12:10:16.525466 19400 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:16.576572 19401 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:16.547780 19393 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:16.566877 19394 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.555573 19248 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:16.555347 19299 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:16.582475 19346 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:16.599176 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 70831us
I20260709 12:10:16.599351 17981 leader_election.cc:403] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:16.566699 18947 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:16.641286 18947 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:16.561539 19397 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.645530 19397 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:16.608174 19395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.004s	sys 0.019s
I20260709 12:10:16.588613 19292 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:16.648631 19292 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:16.649183 19292 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:16.649610 19292 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:16.597508 18009 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:16.620173 18015 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:16.602294 19266 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.651120 19266 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:16.652032 19266 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:16.632586 19322 consensus_meta.cc:287] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.002s
I20260709 12:10:16.614993 18008 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:16.634079 19336 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:16.656242 19336 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.656340 19384 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.657686 19313 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:16.659756 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 567) took 1067 ms. Trace:
I20260709 12:10:16.660282 18012 rpcz_store.cc:276] 0709 12:10:15.592727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.916498 (+323771us) service_pool.cc:224] Handling call
0709 12:10:15.916825 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.517398 (+600573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.659438 (+142040us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400101dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:16.659681 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379489024}
I20260709 12:10:16.661142 19378 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:16.662293 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:16.663528 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 303) took 1171 ms. Trace:
W20260709 12:10:16.663883 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 118328us
I20260709 12:10:16.634874 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 545) took 1041 ms. Trace:
I20260709 12:10:16.635720 19176 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:16.628247 19310 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.655196 19322 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:16.626595 19420 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.598210 19053 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:16.663929 17362 rpcz_store.cc:276] 0709 12:10:15.492173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.939428 (+447255us) service_pool.cc:224] Handling call
0709 12:10:15.970541 (+ 31113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.970894 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.970921 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.971410 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.594478 (+623068us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:16.609230 (+ 14752us) log.cc:844] Serialized 14 byte log entry
0709 12:10:16.609463 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.609542 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.663304 (+ 53762us) raft_consensus.cc:1685] finished
0709 12:10:16.663326 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.663467 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40550,"prepare.queue_time_us":13013,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":3464,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":3984,"thread_start_us":622674,"threads_started":1,"wal-append.queue_time_us":654494}
W20260709 12:10:16.668952 19411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.009s	sys 0.005s
I20260709 12:10:16.622022 19454 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.703584 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:16.664956 19339 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:16.659879 19253 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:16.730357 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2188) took 1278 ms. Trace:
I20260709 12:10:16.705379 17407 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:16.669430 19378 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3.
I20260709 12:10:16.732785 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1420) took 1120 ms. Trace:
I20260709 12:10:16.672418 19310 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.759323 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:16.621073 19401 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:16.733748 17441 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.618553 19400 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:16.768889 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 63631.1us
I20260709 12:10:16.781348 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:16.784811 17287 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:16.778687 19310 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.788295 19393 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:16.758610 19267 raft_consensus.cc:3055] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.768316 17361 rpcz_store.cc:276] 0709 12:10:15.417285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.417411 (+   126us) service_pool.cc:224] Handling call
0709 12:10:16.695839 (+1278428us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400083754. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:16.696016 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994857856}
I20260709 12:10:16.767009 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:16.758185 18008 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:16.709326 19411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.010s	sys 0.005s
W20260709 12:10:16.772449 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 204244us
I20260709 12:10:16.791033 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:16.735035 17360 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:16.789840 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:16.758275 18006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 571) took 1590 ms (client timeout 1726 ms). Trace:
I20260709 12:10:16.766912 19460 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.816869 17255 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:16.892047 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 66862.1us
I20260709 12:10:16.820060 17290 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:16.910218 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 93455.3us
I20260709 12:10:16.701440 19420 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:16.666569 18007 rpcz_store.cc:276] 0709 12:10:15.593362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.636067 (+ 42705us) service_pool.cc:224] Handling call
0709 12:10:16.634610 (+998543us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54003ccb54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:16.634800 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39019264}
I20260709 12:10:16.817772 17285 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:16.733330 19418 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:10:16.758975 19394 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:16.693552 19237 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:16.773898 19253 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:16.903527 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:16.819761 18006 rpcz_store.cc:269] 0709 12:10:15.167396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.168512 (+  1116us) service_pool.cc:224] Handling call
0709 12:10:16.758016 (+1589504us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b540067ff54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:16.758190 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861132032}
I20260709 12:10:16.898561 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:16.792222 19395 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:16.609572 17436 rpcz_store.cc:276] 0709 12:10:15.383381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.575776 (+192395us) service_pool.cc:224] Handling call
0709 12:10:15.576185 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.576605 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.576637 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.577128 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.751712 (+174584us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.760234 (+  8522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.783645 (+ 23411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.569559 (+785914us) raft_consensus.cc:1685] finished
0709 12:10:16.569581 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.569737 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1495,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":149189,"threads_started":1,"wal-append.queue_time_us":406094}
I20260709 12:10:17.086540 17439 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:17.105109 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:16.798936 19267 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:17.093683 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:16.862762 19393 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:16.971400 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 60447.5us
I20260709 12:10:17.091610 17287 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
W20260709 12:10:17.080436 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.044350 19457 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
W20260709 12:10:17.046645 19449 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.377s	user 0.000s	sys 0.000s
W20260709 12:10:17.043722 19461 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.313s	user 0.000s	sys 0.000s
W20260709 12:10:17.052016 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 422174us
I20260709 12:10:17.103253 18012 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:16.904079 19152 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:17.118785 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.113106 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:16.891968 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 312) took 1203 ms. Trace:
I20260709 12:10:16.899896 19447 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.757503 19454 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.042711 19248 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.042925 19299 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.124297 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:16.898777 19443 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:17.121750 19450 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:17.126335 18009 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:16.986404 19463 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:17.041496 19322 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.045989 19400 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:16.935400 18919 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:17.126865 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.126617 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:17.276365 17285 raft_consensus.cc:2393] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:17.041345 19460 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:17.277159 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:16.902787 19384 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.223s
I20260709 12:10:17.277848 18007 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:17.278410 19384 consensus_queue.cc:1243] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer e860f7e876b74ec589f447737822a4f6 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:17.278857 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:17.279196 19463 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.277915 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 591) took 1839 ms. Trace:
I20260709 12:10:16.986905 19176 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:17.282083 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 157961us
I20260709 12:10:17.246132 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.284966 17284 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:17.285351 17404 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:17.138965 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.111733 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 308) took 1696 ms. Trace:
W20260709 12:10:17.225936 17283 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.010s	sys 0.015s
I20260709 12:10:17.285036 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:17.280872 18014 rpcz_store.cc:276] 0709 12:10:15.438663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.814825 (+376162us) service_pool.cc:224] Handling call
0709 12:10:15.815136 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.575410 (+760274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.277683 (+702273us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b540045fbd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:17.277857 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1747099904}
W20260709 12:10:17.287213 17283 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.010s	sys 0.019s
I20260709 12:10:17.289337 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:17.290676 18014 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:17.287608 18012 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:17.292378 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 274840us
I20260709 12:10:17.180434 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:17.295369 17360 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.106005 19395 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.253841 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:17.286764 17433 rpcz_store.cc:276] 0709 12:10:15.415606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.590779 (+175173us) service_pool.cc:224] Handling call
0709 12:10:15.688127 (+ 97348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.688351 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:16.636801 (+948450us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b18002cefc0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12256c34bc 00007f1222a1148b 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2b455 00007f12295133c7 00007f1225b259a7 00007f1225b350bf
0709 12:10:16.636932 (+   131us) log.cc:844] Serialized 14 byte log entry
0709 12:10:17.111271 (+474339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:17.111428 (+   157us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:17.111482 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.111549 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.111671 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12164,"prepare.queue_time_us":395643,"prepare.run_wall_time_us":14846,"raft.queue_time_us":478,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":21795,"spinlock_wait_cycles":231323520,"thread_start_us":841485,"threads_started":2,"wal-append.queue_time_us":556691}
I20260709 12:10:16.953063 19292 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.302011 17333 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:17.298619 17441 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 2: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:17.108180 19253 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:17.317137 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:17.113575 19187 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.319370 17292 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
W20260709 12:10:17.283058 19266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.006s	sys 0.015s
I20260709 12:10:17.320293 17360 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:17.247536 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:17.240046 19328 raft_consensus.cc:3055] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:17.192768 19453 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.387s	user 0.000s	sys 0.000s
I20260709 12:10:17.240278 19416 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.274821 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 582) took 1865 ms. Trace:
I20260709 12:10:17.336335 18010 rpcz_store.cc:276] 0709 12:10:15.409385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.801621 (+392236us) service_pool.cc:224] Handling call
0709 12:10:15.979221 (+177600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.470290 (+491069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.274407 (+804117us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540023da50. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:17.274691 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302784384}
I20260709 12:10:17.337474 19454 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:17.338234 19420 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.338812 19420 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:17.195552 19310 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.322258 19053 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.332530 19328 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:17.299782 19450 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.340319 19328 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.332086 17361 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 2: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:17.304809 18007 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:17.346205 18006 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:17.347635 18006 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.292721 17435 rpcz_store.cc:276] 0709 12:10:15.688785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.691429 (+  2644us) service_pool.cc:224] Handling call
0709 12:10:15.715913 (+ 24484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.740346 (+ 24433us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:16.215784 (+475438us) log.cc:844] Serialized 14 byte log entry
0709 12:10:16.808392 (+592608us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:16.819636 (+ 11244us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:16.862502 (+ 42866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.891699 (+ 29197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.891887 (+   188us) inbound_call.cc:177] Queueing success response
0709 12:10:16.901658 (+  9771us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18002cf500. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e3f3 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
Metrics: {"mutex_wait_us":1256,"prepare.queue_time_us":817490,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":34701,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":6675,"spinlock_wait_cycles":4673408,"thread_start_us":962103,"threads_started":3,"wal-append.queue_time_us":407746}
I20260709 12:10:17.294226 19152 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:17.355741 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.319098 19176 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:17.297783 19466 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:17.365597 19466 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:17.349140 19450 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.366830 19450 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.366624 19466 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.367508 19450 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.367851 19053 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:17.368391 19053 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.302955 19400 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:17.338389 19253 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.178151 19393 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.359474 19152 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.361006 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.362493 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:17.306211 19395 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:17.283388 19447 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:17.333905 19266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.006s	sys 0.016s
I20260709 12:10:17.399219 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:17.357378 19416 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:17.400379 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.299175 19299 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.403713 17287 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:17.405500 17285 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.297849 19248 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.306607 19443 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.413350 17284 raft_consensus.cc:2368] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3.
I20260709 12:10:17.412890 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:17.339296 19420 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.414513 17290 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:17.413910 17286 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:10:17.395027 19460 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:17.402882 19450 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.327229 19187 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.321437 19267 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.448176 19481 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.449093 19481 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:17.409889 19328 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.402887 19463 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.413213 19401 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:17.458526 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 174097us
I20260709 12:10:17.446086 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 538) took 2108 ms. Trace:
W20260709 12:10:17.454304 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 122463us
W20260709 12:10:17.461980 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 144935us
W20260709 12:10:17.460553 17258 connection.cc:256] RPC call timeout handler was delayed by -1.813158784000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 12:10:17.472067 17258 connection.cc:256] RPC call timeout handler was delayed by -1.7969587840000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 12:10:17.472440 17258 connection.cc:256] RPC call timeout handler was delayed by -1.7753587839999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:10:17.473688 17439 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:17.457772 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:17.455130 19450 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.457042 19480 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.771042 17367 rpcz_store.cc:276] 0709 12:10:15.612241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.956047 (+343806us) service_pool.cc:224] Handling call
0709 12:10:15.956381 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.956603 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:16.554829 (+598226us) log.cc:844] Serialized 14 byte log entry
0709 12:10:16.732282 (+177453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:16.732337 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:16.732536 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.732600 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.732729 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28904,"prepare.queue_time_us":85247,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4040,"raft.queue_time_us":109,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8334,"spinlock_wait_cycles":1470208,"thread_start_us":664562,"threads_started":2}
I20260709 12:10:17.461174 19267 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.456264 19394 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:17.461484 19053 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.461462 18013 rpcz_store.cc:276] 0709 12:10:15.338229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.775638 (+437409us) service_pool.cc:224] Handling call
0709 12:10:15.797361 (+ 21723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.821091 (+ 23730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.821129 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.845145 (+ 24016us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.474756 (+629611us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:16.474796 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.474863 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:17.445820 (+970957us) raft_consensus.cc:1685] finished
0709 12:10:17.445841 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.446002 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12825,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":6990,"thread_start_us":578708,"threads_started":1,"wal-append.queue_time_us":728876}
W20260709 12:10:17.485360 17258 connection.cc:256] RPC call timeout handler was delayed by -1.6250587839999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260709 12:10:17.496199 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:17.492399 19450 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.464749 19463 consensus_queue.cc:1059] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:10:17.506718 17258 connection.cc:256] RPC call timeout handler was delayed by -1.6187587839999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 12:10:17.497260 19481 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:17.516335 19378 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:17.529458 19378 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.531847 19378 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.509083 19469 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.532642 19469 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.534255 19479 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:17.535172 19469 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:17.536619 19462 log.cc:927] Time spent T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.434s	user 0.001s	sys 0.001s
I20260709 12:10:17.516552 19478 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:17.537703 19478 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.538412 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:17.538676 19397 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.893s	user 0.005s	sys 0.006s
I20260709 12:10:17.539130 19397 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.540047 19478 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:17.541280 19397 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:17.541826 18011 consensus_meta.cc:287] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.668s	user 0.007s	sys 0.005s
I20260709 12:10:17.543602 18013 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.493772 19418 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.542272 18011 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
W20260709 12:10:17.542383 17188 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55944 (request call id 309) took 12251 ms (client timeout 15000 ms). Trace:
I20260709 12:10:17.496903 18006 raft_consensus.cc:2376] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3. Re-sending same reply.
W20260709 12:10:17.560362 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 95960.7us
I20260709 12:10:17.561758 17333 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:17.564188 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 151367us
I20260709 12:10:17.522363 19450 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.468945 19447 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.567939 19310 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.502542 19416 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.559028 19479 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.576471 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:17.541996 19420 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:17.540197 19463 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.567718 19481 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:17.574853 18011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 543) took 2234 ms (client timeout 2616 ms). Trace:
W20260709 12:10:17.579746 18011 rpcz_store.cc:269] 0709 12:10:15.340211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.652223 (+312012us) service_pool.cc:224] Handling call
0709 12:10:17.574764 (+1922541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.580804 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:17.582291 19491 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:17.582921 19491 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.583841 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:17.582455 18008 consensus_meta.cc:287] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.002s
W20260709 12:10:17.572026 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 104698us
I20260709 12:10:17.599085 17285 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:17.602897 17255 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:17.484412 19176 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.581995 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:17.545851 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.606994 18011 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.541311 19443 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:17.607730 19418 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.577776 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:17.585129 19491 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.614511 17255 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:17.620208 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:17.577783 19463 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:17.634339 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.644125 18008 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:17.606931 19310 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:17.660219 18013 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:17.660492 19494 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.672338 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:17.677493 19494 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.673202 19418 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:17.678779 17434 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.656358 19248 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:17.669719 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.679499 19463 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.638680 19393 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:17.560248 17188 rpcz_store.cc:269] 0709 12:10:05.291468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.294225 (+  2757us) service_pool.cc:224] Handling call
0709 12:10:17.542314 (+12248089us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:14.660011 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:14.660895 (+   884us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:14.660960 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:10:14.660981 (+    21us) tablet.cc:662] Decoding operations
0709 12:10:14.661469 (+   488us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:14.661797 (+   328us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:14.661852 (+    55us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:14.662385 (+   533us) tablet.cc:701] Row locks acquired
0709 12:10:14.662442 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:10:14.662687 (+   245us) write_op.cc:270] Start()
0709 12:10:14.662858 (+   171us) write_op.cc:276] Timestamp: P: 1783599014662591 usec, L: 0
0709 12:10:14.662884 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:10:14.663691 (+   807us) log.cc:844] Serialized 541 byte log entry
0709 12:10:15.373580 (+709889us) op_driver.cc:464] REPLICATION: finished
0709 12:10:15.792060 (+418480us) write_op.cc:301] APPLY: starting
0709 12:10:15.792175 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:15.813323 (+ 21148us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:15.820185 (+  6862us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:15.825920 (+  5735us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:15.891622 (+ 65702us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:15.891673 (+    51us) write_op.cc:312] APPLY: finished
0709 12:10:15.940224 (+ 48551us) log.cc:844] Serialized 23 byte log entry
0709 12:10:15.992283 (+ 52059us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:16.019032 (+ 26749us) write_op.cc:454] Released schema lock
0709 12:10:16.043382 (+ 24350us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:16.520921 (+477539us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:16.525847 (+  4926us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194335,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":418177,"apply.run_cpu_time_us":26848,"apply.run_wall_time_us":719891,"num_ops":1,"prepare.queue_time_us":135242,"prepare.run_cpu_time_us":22168,"prepare.run_wall_time_us":136425,"raft.queue_time_us":197480,"raft.run_cpu_time_us":77949,"raft.run_wall_time_us":189888,"replication_time_us":710511,"thread_start_us":487382,"threads_started":4,"wal-append.queue_time_us":268567,"wal-append.run_cpu_time_us":45769,"wal-append.run_wall_time_us":2632003}]]}
W20260709 12:10:17.655900 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 90876.1us
W20260709 12:10:17.676905 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 62502.2us
I20260709 12:10:17.671998 17980 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:17.503753 19480 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:17.652796 19484 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.704875 19299 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.702236 19482 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.673177 19481 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.677198 19187 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:17.709372 19491 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:17.805737 19491 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.806738 17283 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:17.700309 18007 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:17.808287 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:17.808862 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 136942us
I20260709 12:10:17.673251 19447 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.803112 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.809072 17287 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:17.710248 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.681670 19310 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.670449 19400 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.813299 17285 raft_consensus.cc:2368] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3.
I20260709 12:10:17.813944 19310 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:17.670388 19485 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:17.818464 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.702510 19346 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.820300 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.819643 17332 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:17.806761 19480 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.822834 17284 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:17.825587 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:17.815404 19484 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.828064 17434 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:17.828449 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:17.815178 19442 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.834651 17980 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:17.835952 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.836463 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.836822 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.837152 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.813557 19400 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.838792 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:17.815449 19495 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.772042 19248 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.837985 19481 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:17.840471 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:17.842021 17361 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.840480 17980 leader_election.cc:400] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3.
I20260709 12:10:17.842828 17980 leader_election.cc:403] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:17.842284 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:17.820267 19482 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:17.847324 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:17.845935 17980 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:17.848431 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:17.836285 19491 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:17.859669 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 297999us
I20260709 12:10:17.873553 17367 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
W20260709 12:10:17.849222 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.873797 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:17.878718 17360 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:17.878789 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:17.879257 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:17.873304 18015 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:17.879937 17363 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:17.879688 17367 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.880491 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 549) took 1358 ms. Trace:
I20260709 12:10:17.772114 19418 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:17.879699 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:17.839236 19486 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.882114 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:17.875597 17365 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:17.840500 19492 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.899222 19492 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.901580 19492 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:17.883263 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:17.848024 19480 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:17.840583 19454 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.885229 17362 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:17.908036 19466 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.908514 19466 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:17.908849 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 623526us
I20260709 12:10:17.908921 19466 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.910466 19470 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.834658 19346 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.903510 17255 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:17.846735 19248 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.872473 19420 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3.
I20260709 12:10:17.885908 19469 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.906345 19501 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.848445 19481 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.907720 19480 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.876945 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 310) took 1261 ms. Trace:
I20260709 12:10:17.880853 18015 rpcz_store.cc:276] 0709 12:10:16.521643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.650573 (+128930us) service_pool.cc:224] Handling call
0709 12:10:17.872826 (+1222253us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6f8c 00007f12229f6ef6 000000000036eb39 00007f122aa6a1e0 00007f122ab330c4 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:17.872967 (+   141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.880242 (+  7275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.880438 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11623040}
I20260709 12:10:17.846606 19463 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.885406 19176 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:17.915697 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.845340 19443 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:17.903564 17367 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:17.877624 19490 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:17.831948 19485 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.886024 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:17.939363 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 97152.2us
I20260709 12:10:17.845690 17285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a03a1e696734298850b94830af8a727"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:17.941442 17285 raft_consensus.cc:606] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:17.942046 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:17.942770 17367 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:17.951851 17285 raft_consensus.cc:614] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:17.936275 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:17.935037 19491 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.934072 19469 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.959098 17258 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:17.888345 19450 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.934147 19248 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.898270 19486 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:17.874482 19495 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.936625 19053 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.003360 19053 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.003755 19053 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.006651 19391 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:18.007246 19391 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.009424 19391 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.009554 19481 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.010454 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:18.011708 19299 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.012250 19299 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.014865 19492 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.960275 19482 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.017401 19391 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:18.017971 19391 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.020344 19391 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.020941 19053 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:17.934269 19411 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:17.910894 19470 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.955718 19490 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.026366 19470 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.027902 19490 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.951977 19397 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.028729 19397 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.030931 19397 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:17.996655 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.031634 19053 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:17.961787 19469 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.993728 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:17.940042 19501 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:17.997852 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 57159.8us
I20260709 12:10:17.998245 19393 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:18.234853 19393 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.236128 19248 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.237121 19393 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:17.998965 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:17.999658 19450 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.000069 17433 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:18.000866 19395 consensus_meta.cc:287] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
I20260709 12:10:17.939610 18011 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:17.955621 19176 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:18.239418 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.239621 19176 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:17.956023 19493 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:18.001801 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.002579 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:18.002714 19418 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.002904 19495 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:18.021307 17407 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.743s (SENT) [suppressed 16 similar messages]
W20260709 12:10:17.994702 19502 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:10:18.168470 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.217283 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.238271 17434 raft_consensus.cc:2410] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:18.338238 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 426594us
W20260709 12:10:18.584358 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 563030us
W20260709 12:10:18.576808 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.583423 17361 consensus_meta.cc:287] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.006s
I20260709 12:10:18.585574 17361 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:18.583402 17438 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:18.240046 17433 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:18.586016 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:18.589182 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.313145 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.590413 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.590755 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.591394 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.582398 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 392144us
I20260709 12:10:18.595719 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.595954 17285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4466b54543584a9898797997087d10f1"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:18.596514 19397 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.597065 19397 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.598354 19484 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.596467 19395 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.599823 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 550) took 2077 ms. Trace:
I20260709 12:10:18.600831 18009 rpcz_store.cc:276] 0709 12:10:16.521887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.650573 (+128686us) service_pool.cc:224] Handling call
0709 12:10:16.673074 (+ 22501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.297669 (+624595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.599567 (+1301898us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540023e6d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:18.599754 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963503616}
I20260709 12:10:18.600023 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.602418 17362 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:18.601886 19394 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:18.603745 19394 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.600311 19397 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.603339 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:18.606658 17362 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.606735 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.607452 17438 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:18.608358 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:18.608844 19310 consensus_meta.cc:287] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.785s	user 0.006s	sys 0.000s
I20260709 12:10:18.609398 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.605846 19394 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.612534 17285 raft_consensus.cc:606] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:18.613011 17285 raft_consensus.cc:614] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:18.614264 17362 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:18.614709 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:18.443161 19503 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:10:18.618119 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.626726 17438 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:18.364705 19420 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.248723 19492 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:18.622754 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.657380 17362 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:18.658236 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:18.621829 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.542250 19463 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 12:10:18.033701 19187 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:18.243997 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.032433 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.624339 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.625350 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:18.670262 17363 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:18.500036 19443 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.499804 19499 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.992642 19486 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.153169 19053 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:18.627120 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.676018 17433 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:18.618301 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:18.007766 19346 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:18.364872 19490 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:18.635717 19180 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:18.636560 19152 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:18.627693 19416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.006s	sys 0.010s
W20260709 12:10:18.679682 19416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.006s	sys 0.010s
I20260709 12:10:18.637506 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.638397 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.638473 19469 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.631235 17437 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:18.643354 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.644063 17285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
W20260709 12:10:18.645030 19466 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.734s	user 0.006s	sys 0.001s
I20260709 12:10:18.401723 19248 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.658568 19420 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:18.651146 19447 consensus_meta.cc:287] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.828s	user 0.003s	sys 0.005s
I20260709 12:10:18.431319 19498 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:17.934798 17358 rpcz_store.cc:276] 0709 12:10:16.585136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.585742 (+   606us) service_pool.cc:224] Handling call
0709 12:10:16.607698 (+ 21956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.625586 (+ 17888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.635058 (+  9472us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:16.635648 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:10:17.125935 (+490287us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:17.508422 (+382487us) log.cc:844] Serialized 14 byte log entry
0709 12:10:17.818821 (+310399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.832686 (+ 13865us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:17.836948 (+  4262us) raft_consensus.cc:1685] finished
0709 12:10:17.836966 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.846810 (+  9844us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5092,"prepare.queue_time_us":379861,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":60,"raft.queue_time_us":191695,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":33565,"spinlock_wait_cycles":59136,"thread_start_us":957063,"threads_started":3,"wal-append.queue_time_us":638289,"wal-append.run_cpu_time_us":2743,"wal-append.run_wall_time_us":1265600}
I20260709 12:10:18.654956 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.421761 19299 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.609308 19310 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:18.493697 19470 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.617475 19493 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.676985 19499 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.605738 19395 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.656208 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:18.665644 17404 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:18.709604 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44026.3us
I20260709 12:10:18.669322 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.671185 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:18.659325 19253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.014s	sys 0.023s
I20260709 12:10:18.672220 17286 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:18.676600 17361 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.678567 19053 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.678812 19180 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.681905 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 326) took 1195 ms. Trace:
W20260709 12:10:18.683972 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 90870.5us
I20260709 12:10:18.673851 19322 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.685891 17285 raft_consensus.cc:606] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:18.715440 17285 raft_consensus.cc:614] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:18.715133 17439 rpcz_store.cc:276] 0709 12:10:17.486390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.486508 (+   118us) service_pool.cc:224] Handling call
0709 12:10:18.638262 (+1151754us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:18.681839 (+ 43577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25062144}
I20260709 12:10:18.685931 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.588304 19501 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.690546 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:18.718788 17255 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:18.668108 19492 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.672490 19187 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.658852 17362 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:18.675098 19443 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.681840 19490 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.707571 19310 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.711665 17365 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:18.714308 17434 raft_consensus.cc:2410] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:18.717239 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:18.713961 17436 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.695278 19466 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:18.721896 17441 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 319) took 1667 ms (client timeout 2170 ms). Trace:
W20260709 12:10:18.761142 17441 rpcz_store.cc:269] 0709 12:10:17.054608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.054755 (+   147us) service_pool.cc:224] Handling call
0709 12:10:18.721726 (+1666971us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400162454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:18.721835 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402261248}
I20260709 12:10:18.708030 19346 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:18.713959 19253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.014s	sys 0.023s
I20260709 12:10:18.710695 19480 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.725370 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:18.725636 17255 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:18.725560 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.726401 17404 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:18.768626 17362 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:18.769579 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.713730 19485 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.749805 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1334) took 2024 ms. Trace:
I20260709 12:10:18.750854 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.701740 19498 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.722770 19463 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.720471 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.759064 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:18.722433 19395 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.764305 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.724218 19454 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.777091 17360 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:18.775352 17285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:18.779083 17361 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:18.787961 17285 raft_consensus.cc:606] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:18.780248 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.788409 17285 raft_consensus.cc:614] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:18.783702 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:18.789386 17365 raft_consensus.cc:2410] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:18.775400 17291 rpcz_store.cc:276] 0709 12:10:16.702649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.732966 (+ 30317us) service_pool.cc:224] Handling call
0709 12:10:17.669878 (+936912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:17.680578 (+ 10700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.680613 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:17.681075 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:10:17.835064 (+153989us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:17.835119 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.835190 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:18.654197 (+819007us) raft_consensus.cc:1685] finished
0709 12:10:18.654221 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.721445 (+ 67224us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54003fa050. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:18.727405 (+  5960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10538,"raft.queue_time_us":11426,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":4893,"spinlock_wait_cycles":2048798592,"thread_start_us":153615,"threads_started":1,"wal-append.queue_time_us":231022}
I20260709 12:10:18.764072 19394 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:18.786024 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.787022 17359 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:18.787385 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 70220us
I20260709 12:10:18.790233 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:18.792228 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:18.795305 17258 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:18.795982 17362 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:10:18.779912 19393 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.797096 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:18.782253 19463 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.782114 19484 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.808882 19378 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.783154 19310 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.809631 19378 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.810360 19310 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:18.810560 19505 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:10:18.811352 19310 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.765110 19299 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:18.820756 17361 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.801333 17333 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:18.783707 19512 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.806347 19053 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.796406 19480 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.841403 18919 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.822460 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:18.789047 17364 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:18.826748 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 325) took 1348 ms. Trace:
I20260709 12:10:18.827611 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 316) took 1047 ms. Trace:
I20260709 12:10:18.795212 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.851017 17360 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:18.851115 17286 rpcz_store.cc:276] 0709 12:10:17.780147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.780348 (+   201us) service_pool.cc:224] Handling call
0709 12:10:18.820872 (+1040524us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540007c954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:18.827544 (+  6672us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976270592}
I20260709 12:10:18.831611 19176 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:18.832046 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 172534us
I20260709 12:10:18.813690 19463 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.798555 19322 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.838281 19248 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.812197 19378 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:18.826750 19482 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.806257 19469 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:18.838798 19466 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.808979 19484 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.843605 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:18.774453 19346 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.793712 19454 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:18.841866 18919 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:18.846635 19490 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.799748 19253 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.800149 19393 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:18.847612 19499 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.803869 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:18.788373 19395 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:18.848599 19470 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:18.883107 19393 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.892495 19378 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:18.869270 19420 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.829414 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:18.854790 17360 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:10:18.850406 17440 rpcz_store.cc:276] 0709 12:10:17.477905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.478161 (+   256us) service_pool.cc:224] Handling call
0709 12:10:18.826032 (+1347871us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:18.826267 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.826452 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.826476 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.826512 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:18.826538 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.826589 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.826690 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7935360}
I20260709 12:10:19.009090 17360 pending_rounds.cc:85] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 4
W20260709 12:10:18.855638 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 130053us
I20260709 12:10:18.812099 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:19.019508 17434 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.857579 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:19.021080 17284 raft_consensus.cc:606] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:19.021494 17284 raft_consensus.cc:614] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:18.857568 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 98388.3us
I20260709 12:10:18.849784 19492 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:18.855186 19418 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.864914 19237 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:18.860355 19248 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:18.877250 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:19.028743 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:19.029469 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 152271us
I20260709 12:10:18.855406 19495 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:10:18.862479 19482 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:19.013412 19322 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:18.855600 19480 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:18.883035 18919 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:18.849538 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.867936 19524 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.903827 19454 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:19.007750 17361 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:19.009397 17360 pending_rounds.cc:107] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 4.5
W20260709 12:10:19.009444 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 180116us
I20260709 12:10:19.010375 17437 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:19.010787 19443 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:19.011111 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.053848 17360 raft_consensus.cc:2889] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:18.989809 19499 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.012414 19395 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:19.012965 19486 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.013489 19400 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.014431 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:19.014858 19378 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:19.026286 17436 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:19.017578 19187 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:19.017812 19394 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.083225 19394 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.018707 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:19.086824 19523 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:19.087311 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:19.023530 17332 leader_election.cc:336] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.521s (SENT)
I20260709 12:10:19.013011 19484 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:19.030442 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:19.088073 19393 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.031829 17978 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:18.883606 17359 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:18.993485 19253 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:19.065544 19491 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.089401 19486 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:19.089797 19253 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:19.007861 17435 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:19.055053 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:19.058733 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.020840 19310 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.031038 19248 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.050514 19482 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.048188 19501 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:19.075440 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.074858 18919 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.016038 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:19.051692 19524 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:19.026654 19470 consensus_queue.cc:1059] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:19.066075 17364 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:19.093436 17360 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:19.088218 17332 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:19.031226 19237 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:19.103739 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 71998.1us
W20260709 12:10:19.104362 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 73982.7us
I20260709 12:10:19.099619 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1391) took 1098 ms. Trace:
I20260709 12:10:19.116245 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:19.116456 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 92952.5us
I20260709 12:10:19.060758 19463 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:19.110245 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:19.065918 19322 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:19.098206 19508 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.068960 19499 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:19.117267 17332 leader_election.cc:336] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.590s (SENT)
I20260709 12:10:19.118158 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:19.113790 17258 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f950276bbbb4642872e9280fad2a766. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:19.143904 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:19.145061 17978 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:19.108855 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 227300us
I20260709 12:10:19.121119 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:19.106309 19393 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:19.107246 19517 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.146284 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:19.146831 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 52813.8us
I20260709 12:10:19.148875 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.108125 19484 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.151788 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:19.115626 19498 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.099207 19479 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.112612 19524 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.114498 19346 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.144893 19508 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:19.143800 19418 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.149582 19485 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.145728 19310 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.157023 19490 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:19.160171 19501 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:19.162819 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.155103 19486 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.156958 19443 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:19.174444 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.116535 17436 rpcz_store.cc:276] 0709 12:10:17.995019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.655864 (+660845us) service_pool.cc:224] Handling call
0709 12:10:19.093287 (+437423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:19.159371 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.176604 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:19.177243 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.178434 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.179302 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:19.180302 18009 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:19.181655 19463 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.182416 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.158955 19484 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:19.159245 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.167810 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1436) took 1320 ms. Trace:
I20260709 12:10:19.175289 19494 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:19.199347 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.209812 19527 log.cc:927] Time spent T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.066s	user 0.003s	sys 0.000s
I20260709 12:10:19.178357 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:19.207487 18013 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:19.207521 18015 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:19.160588 19515 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.172065 19418 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:19.171936 19508 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.215111 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:19.200019 19525 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.160490 19529 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.216776 18014 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:19.171653 19532 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.252321 19532 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.252732 19532 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.253598 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:19.202260 19152 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.523s	user 0.016s	sys 0.004s
I20260709 12:10:19.255443 19152 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.255611 19267 raft_consensus.cc:3055] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.256011 19267 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:19.256356 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:19.256924 19267 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:19.258147 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:19.258087 19267 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.259334 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:19.181854 19394 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:19.263916 19394 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:19.217203 17366 rpcz_store.cc:276] 0709 12:10:17.847523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.847626 (+   103us) service_pool.cc:224] Handling call
0709 12:10:17.879473 (+ 31847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.913290 (+ 33817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.913310 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:17.913338 (+    28us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:17.913359 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.167581 (+1254222us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b54002922d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:19.167624 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.167748 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77367168}
I20260709 12:10:19.265100 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:19.266299 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:19.266934 17366 raft_consensus.cc:2410] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:19.267488 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:19.267884 17366 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:19.269635 17366 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:19.219834 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.219982 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:19.220422 17364 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:19.273002 17364 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:19.255968 19152 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.220919 17435 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:19.274581 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.275703 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:19.276245 17435 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.195694 19490 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.220432 19484 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.191915 19310 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.239799 19418 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.173532 19378 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:19.181880 19180 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:10:19.200620 17440 raft_consensus.cc:2410] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:10:19.232986 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.298907 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.201022 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:19.210638 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.234505 19322 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.243747 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:10:19.245702 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 217024us
I20260709 12:10:19.244946 18013 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:19.234349 19400 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.302790 19400 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.304292 19485 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.305162 19400 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.207088 19516 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:19.288434 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.306981 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.226711 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.308202 17437 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:19.309147 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.310267 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.311362 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.311995 17437 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:19.312857 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.291741 19515 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.293280 19490 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:19.294305 19176 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.314319 19515 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:19.295318 19310 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:19.314739 19515 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.296597 17363 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:19.294467 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:19.298787 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 83783.7us
I20260709 12:10:19.316697 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:19.313969 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.318287 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:19.318400 17437 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:19.234277 19486 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.319402 17981 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:19.319240 19486 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.320237 18007 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.321411 19486 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:19.322489 19176 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.323323 19176 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:19.323765 19176 raft_consensus.cc:697] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:19.324779 19176 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.296388 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2208) took 1378 ms. Trace:
I20260709 12:10:19.326951 17359 rpcz_store.cc:276] 0709 12:10:17.917663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.812379 (+894716us) service_pool.cc:224] Handling call
0709 12:10:18.853856 (+ 41477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.089148 (+235292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.296140 (+206992us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b540014afd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:19.296327 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67621120}
I20260709 12:10:19.246263 19480 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:19.250308 19529 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.329298 17258 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:19.288482 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.277864 19053 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:19.323654 17358 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.345825 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:10:19.348804 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 105127us
I20260709 12:10:19.349587 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:19.350521 17333 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:19.353796 19322 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.354362 19322 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.354866 19322 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.356436 17284 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:19.357772 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:19.359265 17978 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:19.360127 19480 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.360643 19480 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.360787 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.361050 19480 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.328164 18007 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:19.330245 19529 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:19.307081 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.378542 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.379243 17440 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:19.338485 19499 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:19.339596 19535 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:19.341176 19510 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:19.341451 19253 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:19.332780 17438 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:19.342486 17434 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:19.251497 19525 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.290328 19237 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:19.375651 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 155727us
W20260709 12:10:19.348179 19533 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:10:19.381551 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.379349 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:19.347069 19053 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:19.384255 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.428033 17359 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:19.428237 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.385100 17291 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.341089 19394 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:19.364070 19485 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.361363 19494 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.387670 19482 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.391517 19248 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:19.399596 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.398813 19416 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:19.399917 17285 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:19.393230 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:19.418284 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.424649 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.378753 19486 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.380208 19378 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.426623 18014 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:19.429556 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.425944 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:19.357949 19418 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:19.433071 17283 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:19.434152 17292 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.431689 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.434651 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 327) took 1947 ms. Trace:
I20260709 12:10:19.348630 19516 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:19.425222 19180 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.417506 19253 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.433615 19494 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.501837 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:19.444201 17289 raft_consensus.cc:2393] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:19.631762 17288 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:19.572976 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:19.584692 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:19.572469 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 52684.7us
I20260709 12:10:19.630704 17287 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:19.640332 17359 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:19.573652 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.632404 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 206520us
W20260709 12:10:19.633849 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.638317 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.433802 19485 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:19.585460 17333 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:19.645996 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 60602.1us
I20260709 12:10:19.646744 17333 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:19.439939 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.442672 17284 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:19.648128 19550 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.649026 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.648716 19550 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.650195 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:19.648694 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.641598 17291 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:19.584967 17436 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:19.500777 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.653460 17290 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:19.649636 17287 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:19.638132 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.652880 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.656461 17285 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:19.652160 18014 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:19.439904 18006 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.659834 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:19.660722 17288 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:19.661814 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:19.659304 19499 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.662902 19539 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.659783 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:19.663367 19539 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.663826 19539 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.663443 19499 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:19.664459 19499 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.584880 19544 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.665705 17284 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.578410 19176 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.631947 19180 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.635641 19378 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.654815 17333 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:19.444706 19486 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.632438 17432 rpcz_store.cc:276] 0709 12:10:17.487432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.491583 (+  4151us) service_pool.cc:224] Handling call
0709 12:10:19.030942 (+1539359us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:19.031174 (+   232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.110671 (+ 79497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.110708 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.111245 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.206063 (+ 94818us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:19.206132 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.206213 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.425140 (+218927us) raft_consensus.cc:1685] finished
0709 12:10:19.425158 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.434576 (+  9418us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3823,"raft.queue_time_us":36457,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":7712,"spinlock_wait_cycles":7046528,"thread_start_us":125274,"threads_started":2,"wal-append.queue_time_us":107130}
I20260709 12:10:19.574115 19443 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.199s
I20260709 12:10:19.645004 19494 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.729539 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:19.816219 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 161484us
I20260709 12:10:19.521324 19484 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:19.800477 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.784929 17980 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:19.439656 19532 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.728557 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.821357 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:19.444283 19416 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.830026 19484 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.830425 19491 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:19.830925 19491 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.728328 19544 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.834709 19525 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:19.836156 19544 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.837401 19493 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:19.837831 19524 consensus_meta.cc:287] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.000s
I20260709 12:10:19.846527 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:19.847579 17287 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.828176 17288 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:19.806043 19495 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.840786 19494 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.841480 17358 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
W20260709 12:10:19.825393 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.836333 19525 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.823633 17333 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:19.881840 19525 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.827329 17291 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:19.652077 19485 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.821771 19486 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.882325 19525 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.853197 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.653537 19543 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.665920 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:19.887425 17292 raft_consensus.cc:2410] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:19.822427 19529 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:19.823328 19180 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.823426 19378 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.860112 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:19.870030 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:19.870558 18014 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:19.823671 19176 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.876101 19532 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.878647 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:19.864888 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.911926 17288 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:19.890168 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.883047 19493 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.915796 19493 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.916273 19493 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.891467 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.857929 19536 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:10:19.865054 19495 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.834612 19550 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.665642 19053 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.900707 18013 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:19.903774 19529 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:19.915195 17283 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.923380 17290 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:19.919073 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.978778 17288 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:19.967114 17284 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:19.923075 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:19.920687 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 324) took 1215 ms. Trace:
I20260709 12:10:19.921331 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:19.923719 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2222) took 1900 ms. Trace:
I20260709 12:10:19.986466 17367 rpcz_store.cc:276] 0709 12:10:18.023449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.852619 (+829170us) service_pool.cc:224] Handling call
0709 12:10:18.852910 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.079932 (+227022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.079967 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.093784 (+ 13817us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.150549 (+ 56765us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:19.150589 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.923361 (+772772us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400082d54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:19.923406 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.923448 (+    42us) raft_consensus.cc:1685] finished
0709 12:10:19.923460 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.923664 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2468,"raft.queue_time_us":2066,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7207,"spinlock_wait_cycles":521157376,"thread_start_us":47202,"threads_started":1,"wal-append.queue_time_us":107363}
I20260709 12:10:19.983771 17362 rpcz_store.cc:276] 0709 12:10:18.710595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.272180 (+561585us) service_pool.cc:224] Handling call
0709 12:10:19.272457 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.297703 (+ 25246us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:19.297724 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:19.297778 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:19.297807 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.920419 (+622612us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b540018cc54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:19.920467 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.920610 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57544448}
I20260709 12:10:19.913276 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.884290 19541 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.014432 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 323) took 1317 ms. Trace:
I20260709 12:10:20.015749 17365 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:19.988869 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:20.014935 17363 rpcz_store.cc:276] 0709 12:10:18.696588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.271546 (+574958us) service_pool.cc:224] Handling call
0709 12:10:19.296371 (+ 24825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.315228 (+ 18857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.014186 (+698958us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b540014afd0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:20.014357 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56452864}
W20260709 12:10:19.918010 19322 consensus_meta.cc:287] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.563s	user 0.003s	sys 0.003s
I20260709 12:10:20.024566 17363 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:19.860980 19524 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.032045 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:19.922431 17358 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.915199 19176 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:19.902257 19482 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:19.931355 19394 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.928674 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:19.949203 19180 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.926397 19416 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:20.135979 17283 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
W20260709 12:10:20.049094 17435 consensus_meta.cc:287] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.772s	user 0.004s	sys 0.008s
I20260709 12:10:20.050140 19418 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:19.945313 19493 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:20.052989 19508 consensus_meta.cc:287] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.000s
I20260709 12:10:20.054672 18006 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:20.054481 19529 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:19.929407 19248 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:20.056880 19515 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.000s
I20260709 12:10:20.164899 19248 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.165511 19248 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.057348 19495 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:20.038807 19541 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:19.943221 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:20.060087 18008 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:20.174116 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:20.067317 19549 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.425s	user 0.002s	sys 0.001s
I20260709 12:10:20.070298 19152 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:20.071674 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:20.075207 19237 raft_consensus.cc:3055] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:20.076052 17407 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:20.086534 19491 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.092398 19516 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:20.094079 19454 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:20.100263 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:20.102072 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:20.104578 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.143033 17435 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:20.105293 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:20.183089 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 107144us
I20260709 12:10:20.186473 17407 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:20.184689 17361 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:19.936560 19253 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:20.185866 17289 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:20.170836 17186 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 5, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 5 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:20.139536 17287 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:20.141211 17363 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.144917 17359 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:20.150554 17980 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:20.194326 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 43858.7us
I20260709 12:10:20.195102 17980 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:20.196244 17980 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:20.197327 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:20.115381 19480 consensus_meta.cc:287] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.733s	user 0.009s	sys 0.001s
I20260709 12:10:20.079619 19494 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:20.164647 19515 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.059433 19524 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:20.198714 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:20.200764 19394 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:20.044238 19322 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.190599 17407 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:20.162124 17979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.000s	sys 0.013s
I20260709 12:10:20.191847 17186 catalog_manager.cc:5697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:20.223837 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:20.171291 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 552) took 3380 ms. Trace:
W20260709 12:10:20.226639 17258 connection.cc:256] RPC call timeout handler was delayed by -1.1079564450001271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:10:20.206614 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 383040us
I20260709 12:10:20.224649 19397 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.337790 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:20.338747 17361 raft_consensus.cc:2393] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:20.327081 17978 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:20.222520 19152 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:20.275403 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 44400us
I20260709 12:10:20.225844 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1360) took 1428 ms. Trace:
W20260709 12:10:20.248555 17979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.000s	sys 0.014s
I20260709 12:10:20.161702 19508 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.183284 19237 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:20.222687 19416 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.200778 19400 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:20.234184 17439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.015s	sys 0.017s
I20260709 12:10:20.182971 18011 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:20.336009 17359 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:20.379909 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.382862 17359 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:20.230633 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 412101us
I20260709 12:10:20.228834 19394 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.224997 19551 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.375151 17286 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.225242 19480 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.249372 17186 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 4, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:20.379774 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.382769 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.236080 19548 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.337877 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.395602 17287 raft_consensus.cc:2368] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4.
W20260709 12:10:20.384094 17439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.016s	sys 0.018s
I20260709 12:10:20.373251 19152 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:20.377485 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 334) took 1020 ms. Trace:
I20260709 12:10:20.364073 19536 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.387823 17360 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.398775 17366 rpcz_store.cc:276] 0709 12:10:19.356842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.364145 (+  7303us) service_pool.cc:224] Handling call
0709 12:10:19.375446 (+ 11301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.376462 (+  1016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.376490 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.376993 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.620601 (+243608us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:19.620649 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.620731 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.066651 (+445920us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:20.373639 (+306988us) raft_consensus.cc:1685] finished
0709 12:10:20.373663 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.377409 (+  3746us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":642,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3962,"spinlock_wait_cycles":4403584,"thread_start_us":202729,"threads_started":1,"wal-append.queue_time_us":261224}
W20260709 12:10:20.389245 19525 consensus_meta.cc:287] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.005s
I20260709 12:10:20.336946 19397 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:20.420174 19397 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.396703 19510 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:20.421219 19510 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.424057 19543 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:20.424515 19543 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:20.365201 19539 consensus_meta.cc:287] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 12:10:20.425236 19539 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:20.275919 18010 rpcz_store.cc:276] 0709 12:10:16.780260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.337422 (+557162us) service_pool.cc:224] Handling call
0709 12:10:17.337782 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.357245 (+2019463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.361336 (+  4091us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:19.377666 (+ 16330us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:19.381064 (+  3398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.137308 (+756244us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b540045c4d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:20.143482 (+  6174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.160736 (+ 17254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94113,"raft.queue_time_us":60112,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6388,"spinlock_wait_cycles":4461375872}
I20260709 12:10:20.375867 17435 rpcz_store.cc:276] 0709 12:10:18.797292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.275452 (+478160us) service_pool.cc:224] Handling call
0709 12:10:20.223219 (+947767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.402349 19152 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.427681 19539 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:20.427798 19510 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:20.392176 17186 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:20.377296 19532 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.428897 19532 raft_consensus.cc:697] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:10:20.380254 18007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 582) took 1206 ms (client timeout 1533 ms). Trace:
I20260709 12:10:20.429806 19532 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.365451 19517 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.404441 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:20.430311 18007 rpcz_store.cc:269] 0709 12:10:19.171546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.178047 (+  6501us) service_pool.cc:224] Handling call
0709 12:10:20.362315 (+1184268us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b5400610154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:20.378061 (+ 15746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196116736}
I20260709 12:10:20.431655 19517 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.432505 17358 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:20.431399 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2209) took 1055 ms. Trace:
I20260709 12:10:20.404907 19536 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.402335 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 587) took 1228 ms. Trace:
I20260709 12:10:20.433319 19536 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.433055 17286 rpcz_store.cc:276] 0709 12:10:19.376431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.376537 (+   106us) service_pool.cc:224] Handling call
0709 12:10:19.385618 (+  9081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.386442 (+1000824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.431173 (+ 44731us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54000b7054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:20.431343 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275266304}
I20260709 12:10:20.434441 17364 raft_consensus.cc:2393] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:20.433722 18008 rpcz_store.cc:276] 0709 12:10:19.174346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.175319 (+   973us) service_pool.cc:224] Handling call
0709 12:10:20.387606 (+1212287us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54006301d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:20.399582 (+ 11976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741861632}
I20260709 12:10:20.437981 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.438576 19248 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:20.438697 17289 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:20.439805 19491 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:20.440603 19322 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:20.434419 17186 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 4, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 4 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:20.441601 19508 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:20.389629 19394 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.442368 19482 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:20.442131 17186 catalog_manager.cc:5697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 3, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 3 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:20.420101 19525 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.413348 19480 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:20.381882 19400 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.414032 17362 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:20.415145 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 584) took 1242 ms. Trace:
I20260709 12:10:20.446245 17186 catalog_manager.cc:5697] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 4, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 4 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:20.375427 19535 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:20.417322 19253 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:20.418159 19237 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:20.418797 17434 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:20.419672 19553 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:20.418196 17980 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:20.426397 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.438226 19397 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.443212 19482 raft_consensus.cc:3055] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.397742 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:20.413013 17366 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:20.494786 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:20.395902 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 535828us
W20260709 12:10:20.379206 19540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.028s	sys 0.035s
W20260709 12:10:20.468037 17404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.000s	sys 0.030s
I20260709 12:10:20.444859 17255 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:20.501994 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:20.502558 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 57760.3us
I20260709 12:10:20.471513 19400 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.481225 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.489975 17287 raft_consensus.cc:2410] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:20.491885 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 73791.3us
W20260709 12:10:20.416107 19552 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 12:10:20.504295 17404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.030s
I20260709 12:10:20.505923 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.543176 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:20.494582 19482 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:20.543497 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.543550 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.545346 17283 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:20.547492 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:20.548521 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:20.549074 17366 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:20.505769 19540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.028s	sys 0.035s
I20260709 12:10:20.496795 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:20.607216 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:20.607079 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.613353 17366 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
W20260709 12:10:20.554343 19486 consensus_meta.cc:287] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.672s	user 0.002s	sys 0.007s
W20260709 12:10:20.560563 19485 consensus_meta.cc:287] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.661s	user 0.004s	sys 0.005s
I20260709 12:10:20.552918 19420 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.544539 19518 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:20.616150 19499 consensus_meta.cc:287] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.951s	user 0.011s	sys 0.000s
W20260709 12:10:20.671260 17441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.013s
W20260709 12:10:20.671665 17441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.011s	sys 0.013s
I20260709 12:10:20.605618 19237 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:20.680394 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:20.684828 17440 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:20.604620 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:20.470904 18006 rpcz_store.cc:276] 0709 12:10:19.172852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.173404 (+   552us) service_pool.cc:224] Handling call
0709 12:10:20.414946 (+1241542us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540058b454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:20.415073 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519300992}
W20260709 12:10:20.683086 17292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.021s
I20260709 12:10:20.563709 19493 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:20.697119 17292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.022s
I20260709 12:10:20.699723 19562 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:20.556007 19454 consensus_queue.cc:1059] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 12:10:20.557399 19516 consensus_queue.cc:1059] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 12:10:20.670049 19420 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.705971 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 593) took 1347 ms. Trace:
I20260709 12:10:20.705142 17434 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:20.701525 17435 raft_consensus.cc:2368] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7.
I20260709 12:10:20.708082 18015 rpcz_store.cc:276] 0709 12:10:19.359044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.359878 (+   834us) service_pool.cc:224] Handling call
0709 12:10:19.360241 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.425541 (+ 65300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.425574 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.426019 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.642263 (+216244us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:19.642303 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.642378 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.705311 (+1062933us) raft_consensus.cc:1685] finished
0709 12:10:20.705745 (+   434us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.705903 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22333,"raft.queue_time_us":76993,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4129,"thread_start_us":257090,"threads_started":2,"wal-append.queue_time_us":731320}
W20260709 12:10:20.709946 17367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.015s	sys 0.037s
W20260709 12:10:20.714232 17367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.015s	sys 0.037s
I20260709 12:10:20.680958 19485 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.718344 19563 ts_tablet_manager.cc:933] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
W20260709 12:10:20.711627 17290 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.013s	sys 0.067s
W20260709 12:10:20.760637 17290 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.014s	sys 0.068s
I20260709 12:10:20.702319 19518 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:20.756373 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1358) took 1959 ms. Trace:
I20260709 12:10:20.668617 19486 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:20.764318 17332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.025s	sys 0.004s
I20260709 12:10:20.767768 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:20.770851 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.711263 19420 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.771106 17366 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:20.773440 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:20.773885 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.774214 17362 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:20.772070 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:20.776214 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.776671 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:20.771518 17332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.025s	sys 0.004s
I20260709 12:10:20.771601 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:20.723845 19557 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:10:20.732052 19516 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:20.696691 19499 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:20.798044 17359 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.775743 17291 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:20.799274 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:20.723161 19322 raft_consensus.cc:3055] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.769744 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.808887 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:20.679832 19482 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:20.859972 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.856992 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:20.860769 17362 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.861580 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.773481 19555 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.773083 19493 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:20.860668 17291 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:10:20.878690 17362 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
W20260709 12:10:20.886655 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.855871 19525 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:21.015367 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 346236us
W20260709 12:10:21.013479 17332 leader_election.cc:336] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.617s (SENT)
W20260709 12:10:21.064915 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 51482.7us
W20260709 12:10:21.066557 17332 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.789s (SENT)
I20260709 12:10:21.067116 17332 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:20.914216 17363 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:21.067694 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:20.898586 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.074961 17289 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.916428 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:20.862846 19176 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.857534 19322 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:21.082300 17361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.074s
I20260709 12:10:20.813593 19516 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:20.882952 19378 consensus_meta.cc:287] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.888s	user 0.005s	sys 0.005s
I20260709 12:10:21.083323 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 333) took 1885 ms. Trace:
W20260709 12:10:20.961163 17436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.022s	sys 0.026s
I20260709 12:10:20.863968 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:20.960987 19554 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 12:10:20.875425 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:20.960582 19572 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.062109 17364 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:20.896258 17358 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.101809 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 335) took 1107 ms. Trace:
I20260709 12:10:21.099841 17439 rpcz_store.cc:276] 0709 12:10:19.198370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.648159 (+449789us) service_pool.cc:224] Handling call
0709 12:10:19.648491 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.655732 (+  7241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.655765 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.656260 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.396465 (+740205us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:20.396506 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.396601 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.083103 (+686502us) raft_consensus.cc:1685] finished
0709 12:10:21.083122 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.083264 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6807,"raft.queue_time_us":10925,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"thread_start_us":683792,"threads_started":1,"wal-append.queue_time_us":794161}
I20260709 12:10:21.118616 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.119259 17439 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.097915 17361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.013s	sys 0.077s
I20260709 12:10:21.105691 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.121853 17362 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.886153 19555 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:20.965858 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:20.898576 19562 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:20.885903 19493 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.107453 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2230) took 1516 ms. Trace:
I20260709 12:10:21.095158 19575 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:21.119957 17186 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.011s	sys 0.028s
W20260709 12:10:21.103226 17436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.022s	sys 0.034s
W20260709 12:10:21.130311 17186 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.012s	sys 0.028s
I20260709 12:10:21.124867 17292 rpcz_store.cc:276] 0709 12:10:19.994196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.994895 (+   699us) service_pool.cc:224] Handling call
0709 12:10:20.044146 (+ 49251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.044368 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:20.699237 (+654869us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.101335 (+402098us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.101393 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:21.101446 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.101519 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.101743 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1038273,"prepare.run_wall_time_us":39,"raft.queue_time_us":87,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9697,"thread_start_us":949536,"threads_started":2}
I20260709 12:10:21.146251 19053 consensus_queue.cc:1059] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:21.128995 17290 rpcz_store.cc:276] 0709 12:10:19.590852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.012188 (+421336us) service_pool.cc:224] Handling call
0709 12:10:20.058805 (+ 46617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.059018 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:20.761023 (+702005us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.107099 (+346076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.107150 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:21.107199 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.107277 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.107395 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92060,"raft.queue_time_us":407,"spinlock_wait_cycles":12045184,"thread_start_us":943650,"threads_started":2}
I20260709 12:10:21.147939 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:21.124888 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.151311 17291 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:21.152491 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:21.152284 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 348652us
I20260709 12:10:21.104827 19525 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:10:21.094444 19176 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.024511 19518 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.158674 19559 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.159845 19485 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:21.170682 19570 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:10:21.172910 19180 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:21.173686 19571 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 12:10:21.107708 19378 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.157155 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.191707 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.117134 19572 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:21.157366 19564 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
W20260709 12:10:21.173101 19567 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 12:10:21.148077 19550 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:21.201085 19550 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.203599 19550 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.179095 17439 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:21.204717 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.205432 17439 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:21.206205 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.207211 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.207947 17439 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:21.208644 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.190637 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.162446 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.162493 19551 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.163725 19053 raft_consensus.cc:3055] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.211464 19053 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:21.211941 19152 consensus_meta.cc:287] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.784s	user 0.008s	sys 0.000s
I20260709 12:10:21.212248 19053 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:21.213476 19053 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.213569 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:21.167403 19536 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.733s	user 0.003s	sys 0.006s
I20260709 12:10:21.214587 19536 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.214895 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.174252 19578 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.160243 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:21.174500 17332 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.006s (SENT)
I20260709 12:10:21.221105 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.221419 17332 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.175575 17360 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.222296 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 47834.6us
I20260709 12:10:21.220021 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.226296 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.220811 17290 raft_consensus.cc:2376] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6. Re-sending same reply.
I20260709 12:10:21.188763 19486 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.231169 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.168983 19397 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:21.233407 17439 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:21.132006 19322 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:21.180605 19556 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:21.219578 17287 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:21.160358 19562 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.239763 17291 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:21.288009 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.201123 19485 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.228626 19499 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.161388 17289 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:21.251924 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:21.291524 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 139104us
I20260709 12:10:21.136006 19516 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:21.271291 17332 leader_election.cc:336] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.046s (SENT)
I20260709 12:10:21.292587 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.241493 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.291796 17292 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:21.304431 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1418) took 1945 ms. Trace:
I20260709 12:10:21.304862 17433 rpcz_store.cc:276] 0709 12:10:19.359415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.073715 (+714300us) service_pool.cc:224] Handling call
0709 12:10:20.074065 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.074449 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.074477 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.074949 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.556726 (+481777us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:20.556770 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.556838 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.304230 (+747392us) raft_consensus.cc:1685] finished
0709 12:10:21.304250 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.304372 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8977,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":481396,"threads_started":1,"wal-append.queue_time_us":696998}
I20260709 12:10:21.212360 19152 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.217553 19529 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:21.308396 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.242983 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.316496 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2238) took 1721 ms. Trace:
W20260709 12:10:21.303120 19571 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:21.319983 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:21.318473 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 126860us
W20260709 12:10:21.346822 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.316943 17365 rpcz_store.cc:276] 0709 12:10:19.594963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.017788 (+422825us) service_pool.cc:224] Handling call
0709 12:10:20.018712 (+   924us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:20.498609 (+479897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.498639 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:20.541799 (+ 43160us) log.cc:844] Serialized 52 byte log entry
0709 12:10:20.863294 (+321495us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:21.193414 (+330120us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.314473 (+121059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.316124 (+  1651us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.316181 (+    57us) raft_consensus.cc:1685] finished
0709 12:10:21.316199 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.316354 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":449847,"raft.queue_time_us":258516,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":12083,"thread_start_us":1140027,"threads_started":4,"wal-append.queue_time_us":559859}
I20260709 12:10:21.360782 17360 raft_consensus.cc:2410] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:21.234216 19578 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:21.314510 19322 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.413476 19589 log.cc:927] Time spent T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:10:21.543565 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1452) took 1444 ms. Trace:
I20260709 12:10:21.543975 17361 rpcz_store.cc:276] 0709 12:10:20.098907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.369757 (+270850us) service_pool.cc:224] Handling call
0709 12:10:20.381952 (+ 12195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.382200 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.382226 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.388877 (+  6651us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.120400 (+731523us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:21.120441 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.120522 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.543344 (+422822us) raft_consensus.cc:1685] finished
0709 12:10:21.543364 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.543500 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":622369,"threads_started":1,"wal-append.queue_time_us":721018}
I20260709 12:10:21.547947 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.549269 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:21.414393 19580 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 12:10:21.551546 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.552927 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.554123 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.554982 17287 raft_consensus.cc:2410] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:21.556099 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1454) took 1456 ms. Trace:
I20260709 12:10:21.556484 17359 rpcz_store.cc:276] 0709 12:10:20.099390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.383850 (+284460us) service_pool.cc:224] Handling call
0709 12:10:20.390671 (+  6821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.856992 (+466321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.555877 (+698885us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54000f46d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:21.556042 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936406272}
I20260709 12:10:21.511154 19378 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.571549 19515 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:21.567188 19322 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:21.572624 19604 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:21.573019 19604 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:21.573912 19604 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:21.575201 19604 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.577229 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.354007 19529 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:21.437808 19588 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:10:21.377179 19563 tablet_copy_client.cc:323] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.65:43395
I20260709 12:10:21.588171 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2239) took 1993 ms. Trace:
I20260709 12:10:20.770361 17437 rpcz_store.cc:276] 0709 12:10:18.796807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.319289 (+522482us) service_pool.cc:224] Handling call
0709 12:10:19.319655 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.362875 (+ 43220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.380821 (+ 17946us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.444658 (+ 63837us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.029803 (+585145us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:20.498496 (+468693us) log.cc:844] Serialized 14 byte log entry
0709 12:10:20.563585 (+ 65089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.615747 (+ 52162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.710689 (+ 94942us) raft_consensus.cc:1685] finished
0709 12:10:20.711725 (+  1036us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.756276 (+ 44551us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26675,"prepare.queue_time_us":560909,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":44033,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":46024,"spinlock_wait_cycles":107558272,"thread_start_us":823030,"threads_started":2,"wal-append.queue_time_us":594421}
W20260709 12:10:21.471006 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.588573 17367 rpcz_store.cc:276] 0709 12:10:19.595236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.020405 (+425169us) service_pool.cc:224] Handling call
0709 12:10:20.020903 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.727050 (+706147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.727083 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.727583 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.013005 (+285422us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:21.013070 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.013168 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.587942 (+574774us) raft_consensus.cc:1685] finished
0709 12:10:21.587965 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.588098 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143431,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":961941,"threads_started":2,"wal-append.queue_time_us":480806}
I20260709 12:10:21.590404 19509 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:21.591061 19509 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.592275 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.592993 18007 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:21.593286 19509 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:21.593597 19541 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.593998 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.595921 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.597332 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.597467 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:21.577939 18011 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:21.598048 19569 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.573s	user 0.001s	sys 0.010s
I20260709 12:10:21.601367 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 334) took 1952 ms. Trace:
I20260709 12:10:21.601558 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1381) took 1091 ms. Trace:
I20260709 12:10:21.598201 17361 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:21.601775 17288 rpcz_store.cc:276] 0709 12:10:19.649269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.011599 (+362330us) service_pool.cc:224] Handling call
0709 12:10:20.011997 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.012244 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.012268 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.028884 (+ 16616us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.486500 (+457616us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:20.486549 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.486631 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.597503 (+1110872us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:21.601028 (+  3525us) raft_consensus.cc:1685] finished
0709 12:10:21.601051 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.601303 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15791488,"thread_start_us":457190,"threads_started":1,"wal-append.queue_time_us":836728}
I20260709 12:10:21.599577 19532 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.601461 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.604023 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.512729 18014 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.604729 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1380) took 1102 ms. Trace:
I20260709 12:10:21.605115 17437 rpcz_store.cc:276] 0709 12:10:20.502159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.601192 (+1099033us) service_pool.cc:224] Handling call
0709 12:10:21.604627 (+  3435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.605501 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.513561 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 611) took 1651 ms. Trace:
I20260709 12:10:21.512533 17433 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:21.606846 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.607295 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1375) took 1146 ms. Trace:
I20260709 12:10:21.514973 19176 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:21.607643 17433 rpcz_store.cc:276] 0709 12:10:20.461283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.306267 (+844984us) service_pool.cc:224] Handling call
0709 12:10:21.607231 (+300964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.608816 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.609011 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.609594 17433 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.315789 19561 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.519559 19559 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.610582 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.611158 18015 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.614809 17288 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.521291 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:21.615767 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 94545.4us
I20260709 12:10:21.616505 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:21.617311 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:21.512665 19420 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 12:10:21.618086 19575 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.618391 19420 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.619688 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:21.522356 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 251098us
I20260709 12:10:21.620702 18006 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:21.620630 19176 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.621613 19176 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:21.623459 17367 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:21.624161 17332 leader_election.cc:336] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.675s (SENT)
I20260709 12:10:21.625234 19176 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:21.625380 17332 leader_election.cc:336] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.533s (SENT)
I20260709 12:10:21.625497 17367 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:21.593853 19509 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.606269 18012 rpcz_store.cc:276] 0709 12:10:19.862149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.923744 (+ 61595us) service_pool.cc:224] Handling call
0709 12:10:19.924133 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.924510 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.924537 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.925093 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.470950 (+545857us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:20.487860 (+ 16910us) log.cc:844] Serialized 14 byte log entry
0709 12:10:20.492423 (+  4563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.492506 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.513320 (+1020814us) raft_consensus.cc:1685] finished
0709 12:10:21.513344 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.513504 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7732,"prepare.queue_time_us":16689,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":6827,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":9952,"thread_start_us":484110,"threads_started":1,"wal-append.queue_time_us":789010}
I20260709 12:10:21.628130 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.629137 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.629683 18012 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:21.520697 19152 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:10:21.607520 17440 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:21.511166 19562 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:21.526552 19555 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.527501 19572 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.631758 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.632550 17440 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:21.633263 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.527631 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.606202 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.635119 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.527899 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.528944 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.529981 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.530637 19599 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:21.531387 19536 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:21.635694 19516 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:21.533788 19581 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.376s	user 0.001s	sys 0.003s
I20260709 12:10:21.534085 19493 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:21.522329 19603 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:21.637710 19603 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:21.420222 18010 raft_consensus.cc:2368] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4.
W20260709 12:10:21.538579 19400 consensus_meta.cc:287] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.995s	user 0.012s	sys 0.006s
I20260709 12:10:21.638641 19603 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.639379 19400 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.640221 19603 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.641508 19400 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.642457 18008 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.642773 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.644013 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.644399 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.605887 19482 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.636463 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.645395 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.646457 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.646997 17290 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.636111 17291 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:21.649281 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.638334 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1351) took 1300 ms. Trace:
I20260709 12:10:21.650718 19535 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.651332 19535 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:21.653549 19535 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:21.538623 19394 consensus_meta.cc:287] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.060s	user 0.008s	sys 0.004s
I20260709 12:10:21.539191 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1359) took 2742 ms. Trace:
I20260709 12:10:21.594410 19517 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:21.604151 19532 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:21.636431 19599 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:21.654228 17441 rpcz_store.cc:276] 0709 12:10:18.797029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.639479 (+842450us) service_pool.cc:224] Handling call
0709 12:10:19.639799 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.640949 (+  1150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.640977 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.644165 (+  3188us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.097164 (+452999us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b1800350920. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:10:20.672026 (+574862us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:20.701973 (+ 29947us) log.cc:844] Serialized 14 byte log entry
0709 12:10:20.812470 (+110497us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b1800350920. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f1222a30a40 00007f1222a2b4e4 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:10:20.855769 (+ 43299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.855841 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.538916 (+683075us) raft_consensus.cc:1685] finished
0709 12:10:21.538943 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.539113 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150359,"prepare.queue_time_us":31218,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":158038,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":18198,"spinlock_wait_cycles":18936448,"thread_start_us":574656,"threads_started":1,"wal-append.queue_time_us":1065470}
I20260709 12:10:21.655747 19532 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.657094 17441 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:21.620674 19420 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.657457 19508 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:21.658298 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1374) took 1197 ms. Trace:
I20260709 12:10:21.658383 19508 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.658881 19508 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:21.658690 17441 rpcz_store.cc:276] 0709 12:10:20.461050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.656442 (+1195392us) service_pool.cc:224] Handling call
0709 12:10:21.656766 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.658009 (+  1243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.658241 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.659998 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.660213 17441 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:21.659873 19508 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.649876 17291 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:21.661597 19599 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.601962 17439 rpcz_store.cc:276] 0709 12:10:20.510537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.208421 (+697884us) service_pool.cc:224] Handling call
0709 12:10:21.601372 (+392951us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b5400161054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:21.601502 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54589312}
I20260709 12:10:21.636873 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.662910 17289 raft_consensus.cc:2393] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:21.663731 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.664390 17289 raft_consensus.cc:2393] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:21.664774 19508 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.665138 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.657037 19532 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.666831 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1373) took 1206 ms. Trace:
I20260709 12:10:21.654820 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.668660 19394 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.668982 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.669638 18009 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:21.669834 17438 raft_consensus.cc:2393] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:21.670871 19394 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:21.671911 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 339) took 1286 ms. Trace:
I20260709 12:10:21.635696 17286 raft_consensus.cc:2376] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3. Re-sending same reply.
I20260709 12:10:21.673285 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.533116 19578 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:21.674412 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.675529 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.660609 18013 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEARNER]: Advancing to term 8
I20260709 12:10:21.627414 19509 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.661551 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.621138 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.678553 17291 raft_consensus.cc:2376] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3. Re-sending same reply.
I20260709 12:10:21.678855 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1376) took 1191 ms. Trace:
I20260709 12:10:21.679237 17435 rpcz_store.cc:276] 0709 12:10:20.487517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.620852 (+1133335us) service_pool.cc:224] Handling call
0709 12:10:21.678790 (+ 57938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.645161 18008 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 3: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:21.680755 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.681615 17435 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.683339 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 336) took 2484 ms. Trace:
I20260709 12:10:21.684836 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.650300 17284 rpcz_store.cc:276] 0709 12:10:20.338144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.368792 (+ 30648us) service_pool.cc:224] Handling call
0709 12:10:20.369156 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.385268 (+ 16112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.385300 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.389115 (+  3815us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.857000 (+467885us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:20.857045 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.857106 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.638127 (+781021us) raft_consensus.cc:1685] finished
0709 12:10:21.638148 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.638272 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8754,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9248,"thread_start_us":379410,"threads_started":1,"wal-append.queue_time_us":709342}
I20260709 12:10:21.688578 19509 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:21.689374 18012 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:21.526297 19237 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.002s
I20260709 12:10:21.691425 19602 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.691854 17286 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:21.692222 18012 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:21.598706 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.719048 18007 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:21.724476 17332 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.724761 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:21.726320 19599 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.726841 19599 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:21.727203 19599 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.728873 19602 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.729328 19602 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.729669 19602 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.736524 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:21.725627 19053 consensus_queue.cc:1059] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:10:21.737910 19454 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.692703 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.738368 19454 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:21.738854 17286 raft_consensus.cc:2376] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5. Re-sending same reply.
W20260709 12:10:21.739215 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.739892 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.739240 19454 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.740586 17286 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:21.741185 19454 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.741688 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.667258 17434 rpcz_store.cc:276] 0709 12:10:20.460815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.646295 (+1185480us) service_pool.cc:224] Handling call
0709 12:10:21.646591 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.666347 (+ 19756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.666493 (+   146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.666540 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:21.666582 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.666646 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.666774 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19344,"raft.queue_time_us":19468,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113}
W20260709 12:10:21.657317 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 579857us
I20260709 12:10:21.774771 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.775422 17404 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:21.660571 17441 pending_rounds.cc:85] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 2
I20260709 12:10:21.776093 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.776497 17441 pending_rounds.cc:107] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:21.776819 17441 raft_consensus.cc:2889] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:21.777534 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1382) took 1224 ms. Trace:
I20260709 12:10:21.779098 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:21.694092 18008 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:21.779098 17286 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:21.523660 19543 consensus_meta.cc:287] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.099s	user 0.007s	sys 0.005s
I20260709 12:10:21.627328 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.672294 17438 rpcz_store.cc:276] 0709 12:10:20.385404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.385550 (+   146us) service_pool.cc:224] Handling call
0709 12:10:21.671705 (+1286155us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000cb554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:21.671846 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2701533440}
I20260709 12:10:21.698390 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.788111 17287 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.645123 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.699187 19575 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:21.698911 19529 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.679468 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:21.698727 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 80675.1us
I20260709 12:10:21.698704 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.701292 17285 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:21.688833 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.376456 19499 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.705052 18009 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:21.707253 17283 raft_consensus.cc:2410] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:21.709563 17292 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:21.710637 18015 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:21.683743 17432 rpcz_store.cc:276] 0709 12:10:19.199236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.817085 (+617849us) service_pool.cc:224] Handling call
0709 12:10:19.854518 (+ 37433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.224267 (+369749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.224305 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.231809 (+  7504us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.807106 (+575297us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:20.883639 (+ 76533us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.637967 (+754328us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18002cf500. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f1222a30a40 00007f1222a2b4e4 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:10:21.682915 (+ 44948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.683009 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.683050 (+    41us) raft_consensus.cc:1685] finished
0709 12:10:21.683146 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.683280 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25505,"prepare.queue_time_us":75492,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":3044,"raft.queue_time_us":839842,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":243,"spinlock_wait_cycles":24601984,"thread_start_us":750062,"threads_started":2,"wal-append.queue_time_us":922271}
W20260709 12:10:21.699436 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 102625us
I20260709 12:10:21.805337 17980 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.715922 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.693066 17440 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:21.808753 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.809561 17286 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:21.807088 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1372) took 1346 ms. Trace:
I20260709 12:10:21.810302 17440 rpcz_store.cc:276] 0709 12:10:20.460568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.634003 (+1173435us) service_pool.cc:224] Handling call
0709 12:10:21.692738 (+ 58735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.806860 (+114122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.807034 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.810712 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:21.811580 17360 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:21.811008 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:21.796532 17333 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:21.814384 17333 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:21.814688 17292 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.815598 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.800892 17287 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:21.801137 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.821276 17284 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:21.821694 17359 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.821586 17187 catalog_manager.cc:5697] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.802448 17361 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:21.824527 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.802821 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:21.797137 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 104422us
I20260709 12:10:21.827479 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:21.801517 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.828977 17285 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:21.753687 18013 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEARNER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:10:21.760546 17290 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:21.764554 17332 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.804185 17291 raft_consensus.cc:2393] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:21.768576 17363 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.830130 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 564) took 1032 ms. Trace:
I20260709 12:10:21.770012 17367 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:21.791796 19583 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:21.823287 17187 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 1 to 2, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.772336 17433 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:21.838512 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1420) took 1196 ms. Trace:
I20260709 12:10:21.838842 17433 rpcz_store.cc:276] 0709 12:10:20.641668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.608766 (+967098us) service_pool.cc:224] Handling call
0709 12:10:21.838450 (+229684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.777925 17441 rpcz_store.cc:276] 0709 12:10:20.552912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.659571 (+1106659us) service_pool.cc:224] Handling call
0709 12:10:21.659867 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.777284 (+117417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.777479 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.839854 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.839311 17187 catalog_manager.cc:5697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 3, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 3 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.840958 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.838018 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.841218 17187 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.785029 17186 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55932 (request call id 326) took 5436 ms. Trace:
I20260709 12:10:21.767632 17437 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:21.816324 17440 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:21.846398 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.803941 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 556) took 1031 ms. Trace:
I20260709 12:10:21.839112 17359 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:21.771222 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 46544.3us
I20260709 12:10:21.846916 17980 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:10:21.830772 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 66292.1us
I20260709 12:10:21.850147 17332 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.830519 18013 rpcz_store.cc:276] 0709 12:10:20.797725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.798527 (+   802us) service_pool.cc:224] Handling call
0709 12:10:21.659847 (+861320us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:21.830035 (+170188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5750016}
I20260709 12:10:21.831789 17438 raft_consensus.cc:2410] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:21.833351 17407 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:21.852337 17407 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:21.847355 18015 rpcz_store.cc:276] 0709 12:10:20.772594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.773838 (+  1244us) service_pool.cc:224] Handling call
0709 12:10:21.610448 (+836610us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:21.803879 (+193431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9570176}
I20260709 12:10:21.833689 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:21.835863 17333 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:21.836983 17292 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:21.842125 17283 raft_consensus.cc:2410] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:21.847098 17440 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.761540 17288 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:21.855646 17287 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.856622 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.857334 17441 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.823176 17364 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.861738 17407 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:21.791996 17434 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 2.
I20260709 12:10:21.804534 19529 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.864123 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.787501 19378 consensus_queue.cc:1059] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:10:21.871277 18014 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:21.844394 17187 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:21.862151 17980 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:10:21.834710 17406 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.188s (SENT)
I20260709 12:10:21.873297 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:21.866448 19572 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.803581 19556 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.868129 19485 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:21.804020 19575 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.831084 19600 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.868836 17407 leader_election.cc:400] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4.
W20260709 12:10:21.915884 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 51113.9us
I20260709 12:10:21.917999 17407 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:21.863245 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.864017 19397 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.804284 18010 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.872136 17187 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 4, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 4 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:21.871994 19400 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:21.923208 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 141317us
I20260709 12:10:21.823303 19561 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.867581 17332 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.795056 19237 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:10:21.831924 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 566) took 1026 ms. Trace:
I20260709 12:10:21.954886 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:21.881786 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.832058 19532 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:21.891395 19176 consensus_queue.cc:1059] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:10:21.847350 19516 raft_consensus.cc:2764] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:21.890830 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:21.889444 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.892715 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.994058 17287 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:21.891784 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:21.995258 18013 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:21.894812 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.995936 17288 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:21.895905 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.997057 17289 raft_consensus.cc:2410] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:21.898134 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.941629 19508 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.832059 18011 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:21.899247 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.897140 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.896160 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.899827 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.845849 19578 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.847815 19536 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.902083 17440 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:21.913254 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:21.843297 17186 rpcz_store.cc:276] 0709 12:10:16.348901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.349238 (+   337us) service_pool.cc:224] Handling call
0709 12:10:21.784941 (+5435703us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:21.245240 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:21.426862 (+181622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:21.426901 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:21.426919 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:21.528023 (+101104us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:21.528088 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:21.528115 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:10:21.528692 (+   577us) tablet.cc:701] Row locks acquired
0709 12:10:21.528710 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:21.528857 (+   147us) write_op.cc:270] Start()
0709 12:10:21.528970 (+   113us) write_op.cc:276] Timestamp: P: 1783599021528810 usec, L: 0
0709 12:10:21.528990 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:21.529710 (+   720us) log.cc:844] Serialized 2845 byte log entry
0709 12:10:21.592094 (+ 62384us) op_driver.cc:464] REPLICATION: finished
0709 12:10:21.593721 (+  1627us) write_op.cc:301] APPLY: starting
0709 12:10:21.593801 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:21.593981 (+   180us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:21.594169 (+   188us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:21.595233 (+  1064us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:21.595455 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:10:21.595497 (+    42us) write_op.cc:312] APPLY: finished
0709 12:10:21.595744 (+   247us) log.cc:844] Serialized 59 byte log entry
0709 12:10:21.764760 (+169016us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:21.764872 (+   112us) write_op.cc:454] Released schema lock
0709 12:10:21.764915 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:21.766502 (+  1587us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:21.766529 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":264,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":1387,"apply.run_cpu_time_us":2736,"apply.run_wall_time_us":172760,"num_ops":7,"prepare.queue_time_us":748700,"prepare.run_cpu_time_us":9662,"prepare.run_wall_time_us":342403,"raft.queue_time_us":10563,"raft.run_cpu_time_us":1178,"raft.run_wall_time_us":152366,"replication_time_us":62965,"thread_start_us":846042,"threads_started":4,"wal-append.queue_time_us":44942}]]}
I20260709 12:10:21.915800 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:21.798333 19612 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:21.869398 19499 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.863466 19486 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:22.012429 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 108604us
I20260709 12:10:21.978346 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.806274 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:21.923480 17187 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.984862 19561 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:21.874744 19529 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.924973 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:21.870409 19583 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:21.875438 19572 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.920786 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:22.024984 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 104314us
I20260709 12:10:21.918927 17441 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:21.912562 19593 consensus_queue.cc:1059] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:10:21.914513 19485 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.930197 19394 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.886735 19420 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:21.930943 17302 tablet_copy_service.cc:140] P 33539b233c2044afa31017244f6cc0d1: Received BeginTabletCopySession request for tablet 8f950276bbbb4642872e9280fad2a766 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:36408)
I20260709 12:10:22.030261 19544 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.929661 19599 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:21.931075 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 344) took 1076 ms. Trace:
I20260709 12:10:21.898869 19518 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.030807 19544 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:21.880470 19592 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:21.920226 19582 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:22.031306 19544 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.901724 19535 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.871824 19310 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:10:22.009168 19612 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:21.942966 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:21.919713 19515 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:21.957515 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 66426.5us
I20260709 12:10:21.959162 17407 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:21.959910 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 92395.7us
W20260709 12:10:22.034819 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 92370.4us
I20260709 12:10:21.960171 19575 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.961535 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:21.962354 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:21.966504 17333 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:22.042735 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 76354us
I20260709 12:10:21.978904 17432 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:21.979952 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 145264us
I20260709 12:10:21.880864 19482 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:10:22.045722 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.791487 19543 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.031129 19518 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.898700 19604 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:10:21.922690 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1412) took 2576 ms. Trace:
I20260709 12:10:21.930192 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:21.991400 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:21.940827 19400 raft_consensus.cc:697] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:22.003537 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:22.004822 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:22.058753 17285 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:22.057261 17361 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:22.059408 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:22.060009 17291 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.006042 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:22.060828 17288 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:22.061671 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:22.006806 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:22.007319 19621 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:10:22.065135 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:22.007957 19624 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:22.008380 19586 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.009513 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:22.010208 17283 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:10:22.010761 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.053035 19499 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.015188 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:21.872056 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:22.015653 17258 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:22.030731 17302 tablet_copy_service.cc:161] P 33539b233c2044afa31017244f6cc0d1: Beginning new tablet copy session on tablet 8f950276bbbb4642872e9280fad2a766 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:36408: session id = 868a5e341d0a41b4ac0927342c8cd598-8f950276bbbb4642872e9280fad2a766
I20260709 12:10:21.985428 19600 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.078508 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:21.978156 19397 consensus_queue.cc:1059] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:10:22.026418 17981 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:22.003383 19578 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.998157 19532 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:22.037149 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:22.039395 17332 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:22.027561 19572 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:22.118031 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 91693.4us
I20260709 12:10:22.033598 17439 rpcz_store.cc:276] 0709 12:10:20.854832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.663247 (+808415us) service_pool.cc:224] Handling call
0709 12:10:21.663491 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.663686 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:21.865406 (+201720us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.930726 (+ 65320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.930783 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.930827 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.930892 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.931012 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8942,"prepare.queue_time_us":127349,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":21204,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5786,"spinlock_wait_cycles":9937152,"thread_start_us":257387,"threads_started":2,"wal-append.queue_time_us":118761}
I20260709 12:10:22.022554 17434 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.048254 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:22.119894 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 82836.2us
I20260709 12:10:21.858783 19615 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:10:22.024844 19486 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:22.134959 19400 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.135427 19486 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:21.978235 18008 rpcz_store.cc:276] 0709 12:10:20.798377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.681713 (+883336us) service_pool.cc:224] Handling call
0709 12:10:21.681992 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.791680 (+109688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.825198 (+ 33518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.049160 19515 raft_consensus.cc:697] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:22.137528 19515 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.062645 17287 raft_consensus.cc:2393] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:22.140730 17366 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.040104 19517 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.142084 19517 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:22.143059 19517 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:22.063743 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.066668 17285 raft_consensus.cc:2410] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:22.067116 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 108047us
I20260709 12:10:22.067147 19624 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:22.011086 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:22.072676 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:22.182394 17363 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:22.204137 17361 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:22.054261 19518 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.074859 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:22.077023 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 61449.4us
I20260709 12:10:22.015829 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:22.080904 19482 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:22.079566 17406 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.207s (SENT)
I20260709 12:10:22.209723 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:22.087383 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.088935 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:22.214546 17441 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.215207 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.119069 17981 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:22.007488 19558 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 12:10:22.067201 18009 raft_consensus.cc:2376] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6. Re-sending same reply.
I20260709 12:10:22.129558 19543 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:22.130424 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.131042 17440 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:22.132627 19535 consensus_queue.cc:1059] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:22.133950 19555 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.076319 19593 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.134387 19378 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.068204 19586 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:22.145767 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:22.069146 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:22.152424 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:22.178246 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.149821 17291 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:22.030730 19583 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:22.205543 17286 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:22.080724 19499 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:22.133836 19397 raft_consensus.cc:3055] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.081241 19600 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:22.016569 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:22.083784 17358 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:22.119838 19578 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.049679 19612 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.203231 19603 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.259948 17439 raft_consensus.cc:2410] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:10:22.247643 17367 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:22.247097 17441 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:22.119390 19394 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 12:10:22.182083 19053 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:10:22.200001 19541 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.073279 19561 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.534072 19541 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:22.492784 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 413226us
I20260709 12:10:22.486768 17302 tablet_copy_source_session.cc:215] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:22.257673 19593 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:22.431622 19632 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:22.513109 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 304239us
I20260709 12:10:22.460453 19624 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:22.446988 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.537751 17433 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:22.535802 19499 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:22.261618 19558 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.542837 19397 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:22.390908 19532 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.543581 19176 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:10:22.546228 19397 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:22.487329 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 443556us
I20260709 12:10:22.543273 19541 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:22.551060 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:22.552134 19628 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.553885 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:22.409768 19602 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.008s
W20260709 12:10:22.555897 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.569306 19602 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.288379 19555 raft_consensus.cc:697] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:22.538057 19600 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.539945 19603 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:22.571918 19602 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:22.558736 19632 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.555655 19578 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.574970 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:22.537406 19593 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.582297 19558 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:22.586161 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.585703 17332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.022s	sys 0.027s
W20260709 12:10:22.586687 17332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.022s	sys 0.027s
I20260709 12:10:22.588019 17406 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:22.589457 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 550103us
I20260709 12:10:22.590601 17406 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:22.577627 19569 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:10:22.055079 17436 rpcz_store.cc:276] 0709 12:10:19.339206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.819252 (+480046us) service_pool.cc:224] Handling call
0709 12:10:19.902805 (+ 83553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.931630 (+ 28825us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:20.377429 (+445799us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.837445 (+1460016us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.855740 (+ 18295us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:21.864226 (+  8486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.875210 (+ 10984us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.898886 (+ 23676us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":499004,"prepare.queue_time_us":625410,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":502640,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":1356743,"threads_started":3,"wal-append.queue_time_us":779450,"wal-append.run_cpu_time_us":1243,"wal-append.run_wall_time_us":1021841}
I20260709 12:10:22.585058 19394 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.573040 19555 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.594118 19603 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:22.596053 17360 raft_consensus.cc:2368] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6.
I20260709 12:10:22.602996 19626 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:22.603760 19626 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:22.604856 19626 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.606673 19394 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.609539 19394 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.596206 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:22.598448 19578 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:22.619189 19544 consensus_meta.cc:287] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.004s
I20260709 12:10:22.619761 19544 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.583474 19599 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:22.623186 19535 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:22.624262 19535 raft_consensus.cc:3055] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.624619 19535 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:22.580303 19485 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:22.627684 19544 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:22.630604 17292 consensus_meta.cc:287] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.000s
I20260709 12:10:22.633356 17292 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:22.579847 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:22.584290 19628 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.625574 19535 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:22.654531 19536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.025s	sys 0.054s
W20260709 12:10:22.664990 19536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.026s	sys 0.054s
W20260709 12:10:22.659003 17434 consensus_meta.cc:287] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.002s
I20260709 12:10:22.682337 17404 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:22.692570 17432 consensus_meta.cc:287] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.002s
I20260709 12:10:22.693255 17432 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:22.695465 17367 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:22.679216 18010 consensus_meta.cc:287] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.738s	user 0.004s	sys 0.006s
W20260709 12:10:22.698278 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 552533us
I20260709 12:10:22.718575 17407 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:22.720667 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 130114us
I20260709 12:10:22.695755 19544 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.700589 19535 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.691653 17434 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:22.714717 19536 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.738700 17364 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:22.738596 17406 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:22.741957 17981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.011s	sys 0.010s
I20260709 12:10:22.717166 18010 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
W20260709 12:10:22.701435 19625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.017s
I20260709 12:10:22.716503 19516 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:22.789387 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 219598us
W20260709 12:10:22.785502 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 47000.2us
I20260709 12:10:22.716398 19558 consensus_queue.cc:1059] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:22.789215 19612 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.741833 19536 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.798761 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:22.789803 19518 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.007s
I20260709 12:10:22.784528 19640 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:22.806238 19625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.006s	sys 0.019s
I20260709 12:10:22.810523 19518 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.813014 19518 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:22.813187 19575 consensus_meta.cc:287] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.000s
I20260709 12:10:22.813836 17288 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:22.738139 19394 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:10:22.797103 19509 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.739436 19544 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.817716 19544 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:22.822636 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2239) took 1188 ms. Trace:
I20260709 12:10:22.823065 17284 rpcz_store.cc:276] 0709 12:10:21.634408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.822785 (+188377us) service_pool.cc:224] Handling call
0709 12:10:21.823028 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.915006 (+ 91978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.915037 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.915081 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:21.915111 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.822410 (+907299us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b54002ad5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:22.822456 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.822576 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211064064}
I20260709 12:10:22.824975 17439 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:22.801194 19632 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:22.799927 19516 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:22.791886 17981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.011s	sys 0.010s
W20260709 12:10:22.810969 19529 consensus_meta.cc:287] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.782s	user 0.003s	sys 0.007s
I20260709 12:10:22.827957 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.829747 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.830173 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.813619 19575 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:22.837921 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 718851us
I20260709 12:10:22.826898 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.842746 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:22.841135 17440 raft_consensus.cc:2410] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:22.845218 17439 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:22.847335 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.801959 19176 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.801734 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 616) took 1203 ms. Trace:
I20260709 12:10:22.851081 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.807721 19536 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.854283 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.806759 19622 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:22.858531 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.824435 19482 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:22.860136 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:22.837867 19518 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:22.867686 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.857425 18010 rpcz_store.cc:276] 0709 12:10:21.596112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.644878 (+ 48766us) service_pool.cc:224] Handling call
0709 12:10:22.799564 (+1154686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.866493 19394 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.870988 17365 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:22.881013 17406 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:22.858003 17438 raft_consensus.cc:2376] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2. Re-sending same reply.
I20260709 12:10:22.877322 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:22.882267 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:22.882803 17284 raft_consensus.cc:606] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:22.870541 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:22.871129 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:22.883891 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.884012 17258 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:22.883914 17440 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.855245 19640 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:22.887764 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:22.891917 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:22.856091 17437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1377) took 2360 ms (client timeout 2072 ms). Trace:
I20260709 12:10:22.900180 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:22.901461 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:22.848193 19529 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:22.934576 19630 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:10:22.886608 19613 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.939540 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:22.956523 19633 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:10:22.956797 18009 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:22.886695 19612 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.886703 17434 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:22.860893 19176 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:22.881157 17436 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:10:22.897697 17979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.004s
I20260709 12:10:22.898548 19627 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.892961 19650 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.960855 19602 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.874441 19518 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:22.869879 19482 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.868461 19622 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:23.003232 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 119284us
W20260709 12:10:22.984838 17979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.004s	sys 0.004s
I20260709 12:10:22.962357 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:22.984912 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4466b54543584a9898797997087d10f1"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:22.957715 19592 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:22.991232 19602 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:22.987376 19650 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:22.992503 19643 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:10:22.967303 19612 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:22.994264 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 95334.6us
I20260709 12:10:23.006445 19152 raft_consensus.cc:3055] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.980679 17440 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:23.008299 19641 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:23.009297 17284 raft_consensus.cc:606] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:22.899219 17437 rpcz_store.cc:269] 0709 12:10:20.487831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.605930 (+1118099us) service_pool.cc:224] Handling call
0709 12:10:22.838488 (+1232558us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b5400161554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:22.843893 (+  5405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127997696}
I20260709 12:10:23.004899 18008 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:22.998594 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 346) took 1037 ms. Trace:
I20260709 12:10:23.038866 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:23.026575 18012 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.028025 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:23.044304 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:23.044859 17440 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:23.013341 19592 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.030938 17284 raft_consensus.cc:614] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.018545 19650 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.038635 17360 rpcz_store.cc:276] 0709 12:10:21.961264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.962064 (+   800us) service_pool.cc:224] Handling call
0709 12:10:22.998331 (+1036267us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540040c9d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:22.998512 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272784128}
I20260709 12:10:23.047470 17440 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.046038 17407 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:23.027236 19152 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:10:23.038151 19648 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:10:23.026962 19612 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:23.052678 19653 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:10:23.046958 19641 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.066040 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:23.061849 19647 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:10:23.037170 19655 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.037993 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:23.070472 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:23.060015 19658 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:23.062363 19652 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:10:23.043555 19510 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:23.049690 19516 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.069512 19555 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:22.991285 19640 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.053279 17407 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:23.071120 17284 raft_consensus.cc:606] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.058269 19575 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.040289 19627 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:10:23.058642 19593 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.086330 19641 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:23.100827 19529 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.093439 19555 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:23.109157 19510 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:23.085507 19516 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 12:10:23.113135 19593 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.210585 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:23.211621 17284 raft_consensus.cc:606] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:23.197614 19641 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.201001 19482 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.233543 19622 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:23.203214 19510 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:23.205044 19654 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:23.426991 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 422092us
I20260709 12:10:23.431280 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:23.440430 17284 raft_consensus.cc:606] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.440822 17284 raft_consensus.cc:614] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.416378 19454 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:23.420022 19482 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:23.237653 19641 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.205114 19666 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.254s
I20260709 12:10:23.415675 19654 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.437216 19556 raft_consensus.cc:3055] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:23.484365 19510 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.511341 19510 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.511454 19592 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.513754 19592 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.515096 19592 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.526634 19592 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.528954 19592 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.504871 19556 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:23.531095 19556 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:23.532720 19556 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.489301 19482 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:23.485602 19454 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.447950 19555 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.537400 19669 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.538069 19669 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:23.553033 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.553575 17437 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:23.555457 19600 consensus_meta.cc:287] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.971s	user 0.008s	sys 0.004s
I20260709 12:10:23.557981 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:23.558841 18012 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:23.562602 18008 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:23.562879 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:23.563609 18009 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:23.564040 18015 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:23.565116 18010 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:23.575970 19482 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:23.577167 19641 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:23.581676 19454 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.583184 19586 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.584334 19586 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.586714 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:23.555951 19600 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:23.589944 19544 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.590895 17358 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.590641 19544 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:23.594686 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.596529 19572 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.413s	user 0.012s	sys 0.000s
I20260709 12:10:23.593492 19544 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:23.562603 19669 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:23.603840 19600 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:23.616757 19658 consensus_meta.cc:287] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.000s
I20260709 12:10:23.597059 19572 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.618950 17359 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:23.578148 19515 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:10:23.639315 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.656762 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.665859 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 86615.6us
I20260709 12:10:23.699257 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:23.585928 19536 consensus_meta.cc:287] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.000s
W20260709 12:10:23.709175 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 1.11292e+06us
I20260709 12:10:23.709463 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2258) took 1562 ms. Trace:
I20260709 12:10:23.710750 19628 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.710553 17332 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:23.710536 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 1.13067e+06us
I20260709 12:10:23.617300 19658 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.713959 17333 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:23.696229 19669 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:23.718937 17440 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.712460 19640 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.724074 19640 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.724454 19640 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.709957 17361 rpcz_store.cc:276] 0709 12:10:22.146803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.287869 (+141066us) service_pool.cc:224] Handling call
0709 12:10:22.527244 (+239375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.527480 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:22.579639 (+ 52159us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.708807 (+1129168us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b180033c280. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f1222a30a40 00007f1222a2b4e4 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:10:23.709019 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.709081 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:23.709147 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.709228 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.709384 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":824,"prepare.queue_time_us":52460,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1129982,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"spinlock_wait_cycles":10022272}
I20260709 12:10:23.732095 19632 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:23.717636 19535 consensus_meta.cc:287] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.977s	user 0.010s	sys 0.002s
I20260709 12:10:23.732710 19625 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:10:23.734899 19628 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.706139 19536 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:23.717480 19572 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.738986 17432 raft_consensus.cc:2410] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:23.741233 17332 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.721951 19669 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.753645 19669 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.748728 19575 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:23.750676 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:23.722244 19673 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:10:23.761076 19624 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.751251 19536 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:23.751852 17439 raft_consensus.cc:2368] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5.
I20260709 12:10:23.757403 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.757939 17333 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:23.762609 17367 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:23.743249 19499 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:23.704407 19676 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:23.744719 19603 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:23.775063 17332 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:23.775373 17978 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 2.128s (SENT) [suppressed 68 similar messages]
I20260709 12:10:23.747947 19632 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:23.778522 17332 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.778868 17361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:23.779848 17361 raft_consensus.cc:606] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:23.780212 17361 raft_consensus.cc:614] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.780310 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.787187 17333 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:23.805644 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.809087 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:23.783277 19650 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.725s	user 0.000s	sys 0.011s
I20260709 12:10:23.811883 19499 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.781740 19485 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:23.814410 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:23.783046 19572 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:23.785684 19493 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.721022 19675 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:23.820585 19176 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:23.823776 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:23.824062 19612 consensus_meta.cc:287] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.753s	user 0.002s	sys 0.009s
I20260709 12:10:23.812346 19642 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:23.782729 19603 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.814827 19529 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:23.814414 19499 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:23.812512 19575 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:23.831391 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 44310.3us
I20260709 12:10:23.826973 19640 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.842594 19310 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:23.852293 19310 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:23.853163 19310 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:23.853624 19640 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.849140 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:23.747741 19628 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.854707 17367 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:23.838742 19572 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:23.857726 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:23.831245 19599 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.844866 19642 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.859813 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:23.862910 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:23.863873 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:23.866387 19578 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:23.867117 19561 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:23.867782 19566 raft_consensus.cc:3055] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:23.871536 19176 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.873015 17367 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:23.851532 19499 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.877175 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:23.836623 19650 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.857460 19634 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.884702 17255 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:23.873642 19529 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:23.854080 19310 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.871809 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1390) took 1040 ms. Trace:
I20260709 12:10:23.883675 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:23.874910 19669 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.873690 19575 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:23.872201 19642 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:23.845567 19612 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.884616 19628 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.866410 19515 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:10:23.877636 19566 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:23.898542 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2261) took 1222 ms. Trace:
I20260709 12:10:23.876281 19578 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:23.892153 19253 raft_consensus.cc:3055] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:23.906618 17363 rpcz_store.cc:276] 0709 12:10:22.676488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.676614 (+   126us) service_pool.cc:224] Handling call
0709 12:10:22.677012 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.711119 (+1034107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.711152 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.711699 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.828087 (+116388us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:23.828157 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.828339 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.898321 (+ 69982us) raft_consensus.cc:1685] finished
0709 12:10:23.898342 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.898481 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1033606,"raft.queue_time_us":1034118,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":115870,"threads_started":1,"wal-append.queue_time_us":166679}
I20260709 12:10:23.901268 19482 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:23.910346 17333 connection.cc:256] RPC call timeout handler was delayed by -1.6982191879999391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 12:10:23.911902 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:23.894193 19556 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.893832 19669 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.913367 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.913535 17363 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:23.882325 19561 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.871649 19632 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:23.914633 17437 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.912302 19482 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:23.907459 19613 consensus_queue.cc:1059] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:23.917537 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:23.917389 17255 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:23.911957 19253 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:23.892858 17435 rpcz_store.cc:276] 0709 12:10:22.828866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.835443 (+  6577us) service_pool.cc:224] Handling call
0709 12:10:23.823557 (+988114us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:23.869611 (+ 46054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20401408}
I20260709 12:10:23.918867 19612 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.917279 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:23.888358 19176 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.912358 19566 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.920436 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.902441 19603 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.907965 17434 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.914650 19625 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.889068 19679 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:23.920073 19669 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.940179 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.916744 19556 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:23.930724 17363 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:23.919596 19628 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.919435 19578 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:23.918684 19572 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:23.894191 19634 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.942294 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:23.943890 19482 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:23.897452 19529 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:23.946631 19176 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:23.929147 19053 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:23.948800 17333 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:23.953116 19604 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.949295 19566 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.952641 19603 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:23.974931 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.947170 19556 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.953495 19152 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:23.995903 17978 leader_election.cc:336] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.854s (SENT)
I20260709 12:10:24.022869 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:23.983528 19053 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.956511 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:24.018707 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 70002.1us
I20260709 12:10:23.929809 19575 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:24.020181 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.998255 19604 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:24.023306 19578 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:24.017009 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.038091 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.940984 19625 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.024717 19515 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.018203 19650 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.025949 19603 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:24.054659 19053 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:24.145810 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.090921 19604 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.983426 19253 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.090734 19508 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:24.153389 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.167546 17367 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:24.167788 19650 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.168291 19650 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.170560 19650 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.174505 19253 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.105472 19578 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:24.150738 19152 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.180871 19634 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.176972 19508 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:24.179490 19586 consensus_meta.cc:287] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.595s	user 0.014s	sys 0.000s
I20260709 12:10:24.175168 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:24.166471 19561 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:24.212672 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.208154 19686 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.224540 18006 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:24.174718 19669 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.143986 19053 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.235916 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 579) took 1344 ms. Trace:
I20260709 12:10:24.244670 19583 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.245070 19675 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:24.244895 19650 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:24.229662 19603 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.261723 19642 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:24.241459 19578 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.258498 19625 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.257910 19675 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.256325 19583 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:24.329702 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 77315us
W20260709 12:10:24.286370 19624 consensus_meta.cc:287] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.009s
I20260709 12:10:24.285229 19669 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:24.241734 19508 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.358577 19499 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.362528 19600 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.335856 19053 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.249531 18006 rpcz_store.cc:276] 0709 12:10:22.891807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.894317 (+  2510us) service_pool.cc:224] Handling call
0709 12:10:24.153000 (+1258683us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:24.234681 (+ 81681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39166848}
I20260709 12:10:24.281162 19642 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:24.263561 19650 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.288031 19675 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:24.372455 19604 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.394327 19508 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.397282 19604 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.393193 19650 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:24.400367 17359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 342) took 2445 ms (client timeout 2128 ms). Trace:
W20260709 12:10:24.401546 17359 rpcz_store.cc:269] 0709 12:10:21.954414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.954585 (+   171us) service_pool.cc:224] Handling call
0709 12:10:24.399898 (+2445313us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54003c5854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:24.400134 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3771631488}
I20260709 12:10:24.404477 17363 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.405421 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.405877 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1474) took 2369 ms. Trace:
I20260709 12:10:24.407629 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.406422 17366 rpcz_store.cc:276] 0709 12:10:22.036270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.141515 (+105245us) service_pool.cc:224] Handling call
0709 12:10:22.539563 (+398048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.539920 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.539945 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.540374 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.641925 (+101551us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:22.641972 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.642052 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.792004 (+149952us) raft_consensus.cc:1685] finished
0709 12:10:22.792026 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.405371 (+1613345us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54003d09d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:24.405659 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1282,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":914686208,"thread_start_us":101117,"threads_started":1,"wal-append.queue_time_us":144656,"wal-append.run_cpu_time_us":5017,"wal-append.run_wall_time_us":1119013}
I20260709 12:10:24.408258 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:24.404745 17365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 353) took 2438 ms (client timeout 3123 ms). Trace:
I20260709 12:10:24.400437 19499 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:24.411755 17255 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:24.412118 19583 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:24.415740 17363 raft_consensus.cc:2410] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:24.416419 17361 raft_consensus.cc:2368] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6.
W20260709 12:10:24.411616 17365 rpcz_store.cc:269] 0709 12:10:21.966157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.078216 (+112059us) service_pool.cc:224] Handling call
0709 12:10:24.404249 (+2326033us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540032f5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:24.404563 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799282432}
I20260709 12:10:24.424295 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.425179 17365 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.418200 19517 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.426651 19517 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.429292 19517 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:24.419389 19583 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.430346 19583 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:24.431831 19642 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.420897 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 367) took 1205 ms. Trace:
I20260709 12:10:24.422308 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 363) took 1532 ms. Trace:
I20260709 12:10:24.422631 19575 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:24.430614 19669 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:24.421226 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.418313 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 366) took 1203 ms. Trace:
I20260709 12:10:24.435178 17434 rpcz_store.cc:276] 0709 12:10:23.214963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.215808 (+   845us) service_pool.cc:224] Handling call
0709 12:10:23.420745 (+204937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.939523 (+518778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.417533 (+478010us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400161f54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:24.417969 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082598784}
I20260709 12:10:24.436319 19575 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.433255 17441 rpcz_store.cc:276] 0709 12:10:22.889860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.891043 (+  1183us) service_pool.cc:224] Handling call
0709 12:10:22.891358 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.975695 (+ 84337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.975727 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.975771 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:22.975800 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.421782 (+1445982us) spinlock_profiling.cc:243] Waited 84.1 ms on lock 0x7b54001473d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:24.421847 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.422144 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193470336}
I20260709 12:10:24.432613 19642 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.436172 19583 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:24.439360 19575 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.435784 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:24.445147 19518 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:24.446280 19679 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.451808 17366 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:24.433136 17440 rpcz_store.cc:276] 0709 12:10:23.215255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.215861 (+   606us) service_pool.cc:224] Handling call
0709 12:10:23.216167 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.722409 (+506242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.420394 (+697985us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b540036db54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:24.420703 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155775744}
I20260709 12:10:24.456056 17365 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:24.439464 19604 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:24.463821 19604 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:24.464433 19604 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:24.461323 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.462929 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.466966 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:24.468887 19641 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:24.469527 19641 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:24.470033 19669 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.470788 19669 raft_consensus.cc:697] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:24.472383 19669 consensus_queue.cc:237] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.477523 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:24.478777 17291 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:24.483160 19641 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.485550 19641 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.486367 19583 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:24.486634 19562 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.489827 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:24.491488 17363 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:24.495711 17286 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:24.493683 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:24.498139 17289 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:10:24.498935 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.500296 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:24.515904 17283 raft_consensus.cc:2410] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:24.501619 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.504412 19662 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 1.369s	user 0.015s	sys 0.022s
I20260709 12:10:24.523798 19583 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.527405 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.529803 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.530774 17363 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:24.531780 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.533011 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.527223 19562 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.534701 19604 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.535593 19558 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:24.536420 19562 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:24.537910 19583 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.538751 17287 raft_consensus.cc:2410] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:10:24.540475 17439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1394) took 1694 ms (client timeout 1899 ms). Trace:
W20260709 12:10:24.541268 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.541008 17439 rpcz_store.cc:269] 0709 12:10:22.846824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.846952 (+   128us) service_pool.cc:224] Handling call
0709 12:10:24.539997 (+1693045us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b540006ed54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:24.540236 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078472320}
I20260709 12:10:24.544488 19556 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.547107 19599 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:24.547269 19556 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:24.547748 19599 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.549739 19602 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.527487 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:24.550557 17433 raft_consensus.cc:2376] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3. Re-sending same reply.
W20260709 12:10:24.551191 17433 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1386) took 1727 ms (client timeout 1527 ms). Trace:
W20260709 12:10:24.551307 17978 leader_election.cc:336] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.518s (SENT)
I20260709 12:10:24.536165 19558 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.551743 18006 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:24.552812 19397 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.553735 19558 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:24.555755 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:24.556639 19642 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:24.556900 18010 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.558955 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.559952 17978 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:24.564043 17439 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:24.551644 17433 rpcz_store.cc:269] 0709 12:10:22.823947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.824908 (+   961us) service_pool.cc:224] Handling call
0709 12:10:24.527112 (+1702204us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:24.551082 (+ 23970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3684096}
I20260709 12:10:24.567680 17361 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:24.567941 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:24.572258 19509 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.572794 19509 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:24.573215 19509 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:24.573323 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.575888 19400 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:24.577430 19515 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.577802 19515 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:24.577862 19482 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.578456 19482 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:24.578894 19515 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.579787 19482 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.581310 19482 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.585088 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2260) took 1908 ms. Trace:
I20260709 12:10:24.585638 17358 rpcz_store.cc:276] 0709 12:10:22.676165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.676296 (+   131us) service_pool.cc:224] Handling call
0709 12:10:22.719190 (+ 42894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.591391 (+872201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.584484 (+993093us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b540032ebd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:24.584864 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998408064}
I20260709 12:10:24.588210 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.590641 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.609972 17358 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:24.611581 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.608557 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.586311 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:24.613199 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.612542 17362 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:24.613761 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 43669.1us
I20260709 12:10:24.613598 19486 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.614530 19486 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.614917 19486 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.614892 17978 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:24.613655 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.618042 17358 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:24.618757 19152 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:24.619490 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.621212 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:24.623036 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.623529 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.664371 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.664932 17358 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.665125 17365 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:24.623805 19486 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.670531 17362 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:24.671833 17255 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:24.628074 19679 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.629446 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.630352 19602 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:24.630620 19604 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:24.625669 19599 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:24.631520 19556 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.632483 19322 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:24.635656 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.642351 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.643424 17432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1384) took 1820 ms (client timeout 1866 ms). Trace:
I20260709 12:10:24.643999 17436 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:24.646606 18010 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.646521 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:24.648188 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:24.649153 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:24.650143 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:24.651175 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:24.652194 18012 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.652993 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:24.654444 19641 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:24.635641 19509 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.655884 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.651083 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:24.660946 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.667353 17361 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:24.697306 17363 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
W20260709 12:10:24.746906 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.673233 17288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2260) took 2771 ms (client timeout 2865 ms). Trace:
I20260709 12:10:24.916961 17367 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:24.917034 17432 rpcz_store.cc:269] 0709 12:10:22.823398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.823529 (+   131us) service_pool.cc:224] Handling call
0709 12:10:24.643004 (+1819475us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b540034e754. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:24.643256 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055425280}
W20260709 12:10:24.920635 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.924463 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.736888 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1473) took 2786 ms. Trace:
I20260709 12:10:24.930546 17255 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:24.929541 17364 rpcz_store.cc:276] 0709 12:10:21.950585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.950807 (+   222us) service_pool.cc:224] Handling call
0709 12:10:21.951227 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.742567 (+791340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.714700 (+1972133us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54003a02d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:24.736711 (+ 22011us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808895744}
I20260709 12:10:24.760931 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:24.921032 17288 rpcz_store.cc:269] 0709 12:10:21.901680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.061439 (+159759us) service_pool.cc:224] Handling call
0709 12:10:24.672801 (+2611362us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54002003d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:24.673029 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728103808}
W20260709 12:10:24.736981 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.672823 19454 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.750000 19655 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.946368 17366 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.905964 19486 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:24.940171 17292 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:24.931978 18007 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.923135 19517 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.672531 19654 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:24.957687 17365 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.736809 19482 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.963377 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:24.967792 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.968087 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:24.969971 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 348860us
I20260709 12:10:24.968953 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1481) took 1218 ms. Trace:
I20260709 12:10:24.963258 18014 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:24.953935 19604 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:24.969916 18015 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:24.968772 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:24.962563 18008 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.755292 19400 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.216s
I20260709 12:10:24.976338 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:24.974766 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:24.981271 17363 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.972028 17365 rpcz_store.cc:276] 0709 12:10:23.750277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.666020 (+915743us) service_pool.cc:224] Handling call
0709 12:10:24.925865 (+259845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.968701 (+ 42836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.968896 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.935873 18011 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:24.984671 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:24.985512 18011 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:24.986937 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:24.933627 19602 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.987555 17432 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:24.959290 19322 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:24.988152 18012 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.990790 19593 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.991547 17361 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:25.010514 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:25.004894 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:25.001967 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.002344 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:25.048990 17359 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.049383 17435 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:25.049615 19599 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:24.932929 19556 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.050348 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:24.975018 19454 raft_consensus.cc:697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:25.057914 17359 raft_consensus.cc:2368] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4.
I20260709 12:10:25.061569 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 356) took 1008 ms. Trace:
W20260709 12:10:25.060446 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 254736us
I20260709 12:10:25.044423 18011 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:25.124732 17362 rpcz_store.cc:276] 0709 12:10:24.052790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.737700 (+684910us) service_pool.cc:224] Handling call
0709 12:10:24.738134 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.738492 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:24.958057 (+219565us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.061184 (+103127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.061237 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.061279 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.061347 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.061488 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13298,"raft.queue_time_us":22588,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":13330,"thread_start_us":269476,"threads_started":2}
I20260709 12:10:25.085800 19604 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:25.132755 18012 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:25.140174 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.133021 19667 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.992451 17358 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:25.001284 19602 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.002494 19578 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.000532 19586 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.044706 19053 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:25.004597 19322 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.045061 19515 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.002336 19176 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.086568 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.010308 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.089444 17364 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
W20260709 12:10:25.089573 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 117500us
W20260709 12:10:25.090121 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.008495 19593 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.166347 19566 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.164738 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:25.143983 17435 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:25.095127 18009 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:25.095640 19400 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:25.056972 19641 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.104152 17367 raft_consensus.cc:2410] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:25.005868 19482 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.108781 19599 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:25.092299 17980 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:24.988006 19655 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:25.044384 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 81087.3us
I20260709 12:10:25.145943 17288 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:25.154664 17363 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:25.162695 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.164577 19578 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:25.165307 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.144225 19509 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:25.094718 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.166651 19053 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:25.173449 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.175873 19586 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.176999 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.177572 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.184512 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1490) took 1426 ms. Trace:
I20260709 12:10:25.177599 18014 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:25.201943 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.172796 19556 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:25.204453 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.189870 19667 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:25.207019 19152 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.177994 19604 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:25.207832 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 46931.4us
I20260709 12:10:25.207980 19655 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.171645 19397 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.215262 17287 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:10:25.219123 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 127120us
I20260709 12:10:25.220116 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.278311 17362 raft_consensus.cc:2368] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6.
I20260709 12:10:25.278697 19400 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:25.220518 18010 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:25.279608 18007 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:25.222061 19578 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.280296 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:25.280517 19654 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.185043 19566 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.280797 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.282771 19566 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.283360 19566 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.283860 19566 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:25.285156 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:25.282460 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.286809 18007 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:25.287904 19563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f950276bbbb4642872e9280fad2a766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:25.288043 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.289633 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.230170 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:25.234963 19705 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 12:10:25.235683 19482 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.181530 19641 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.239331 17363 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.239159 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.240736 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.208977 19053 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.243841 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:25.244391 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.247588 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:25.218067 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.249569 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:25.303539 18014 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.304193 18012 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:25.250836 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1475) took 1504 ms. Trace:
I20260709 12:10:25.270153 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:25.251821 19586 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.173146 19454 consensus_queue.cc:237] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:25.259719 19679 raft_consensus.cc:3055] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.261127 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.277365 18008 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:25.211599 17358 rpcz_store.cc:276] 0709 12:10:23.752605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.750337 (+997732us) service_pool.cc:224] Handling call
0709 12:10:24.937849 (+187512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.149809 (+211960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.179324 (+ 29515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.269479 17289 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:25.273720 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:25.268507 17286 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:25.271651 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:25.289752 19709 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.193625 19176 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.298712 17366 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:25.300007 17363 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:25.278348 19152 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:25.216133 19599 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.321926 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.335318 18012 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:25.326960 17290 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.305033 17360 rpcz_store.cc:276] 0709 12:10:23.745924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.746092 (+   168us) service_pool.cc:224] Handling call
0709 12:10:23.746508 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.748181 (+  1673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.748213 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.741898 (+993685us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b2c00000a78. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:10:24.928453 (+186555us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.116759 (+188306us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:25.116803 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.123277 (+  6474us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.250331 (+127054us) raft_consensus.cc:1685] finished
0709 12:10:25.250355 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.250659 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1239,"raft.queue_time_us":2337,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":18662272,"thread_start_us":143482,"threads_started":1,"wal-append.queue_time_us":289606}
I20260709 12:10:25.327486 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:25.329008 17361 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.328980 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:25.266065 19667 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:25.296046 19397 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:25.321072 19679 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:25.338330 17364 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:25.328943 18010 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:25.340590 18015 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:25.328575 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.324710 19482 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.353845 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.328401 19486 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 12:10:25.355285 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.354728 17359 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:25.357440 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:25.341583 19566 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:25.339344 19667 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.328689 19400 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:10:25.344918 18011 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:25.360962 17366 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:25.355829 19709 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:25.367486 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 93945.8us
I20260709 12:10:25.365067 18012 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:25.359196 17364 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:25.367296 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:25.367686 19176 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.368424 19710 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.368172 19482 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:25.368676 19641 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:25.368819 19628 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.370568 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:25.346382 19578 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:25.374904 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:25.376088 17365 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.376392 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:25.367202 17283 raft_consensus.cc:2410] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:25.367763 17360 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.385627 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:25.383723 17978 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:25.383422 18009 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:25.395717 17255 leader_election.cc:400] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6.
I20260709 12:10:25.396128 17255 leader_election.cc:403] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:25.405838 17287 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
W20260709 12:10:25.397199 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.367163 19572 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:10:25.405632 17980 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:25.412007 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:25.440284 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:25.411619 17285 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:25.413309 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:25.410604 17366 raft_consensus.cc:1240] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:25.382351 19667 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.447795 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:25.439935 19176 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.396773 19679 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.453498 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:25.453399 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 58955.4us
I20260709 12:10:25.407378 19710 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.449867 18010 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:25.457221 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 72529us
I20260709 12:10:25.442940 19641 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:25.462278 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.453325 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 69692.5us
I20260709 12:10:25.456014 17365 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.413455 19566 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.472033 17366 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.473331 18014 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:25.474920 19499 raft_consensus.cc:3055] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.475379 19499 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:25.476363 19499 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.476461 18014 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.478813 18014 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.480012 18014 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.480189 18012 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:25.455408 19572 consensus_queue.cc:1243] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer 868a5e341d0a41b4ac0927342c8cd598 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:25.481812 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:25.482431 17286 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:25.482604 17283 raft_consensus.cc:2393] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:25.483541 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:25.485029 17283 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:25.396656 19628 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:25.486909 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:25.487613 19593 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.489586 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:25.457254 19718 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.490504 19718 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.394485 19586 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:10:25.490849 19718 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.492022 19586 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.492415 19586 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.492756 19586 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.494320 19566 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.494884 19599 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.496347 19669 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:25.496788 19566 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.497457 19669 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.498698 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:25.499228 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 366) took 1002 ms. Trace:
I20260709 12:10:25.499643 17367 rpcz_store.cc:276] 0709 12:10:24.496516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.182148 (+685632us) service_pool.cc:224] Handling call
0709 12:10:25.182616 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.208412 (+ 25796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.208444 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.208994 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.345828 (+136834us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.345863 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.345925 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.499026 (+153101us) raft_consensus.cc:1685] finished
0709 12:10:25.499044 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.499168 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100,"raft.queue_time_us":15295,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"thread_start_us":136408,"threads_started":1,"wal-append.queue_time_us":288253}
I20260709 12:10:25.497860 19669 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:25.501561 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 121352us
I20260709 12:10:25.502177 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:25.502442 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:25.503011 19642 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:25.503423 19642 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:25.503881 19642 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.504655 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:25.505777 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1497) took 1070 ms. Trace:
I20260709 12:10:25.506207 17361 rpcz_store.cc:276] 0709 12:10:24.435452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.061148 (+625696us) service_pool.cc:224] Handling call
0709 12:10:25.328822 (+267674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.336687 (+  7865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.505569 (+168882us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54003d09d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:25.505714 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562488576}
I20260709 12:10:25.506793 17333 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:25.508070 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:25.510304 19578 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:25.510788 19578 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:25.511101 19397 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:25.511885 19679 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.511790 19578 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.513263 19600 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.513816 19600 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:25.514853 19600 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.515352 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:25.516155 17432 raft_consensus.cc:2410] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:25.518421 19572 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:25.485803 17187 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60632 (request call id 218) took 11250 ms. Trace:
I20260709 12:10:25.532732 17283 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.534931 18013 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:25.542421 17290 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:25.470570 19641 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.490736 19667 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.545856 17432 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:25.548348 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.552933 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 50557.6us
I20260709 12:10:25.567042 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.540717 18009 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.571739 17288 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:25.572659 17978 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:25.544137 19655 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.548192 19397 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.541157 19566 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:25.544132 19482 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:25.547425 19641 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.548105 19654 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.572435 19486 consensus_queue.cc:1059] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:25.590210 18011 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:10:25.593472 19509 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.594303 17285 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.594849 19722 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.595510 19716 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:25.596692 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 107182us
I20260709 12:10:25.596560 19718 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.598896 19718 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:25.598927 19641 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.600885 19628 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:25.601492 19641 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:25.602010 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 368) took 1104 ms. Trace:
I20260709 12:10:25.604658 19176 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6.
I20260709 12:10:25.578510 19499 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.607012 19669 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.608341 19669 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.608820 18012 raft_consensus.cc:1217] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 12:10:25.609334 18012 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:25.602412 17362 rpcz_store.cc:276] 0709 12:10:24.497307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.279037 (+781730us) service_pool.cc:224] Handling call
0709 12:10:25.510324 (+231287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.510530 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.510554 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.510597 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.510624 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.510675 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.601837 (+ 91162us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540018cc50. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:25.601948 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531018112}
I20260709 12:10:25.612890 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:25.598855 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:25.629908 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 54106.1us
I20260709 12:10:25.631215 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:25.577428 19599 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:25.580006 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:25.640045 19628 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.611024 19397 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:25.643519 19515 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.662659 19716 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.614197 19566 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:25.661423 18008 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:25.663391 19722 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:25.666685 19628 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:25.568022 19710 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:25.670853 19709 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.665773 19593 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:25.685354 19718 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:25.660872 19599 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:25.522459 17187 rpcz_store.cc:276] 0709 12:10:14.235154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.235474 (+   320us) service_pool.cc:224] Handling call
0709 12:10:25.485573 (+11250099us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:22.068640 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:23.047682 (+979042us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b5400076128. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122bed79e1 00007f122bed664c 00007f1229565d5d 00007f12295510a6 00007f1229550d58 00007f12295559f1 00007f12295559a9 00007f1229555939 00007f1229555901 00007f1229554b2d 0000000000388634
0709 12:10:23.052239 (+  4557us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:23.055733 (+  3494us) write_op.cc:435] Acquired schema lock
0709 12:10:23.055753 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:23.215142 (+159389us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:23.231371 (+ 16229us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:23.233788 (+  2417us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:10:23.513726 (+279938us) tablet.cc:701] Row locks acquired
0709 12:10:23.513750 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:10:23.513910 (+   160us) write_op.cc:270] Start()
0709 12:10:23.514141 (+   231us) write_op.cc:276] Timestamp: P: 1783599023513862 usec, L: 0
0709 12:10:23.514168 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:10:23.514839 (+   671us) log.cc:844] Serialized 2835 byte log entry
0709 12:10:23.920737 (+405898us) op_driver.cc:464] REPLICATION: finished
0709 12:10:24.255240 (+334503us) write_op.cc:301] APPLY: starting
0709 12:10:24.258033 (+  2793us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:24.276647 (+ 18614us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:24.278027 (+  1380us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:24.280804 (+  2777us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:24.281033 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:10:24.281077 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:24.282067 (+   990us) log.cc:844] Serialized 59 byte log entry
0709 12:10:24.283941 (+  1874us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:24.288474 (+  4533us) write_op.cc:454] Released schema lock
0709 12:10:24.288530 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:24.288947 (+   417us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:24.288981 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46732,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":327984,"apply.run_cpu_time_us":3106,"apply.run_wall_time_us":37302,"num_ops":7,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":122208,"prepare.run_wall_time_us":1710018,"raft.queue_time_us":57928,"raft.run_cpu_time_us":10281,"raft.run_wall_time_us":310879,"replication_time_us":405102,"spinlock_wait_cycles":186314368,"thread_start_us":574615,"threads_started":3,"wal-append.queue_time_us":287798,"wal-append.run_cpu_time_us":13667,"wal-append.run_wall_time_us":1481402}]]}
W20260709 12:10:25.715750 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 116979us
I20260709 12:10:25.638088 19654 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:25.660437 19667 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:25.727280 19578 consensus_queue.cc:1059] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:10:25.716810 19709 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:25.749593 19397 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:25.750149 19720 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.750579 19566 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:25.677847 19515 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.723686 19572 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:25.772419 17333 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f950276bbbb4642872e9280fad2a766. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:10:25.875206 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.714174 19628 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:25.782323 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.923617 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:25.927933 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 319147us
W20260709 12:10:25.924629 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 170939us
W20260709 12:10:25.830739 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.833269 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.881289 19719 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:10:25.922840 17363 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.750608 19725 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.960953 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:25.962164 17363 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.970886 17291 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:25.977494 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.961557 19053 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.982781 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:25.989364 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 309715us
I20260709 12:10:25.969826 19641 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.993043 19723 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.993960 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 189329us
W20260709 12:10:25.995051 19729 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:10:25.996222 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:25.993032 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:25.941563 19397 consensus_queue.cc:1059] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:10:25.986069 19667 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:25.998838 19728 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:10:25.999760 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:26.001312 19726 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.318s	user 0.000s	sys 0.000s
I20260709 12:10:26.003742 17439 raft_consensus.cc:2368] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5.
I20260709 12:10:26.007071 17432 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:25.931918 19720 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:25.883116 19709 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.019079 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:26.003221 19679 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:26.022612 17362 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.008279 19723 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.023250 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:26.040763 17365 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:26.052600 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 75733.2us
I20260709 12:10:26.057577 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:25.962209 19725 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:26.065828 17440 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:26.042936 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 592) took 1386 ms. Trace:
I20260709 12:10:25.975198 19572 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:26.081894 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.043833 19604 consensus_queue.cc:1059] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:26.043998 19641 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:26.096242 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 133209us
I20260709 12:10:26.087534 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:26.088346 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.081753 19642 consensus_meta.cc:287] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.005s
I20260709 12:10:26.049551 19667 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:25.987105 19722 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:26.093463 17332 leader_election.cc:336] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.517s (SENT)
I20260709 12:10:26.075690 17363 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:26.102581 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 102978us
I20260709 12:10:26.102557 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:26.097318 17440 raft_consensus.cc:2376] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2. Re-sending same reply.
I20260709 12:10:26.080439 19709 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.111967 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 367) took 1615 ms. Trace:
W20260709 12:10:26.112592 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.113559 17362 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:26.077744 18006 rpcz_store.cc:276] 0709 12:10:24.653941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.368467 (+714526us) service_pool.cc:224] Handling call
0709 12:10:25.368873 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.369409 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:25.369444 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.369997 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.659397 (+289400us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:25.659481 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.668960 (+  9479us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.039486 (+370526us) raft_consensus.cc:1685] finished
0709 12:10:26.039526 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.039971 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":377,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":267800,"threads_started":1,"wal-append.queue_time_us":379766}
I20260709 12:10:26.080852 19053 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:26.085695 19751 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.144729 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:26.144963 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.145395 17365 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.097672 19515 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:26.115583 18015 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:26.061111 19679 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.087071 19599 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:26.151449 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:26.171753 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 94160.5us
I20260709 12:10:26.117846 17363 rpcz_store.cc:276] 0709 12:10:24.496934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.192049 (+695115us) service_pool.cc:224] Handling call
0709 12:10:25.239160 (+ 47111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.922362 (+683202us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b4c00371e40. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1223de7a20 00007f1223df8a29 00007f1223dbe644 00007f1223de5f2d 00007f1223de5b93 00007f1225b1618b 00007f1225b16cb5 00007f1225b11f30 00007f1225b137de 00007f1225b1db49 00007f1225b1e416
0709 12:10:26.111678 (+189316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.111905 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6847744}
I20260709 12:10:26.186527 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:26.187422 17366 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.187774 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:26.150444 19602 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:10:26.197180 19734 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:10:26.198454 19743 log.cc:927] Time spent T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
W20260709 12:10:26.198787 19733 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:10:26.211498 17364 raft_consensus.cc:2410] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:26.247754 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 153524us
W20260709 12:10:26.199591 19586 consensus_meta.cc:287] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.706s	user 0.014s	sys 0.004s
W20260709 12:10:26.259549 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 317065us
I20260709 12:10:26.116974 19642 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.261404 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:26.263967 17362 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:26.262344 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 63110.2us
I20260709 12:10:26.274008 17404 leader_election.cc:400] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4.
I20260709 12:10:26.274531 17404 leader_election.cc:403] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:26.150960 19714 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 12:10:26.282253 19499 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.282788 19563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52232 (request call id 609) took 6431 ms. Trace:
I20260709 12:10:26.282919 19499 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:26.283694 19750 log.cc:927] Time spent T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:10:26.283993 19578 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.284583 19578 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.286520 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:26.286801 19578 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:26.288691 19669 consensus_meta.cc:287] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.002s
I20260709 12:10:26.263720 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:26.247507 19604 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:10:26.295324 17364 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:26.273911 18010 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.293884 17404 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:26.282960 19753 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:10:26.314188 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 596) took 1637 ms. Trace:
I20260709 12:10:26.276325 19745 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.314694 18013 rpcz_store.cc:276] 0709 12:10:24.662424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.980960 (+318536us) service_pool.cc:224] Handling call
0709 12:10:26.299981 (+1319021us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54005f2dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:26.300118 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763339392}
I20260709 12:10:26.322237 17365 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:26.269549 19586 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:26.337831 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44027.5us
I20260709 12:10:26.314284 19742 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.351056 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:26.296432 19751 consensus_queue.cc:1059] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:10:26.283245 19563 rpcz_store.cc:276] 0709 12:10:19.861413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.913106 (+ 51693us) service_pool.cc:224] Handling call
0709 12:10:20.769960 (+856854us) ts_tablet_manager.cc:934] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
0709 12:10:25.285937 (+4515977us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:26.022854 (+736917us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:26.023000 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:26.278125 (+255125us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:26.282166 (+  4041us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:26.282557 (+   391us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:26.282673 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":99395,"tablet-copy.queue_time_us":765046,"thread_start_us":574038,"threads_started":2}
I20260709 12:10:26.360435 19563 tablet_copy_client.cc:806] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:26.361230 19563 tablet_copy_client.cc:670] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
W20260709 12:10:26.361255 19747 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:10:26.365260 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 382) took 1095 ms. Trace:
I20260709 12:10:26.365749 17435 rpcz_store.cc:276] 0709 12:10:25.270128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.271828 (+  1700us) service_pool.cc:224] Handling call
0709 12:10:25.272202 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.573821 (+301619us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:25.577695 (+  3874us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.668786 (+ 91091us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.943246 (+274460us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.962720 (+ 19474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.970584 (+  7864us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.364965 (+394381us) raft_consensus.cc:1685] finished
0709 12:10:26.364997 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.365173 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91420,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8921,"thread_start_us":475411,"threads_started":2,"wal-append.queue_time_us":461485}
I20260709 12:10:26.367445 19720 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:26.346055 19723 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:26.387066 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:26.388049 17437 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:26.399829 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 52667.2us
I20260709 12:10:26.360320 19751 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:26.402002 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:26.353276 19756 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.406571 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:26.408265 17439 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:10:26.413373 17332 leader_election.cc:336] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.067s (SENT)
I20260709 12:10:26.341620 19745 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.414628 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:26.406615 19756 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.414487 19602 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.439100 17359 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:26.440915 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:26.437991 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:26.410760 19572 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.407622 18007 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:26.404060 19751 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:26.444085 17288 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:26.440989 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:26.455503 17286 raft_consensus.cc:2410] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:26.458650 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:26.439366 19715 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:10:26.461522 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 45895.8us
I20260709 12:10:26.469844 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:26.470019 19751 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:26.471217 19727 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:26.486450 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:26.490334 19599 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:26.491071 19599 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:26.470636 17284 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:26.471518 19751 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:26.441507 19515 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.445415 19572 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:26.526298 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 93515.6us
W20260709 12:10:26.527439 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 138534us
W20260709 12:10:26.528231 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 118364us
I20260709 12:10:26.443895 19756 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.541976 17978 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:26.537096 19764 log.cc:927] Time spent T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 12:10:26.572422 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.462683 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:26.465658 19723 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.181s
I20260709 12:10:26.464152 19654 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:10:26.538334 19572 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.646003 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:26.645938 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:26.682749 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 140841us
I20260709 12:10:26.705691 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:26.682909 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:26.683367 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:26.683672 19628 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.000s
W20260709 12:10:26.647125 19763 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:10:26.711122 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:26.683030 19599 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:26.712296 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 247012us
I20260709 12:10:26.646435 19758 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.714016 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:10:26.712602 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.709023 19397 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.706247 19604 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:26.722904 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 77010.5us
I20260709 12:10:26.725188 19745 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:26.538954 19515 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:26.729569 19770 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:26.730301 19754 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.731529 19754 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:26.733111 19515 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:26.732645 19754 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.683212 19752 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.291s
W20260709 12:10:26.734134 19709 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.000s
I20260709 12:10:26.717780 19152 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.735443 19397 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:26.736433 17258 leader_election.cc:400] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5.
I20260709 12:10:26.739076 17258 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:26.740005 19655 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.711539 19400 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.728235 19586 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:26.716756 19628 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.742311 19397 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:26.756736 17258 leader_election.cc:400] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5.
I20260709 12:10:26.757730 19669 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:26.758931 19773 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:10:26.760738 19740 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.761s	user 0.000s	sys 0.014s
I20260709 12:10:26.764818 19742 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4.
W20260709 12:10:26.765617 19746 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.625s	user 0.011s	sys 0.044s
I20260709 12:10:26.767831 19679 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:26.747028 19752 consensus_queue.cc:1059] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:10:26.770525 19774 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:10:26.757032 17978 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:26.774534 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:26.776408 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:26.791116 19748 consensus_queue.cc:1059] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:10:26.792034 19716 raft_consensus.cc:3055] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.792506 19716 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:26.792327 19397 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:26.778638 19669 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:26.774163 19572 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.777139 19655 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:26.781114 19152 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:10:26.798535 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2273) took 1531 ms. Trace:
W20260709 12:10:26.777840 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 59906.5us
I20260709 12:10:26.855393 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 376) took 1308 ms. Trace:
W20260709 12:10:26.855590 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 52040.9us
I20260709 12:10:26.793790 19628 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:26.810937 19725 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:26.855381 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 79029.4us
I20260709 12:10:26.856446 17291 rpcz_store.cc:276] 0709 12:10:25.267552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.267852 (+   300us) service_pool.cc:224] Handling call
0709 12:10:25.268221 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.981872 (+713651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.798255 (+816383us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54003faf54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:26.798430 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1606400128}
W20260709 12:10:26.859704 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 105631us
W20260709 12:10:26.830876 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.861233 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:26.858361 19593 raft_consensus.cc:3055] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:26.805142 18010 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:26.862174 19655 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:26.862876 19628 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.862689 19593 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:26.898484 19604 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.867128 19499 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:26.899031 19604 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.899487 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:26.901335 19604 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:26.901466 19563 tablet_copy_client.cc:538] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:26.905354 19655 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:26.906816 17366 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:26.898962 19593 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:26.857100 17283 rpcz_store.cc:276] 0709 12:10:25.546636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.546768 (+   132us) service_pool.cc:224] Handling call
0709 12:10:25.570025 (+ 23257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.578341 (+  8316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.578375 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.595228 (+ 16853us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.925621 (+330393us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.925666 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.925752 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.760307 (+834555us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b2400187268. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12228b49c4 00007f12228b2acb 00007f1222a6ddc9 00007f1222a6da55 00007f1222a6d09d 00007f122569f10e 00007f12256b688c 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221
0709 12:10:26.794495 (+ 34188us) raft_consensus.cc:1685] finished
0709 12:10:26.794519 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.855319 (+ 60800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35646,"raft.queue_time_us":767,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":13148,"spinlock_wait_cycles":6002176,"thread_start_us":118771,"threads_started":1,"wal-append.queue_time_us":395038}
I20260709 12:10:26.908779 19593 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.909776 19572 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:26.910218 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 627) took 1383 ms. Trace:
I20260709 12:10:26.795766 19748 raft_consensus.cc:3055] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:26.914497 19748 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:26.907747 17188 catalog_manager.cc:5697] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65), VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66), VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67), VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 3 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:10:26.914027 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 56717.5us
I20260709 12:10:26.917389 19517 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:26.918020 19517 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.862673 19738 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:26.795127 19774 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.851290 17436 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:26.854045 19742 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.892896 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:26.893514 19586 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:26.896904 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.906531 19628 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.885448 19669 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:26.804596 19667 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:26.809671 19641 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:26.795379 19642 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:26.793871 19397 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:26.929138 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.891265 19566 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:26.929909 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 172948us
W20260709 12:10:26.939517 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 78359.6us
W20260709 12:10:26.924355 19771 log.cc:927] Time spent T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:26.941087 19572 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:26.915386 19748 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:26.921772 19738 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:26.946879 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:26.941789 19566 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:26.934501 17188 catalog_manager.cc:5697] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 3 to 4, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:26.957728 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:26.948736 19517 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:26.949355 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:26.921976 19774 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:26.954531 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:26.955331 18007 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:26.955471 18015 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:26.955633 18014 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:26.955793 19628 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:26.956655 17434 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.956859 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:26.957795 19563 tablet_bootstrap.cc:492] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:10:26.958930 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:26.962713 17188 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 4 to 6, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 6 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:26.793473 19716 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:26.954315 18013 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:26.972174 19669 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.936277 19709 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.933873 19742 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:26.970724 17284 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:26.957707 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:26.982460 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.005740 17365 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:26.978353 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:26.991119 17188 catalog_manager.cc:5697] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:27.006953 17437 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:26.986690 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 46416.5us
I20260709 12:10:27.007833 17188 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 2 to 3, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 3 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:26.998816 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:26.991796 17283 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:27.001534 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:26.998131 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:26.985656 19655 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.010273 18015 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:27.011011 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.014017 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:27.015789 18013 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.015964 17441 raft_consensus.cc:2410] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:27.011921 17188 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 4 to 5, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 5 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:27.017592 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.019771 17980 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:27.018253 17188 catalog_manager.cc:5697] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 2 to 4, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 4 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:27.020164 17359 raft_consensus.cc:2393] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:26.998471 19400 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.987715 19642 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:27.005838 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:26.976910 19572 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.007467 19742 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:27.186771 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 81089.7us
I20260709 12:10:27.012365 19641 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:27.093390 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.178762 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 152903us
I20260709 12:10:27.014341 19748 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.026320 17978 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:27.022323 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.093725 17258 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:27.047744 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:27.032231 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.186543 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:27.186050 18013 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:26.914001 18010 rpcz_store.cc:276] 0709 12:10:25.526914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.544604 (+ 17690us) service_pool.cc:224] Handling call
0709 12:10:26.143228 (+598624us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:26.189097 (+ 45869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.909898 (+720801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.910128 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8902528}
I20260709 12:10:27.005322 19517 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:27.012010 19499 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:27.090938 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:27.034677 17188 catalog_manager.cc:5697] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 3 to 5, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 5 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:27.023154 17361 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:27.167338 19784 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:27.068253 19710 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.182199 19716 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:27.279249 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 53835.9us
I20260709 12:10:27.017982 18011 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:27.263041 19593 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:27.225293 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.309767 17188 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:27.217620 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:27.018361 19655 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.333137 19655 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:27.240046 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.091997 19556 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:27.337117 19556 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.337337 19777 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:10:27.083427 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:27.293296 19782 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 12:10:27.208050 19400 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:27.305660 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 279420us
I20260709 12:10:27.314078 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.281507 19755 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.281198 19779 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.318063 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:27.261930 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:27.321312 19499 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:27.323529 17434 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
W20260709 12:10:27.343266 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.343865 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:27.302556 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:27.209254 19756 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.307348 19628 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.346544 17188 catalog_manager.cc:5697] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 2 to 4, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 4 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:27.284379 17358 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:27.107591 19566 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.005614 19397 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.094564 19774 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:27.317629 19710 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:27.461390 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.459488 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.471756 18013 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:27.471958 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.107858 19738 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.289563 19641 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:27.505439 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 188259us
I20260709 12:10:27.314749 19517 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:27.479995 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.472146 17188 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 2 to 6, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 6 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:27.479862 17440 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:27.324923 19604 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.511590 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.510775 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:27.511540 17188 catalog_manager.cc:5697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 2 to 5, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 5 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:27.321960 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.523284 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.444872 19586 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:27.418298 19755 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:27.546554 19783 log.cc:927] Time spent T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 12:10:27.546693 19515 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.364648 19777 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 12:10:27.527557 19556 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:27.504498 19628 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:27.528429 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 513728us
I20260709 12:10:27.527674 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.515890 17188 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 4 to 5, leader changed from <none> to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 5 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:27.610518 17188 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 2 to 3, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 3 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:27.534473 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.611828 17440 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:27.538074 19499 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:27.542220 19744 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.543280 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.479796 19710 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.553412 18014 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.623374 17188 catalog_manager.cc:5697] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:27.551167 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:27.552960 17439 consensus_meta.cc:287] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.001s
I20260709 12:10:27.364215 19773 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.555814 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.607501 17433 raft_consensus.cc:2368] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4.
I20260709 12:10:27.533555 19655 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:27.357244 19593 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.624931 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:27.625147 17439 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
W20260709 12:10:27.645150 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 94078.4us
I20260709 12:10:27.563643 19738 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.654124 17432 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:27.676436 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:27.677102 17440 raft_consensus.cc:2376] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5. Re-sending same reply.
I20260709 12:10:27.551676 19755 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:27.607785 19556 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.620491 19744 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.648600 17188 catalog_manager.cc:5697] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 1 to 2, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:27.680181 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:27.526018 19604 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.693866 19604 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:27.608364 19566 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.549196 19642 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 12:10:27.690478 19798 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:27.695369 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 138745us
I20260709 12:10:27.647504 19499 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.697991 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:27.708235 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.725091 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:27.726505 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:27.733516 17439 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:27.652143 17434 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:27.737977 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:27.695749 19744 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.741886 18014 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
W20260709 12:10:27.715813 19740 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:27.678857 19795 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:10:27.719218 19499 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.653482 19773 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:27.744740 18009 consensus_meta.cc:287] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.000s
I20260709 12:10:27.783182 19517 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:27.787940 19667 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.788650 19667 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:27.695096 19556 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.796279 19556 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:27.796888 19556 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:27.798350 19794 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:10:27.800029 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.801318 19791 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.578s	user 0.003s	sys 0.000s
W20260709 12:10:27.806617 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.807235 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.809901 19790 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.588s	user 0.002s	sys 0.000s
I20260709 12:10:27.818390 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:27.821180 18011 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:27.742980 19799 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.828897 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 510870us
W20260709 12:10:27.835309 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.757445 19793 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:10:27.839357 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.842247 18013 raft_consensus.cc:2376] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4. Re-sending same reply.
W20260709 12:10:27.848771 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 119908us
W20260709 12:10:27.833858 19772 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.021s	sys 0.034s
W20260709 12:10:27.860190 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 345241us
I20260709 12:10:27.857467 17407 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:27.866261 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:27.869356 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.022s	sys 0.051s
W20260709 12:10:27.869956 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.022s	sys 0.051s
W20260709 12:10:27.870391 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 505477us
I20260709 12:10:27.782500 18009 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:27.877895 17407 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:27.847340 19586 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:27.861128 19772 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.021s	sys 0.035s
I20260709 12:10:27.889019 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:27.884426 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.847824 19400 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:27.887633 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.847985 19777 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:27.898741 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.899364 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.867686 19152 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.880578 19742 consensus_meta.cc:287] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.002s
I20260709 12:10:27.905464 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.925875 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.926298 17366 raft_consensus.cc:2410] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:10:27.906670 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.907054 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.927256 17360 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:27.908506 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.919544 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.928175 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.870772 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.877602 19751 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.924678 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:27.928514 17359 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:27.939848 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.881724 19509 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:27.948606 19509 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.949270 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:27.950531 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.951244 17440 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:27.951673 19509 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:27.952008 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.952637 17440 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:27.953534 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.953704 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:27.954293 17359 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.957490 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:27.959410 18015 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:27.959318 17285 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:27.961895 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:27.962378 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:27.963248 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.964406 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.964790 19586 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:27.965592 17359 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:27.966696 17359 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.973529 17359 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:27.977232 17359 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:27.890489 19756 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:27.900089 19641 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:27.940490 19742 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.945542 19667 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:27.946233 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:27.946148 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:27.946738 17365 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:27.947155 17434 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:27.947273 19572 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:27.947530 19751 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.947839 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1436) took 1004 ms. Trace:
I20260709 12:10:27.947945 17362 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 1.
I20260709 12:10:27.848263 19799 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:27.943461 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:27.758195 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:28.408242 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.076746 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:28.410620 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.412149 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.964380 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:28.267469 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:28.131359 17978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.002s	sys 0.006s
W20260709 12:10:28.416714 17978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.002s	sys 0.015s
I20260709 12:10:28.037155 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 641) took 1083 ms. Trace:
W20260709 12:10:28.415635 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 424519us
I20260709 12:10:27.990895 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:28.153170 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.417209 17433 rpcz_store.cc:276] 0709 12:10:26.943620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.943769 (+   149us) service_pool.cc:224] Handling call
0709 12:10:27.947600 (+1003831us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54003b65d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:27.947765 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360287488}
I20260709 12:10:28.411299 17366 raft_consensus.cc:2410] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:28.424429 17333 leader_election.cc:336] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 1.576s (SENT)
I20260709 12:10:28.425673 17440 raft_consensus.cc:2410] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:28.413731 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.755759 19499 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.418370 18014 rpcz_store.cc:276] 0709 12:10:26.961044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.983286 (+ 22242us) service_pool.cc:224] Handling call
0709 12:10:28.033752 (+1050466us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b540045c4d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:28.037067 (+  3315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251057024}
I20260709 12:10:28.466697 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1461) took 1302 ms. Trace:
I20260709 12:10:28.467243 17440 rpcz_store.cc:276] 0709 12:10:27.164564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.203137 (+1038573us) service_pool.cc:224] Handling call
0709 12:10:28.466609 (+263472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:27.930940 19795 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:28.491693 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 67293.6us
I20260709 12:10:28.492704 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:28.494359 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:28.093693 19800 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.399s	user 0.000s	sys 0.004s
W20260709 12:10:28.391498 19803 log.cc:927] Time spent T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:10:28.496426 17367 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:28.212483 19725 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:28.492776 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1472) took 1055 ms. Trace:
W20260709 12:10:28.432765 19748 consensus_meta.cc:287] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.174s	user 0.008s	sys 0.004s
I20260709 12:10:28.123445 18011 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:28.493762 17285 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
W20260709 12:10:28.519570 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 556024us
I20260709 12:10:28.496961 17284 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:28.493040 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:28.421816 19751 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.980850 19773 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:28.244590 19556 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.080332 19655 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:28.534355 17188 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.012s	sys 0.035s
I20260709 12:10:28.088418 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:28.085791 19593 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:28.433347 19798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.005s	sys 0.014s
I20260709 12:10:28.511176 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:28.505316 17438 rpcz_store.cc:276] 0709 12:10:27.438908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.745564 (+306656us) service_pool.cc:224] Handling call
0709 12:10:28.492696 (+747132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.512143 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:28.543496 17440 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:28.523121 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 619949us
I20260709 12:10:28.432359 19667 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.524979 17406 leader_election.cc:336] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.865s (SENT)
I20260709 12:10:27.924068 19777 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:28.522158 17288 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:28.036957 19809 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:28.509415 19604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.013s	sys 0.025s
W20260709 12:10:28.534966 17188 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.012s	sys 0.035s
I20260709 12:10:28.493999 19805 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:27.936870 19152 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:28.558928 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:28.542768 19798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.005s	sys 0.014s
I20260709 12:10:28.544948 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:28.530321 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1471) took 1210 ms. Trace:
I20260709 12:10:28.546880 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:28.575906 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 606) took 1571 ms. Trace:
I20260709 12:10:28.576417 18006 rpcz_store.cc:276] 0709 12:10:27.004605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.539170 (+534565us) service_pool.cc:224] Handling call
0709 12:10:27.727893 (+188723us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:27.823502 (+ 95609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.828035 (+  4533us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:28.034257 (+206222us) log.cc:844] Serialized 52 byte log entry
0709 12:10:28.496070 (+461813us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:28.504519 (+  8449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.520754 (+ 16235us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.575616 (+ 54862us) raft_consensus.cc:1685] finished
0709 12:10:28.575646 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.575834 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24462,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":342384,"threads_started":1,"wal-append.queue_time_us":472466}
I20260709 12:10:28.578248 17433 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:28.579423 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:28.580035 17433 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:28.580879 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:28.581597 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1464) took 1416 ms. Trace:
I20260709 12:10:28.545956 19725 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:28.563181 19796 log.cc:927] Time spent T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.827s	user 0.002s	sys 0.000s
I20260709 12:10:28.564920 19777 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:28.565598 19820 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.566814 19804 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.557127 19604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.014s	sys 0.025s
I20260709 12:10:28.567289 19805 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:28.569393 19152 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:28.559182 19814 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.610545 19814 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:28.613015 19814 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:28.557797 19509 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.613870 19509 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:28.549562 19556 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:28.618220 19556 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:28.569283 19779 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.619395 19779 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:28.619850 19779 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.547341 18009 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.623224 19774 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.555269 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:28.627112 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:28.629240 19509 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:28.630373 19821 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:28.574045 19798 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:28.581899 17433 rpcz_store.cc:276] 0709 12:10:27.165332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.580607 (+1415275us) service_pool.cc:224] Handling call
0709 12:10:28.581526 (+   919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.539407 19795 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:28.590734 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:28.586220 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 642) took 1618 ms. Trace:
I20260709 12:10:28.549728 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:28.603951 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 79015.4us
I20260709 12:10:28.548840 19748 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:28.632777 17438 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:28.572899 19809 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:28.552253 19667 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:28.899365 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.956418 17407 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.778s (SENT) [suppressed 53 similar messages]
I20260709 12:10:28.734659 18011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 610) took 1626 ms. Trace:
I20260709 12:10:28.957023 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2298) took 1060 ms. Trace:
W20260709 12:10:28.653702 19716 consensus_meta.cc:287] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.329s	user 0.008s	sys 0.000s
W20260709 12:10:28.642302 19669 consensus_meta.cc:287] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.639s	user 0.007s	sys 0.006s
I20260709 12:10:28.957476 17359 rpcz_store.cc:276] 0709 12:10:27.897058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.977976 (+ 80918us) service_pool.cc:224] Handling call
0709 12:10:27.983222 (+  5246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.087726 (+104504us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:28.087762 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.415168 (+327406us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.743561 (+328393us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.743601 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.743680 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.956793 (+213113us) raft_consensus.cc:1685] finished
0709 12:10:28.956809 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.956949 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44812,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5772,"thread_start_us":235653,"threads_started":1,"wal-append.queue_time_us":462680}
I20260709 12:10:28.959036 19811 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.796382 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:28.959569 19811 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:28.960798 17362 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:28.963151 19811 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:28.890496 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.632567 19804 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:28.649390 19710 consensus_meta.cc:287] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.974s	user 0.007s	sys 0.001s
I20260709 12:10:28.965811 19710 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:28.966935 19804 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:28.967236 18008 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:28.644723 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 390) took 1724 ms. Trace:
I20260709 12:10:28.968124 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1447) took 1875 ms. Trace:
W20260709 12:10:28.968914 18008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 605) took 1964 ms (client timeout 1778 ms). Trace:
W20260709 12:10:28.954728 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 204313us
I20260709 12:10:28.646804 19725 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:28.969442 18008 rpcz_store.cc:269] 0709 12:10:27.004361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.082442 (+ 78081us) service_pool.cc:224] Handling call
0709 12:10:28.968707 (+1886265us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540050d054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:28.968845 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3436264192}
I20260709 12:10:28.972483 17432 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:28.848670 17363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.012s	sys 0.005s
W20260709 12:10:28.973603 17363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.012s	sys 0.009s
I20260709 12:10:28.734952 19799 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:28.815856 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 249263us
W20260709 12:10:28.795017 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.887497 17404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.010s	sys 0.009s
W20260709 12:10:28.649329 17332 leader_election.cc:336] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.658s (SENT)
W20260709 12:10:28.970827 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 414275us
I20260709 12:10:28.978284 17981 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:28.974073 19742 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:28.980268 19827 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.980727 19827 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.981097 19827 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.957321 18011 rpcz_store.cc:276] 0709 12:10:27.108664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.827772 (+719108us) service_pool.cc:224] Handling call
0709 12:10:28.074881 (+247109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.528053 (+453172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.734441 (+206388us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b540045c4d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:28.734594 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420779392}
I20260709 12:10:28.958223 17433 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:28.983615 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1440) took 1892 ms. Trace:
I20260709 12:10:28.983927 17433 rpcz_store.cc:276] 0709 12:10:27.091181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.692332 (+1601151us) service_pool.cc:224] Handling call
0709 12:10:28.957869 (+265537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.983361 (+ 25492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.983557 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.988456 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1442) took 1896 ms. Trace:
I20260709 12:10:28.988991 17438 rpcz_store.cc:276] 0709 12:10:27.091808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.987485 (+1895677us) service_pool.cc:224] Handling call
0709 12:10:28.987777 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.988060 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.988088 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.988151 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:28.988206 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.988265 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.988373 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.990550 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:28.959494 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.991407 17432 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:28.734570 19628 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:28.634460 19738 consensus_meta.cc:287] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.949s	user 0.004s	sys 0.007s
I20260709 12:10:28.786017 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:28.994570 19641 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:28.970217 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.769553 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:28.968591 17434 rpcz_store.cc:276] 0709 12:10:27.093165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.507608 (+1414443us) service_pool.cc:224] Handling call
0709 12:10:28.968040 (+460432us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.995579 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:28.651748 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 156481us
I20260709 12:10:28.640851 19805 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:28.964186 19809 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:28.574563 17436 rpcz_store.cc:276] 0709 12:10:27.320448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.740391 (+419943us) service_pool.cc:224] Handling call
0709 12:10:28.526217 (+785826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.775228 19779 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.024036 19798 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.026283 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:28.997581 18007 rpcz_store.cc:276] 0709 12:10:26.968021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.014065 (+ 46044us) service_pool.cc:224] Handling call
0709 12:10:27.179971 (+165906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.619962 (+439991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.645544 (+ 25582us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.650473 (+  4929us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:27.675471 (+ 24998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.585891 (+910420us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400740254. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:28.585950 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.586139 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862954880}
I20260709 12:10:29.027081 17284 raft_consensus.cc:606] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:28.999912 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 646) took 1137 ms. Trace:
I20260709 12:10:28.931957 19499 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:28.647650 19566 consensus_meta.cc:287] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.953s	user 0.005s	sys 0.005s
I20260709 12:10:28.992581 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1475) took 1310 ms. Trace:
I20260709 12:10:28.797894 17255 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:28.990846 17438 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:28.974364 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2299) took 1071 ms. Trace:
I20260709 12:10:29.002151 17440 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:28.734030 18009 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:28.976382 17404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.012s	sys 0.009s
W20260709 12:10:29.040827 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 243020us
I20260709 12:10:29.041934 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:29.042405 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.042959 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.976756 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 327445us
I20260709 12:10:29.039258 17363 rpcz_store.cc:276] 0709 12:10:27.903457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.983667 (+ 80210us) service_pool.cc:224] Handling call
0709 12:10:28.075556 (+ 91889us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:28.089236 (+ 13680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.089267 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:28.089843 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 12:10:28.973967 (+884124us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.974008 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.974080 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.974158 (+    78us) raft_consensus.cc:1685] finished
0709 12:10:28.974168 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.974301 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":827,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":96743,"thread_start_us":740274,"threads_started":1,"wal-append.queue_time_us":821438}
W20260709 12:10:29.046016 17332 leader_election.cc:336] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.867s (SENT)
I20260709 12:10:29.046389 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:29.046649 17332 leader_election.cc:336] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.905s (SENT)
W20260709 12:10:28.976094 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.975092 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.046969 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 90586.8us
I20260709 12:10:28.967855 17291 rpcz_store.cc:276] 0709 12:10:26.920526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.927963 (+  7437us) service_pool.cc:224] Handling call
0709 12:10:26.961698 (+ 33735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.996568 (+ 34870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.996596 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.003087 (+  6491us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.316193 (+313106us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:27.638888 (+322695us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.862702 (+223814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.862795 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.406926 (+544131us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:28.644398 (+237472us) raft_consensus.cc:1685] finished
0709 12:10:28.644513 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.644654 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77645,"prepare.queue_time_us":335602,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3279,"raft.queue_time_us":80224,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":9774,"spinlock_wait_cycles":15966592,"thread_start_us":657107,"threads_started":3,"wal-append.queue_time_us":566890}
W20260709 12:10:29.016093 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.977877 19667 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:28.934077 19751 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.030247 17441 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:29.011873 19642 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.016518 19744 consensus_meta.cc:287] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.265s	user 0.007s	sys 0.005s
I20260709 12:10:29.033871 18011 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:29.038961 17432 rpcz_store.cc:276] 0709 12:10:27.686168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.452873 (+766705us) service_pool.cc:224] Handling call
0709 12:10:28.992382 (+539509us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b540036db54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:28.992510 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098318208}
I20260709 12:10:29.039811 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1449) took 1934 ms. Trace:
I20260709 12:10:28.975608 17980 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:29.047065 17365 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:29.047678 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.046677 17359 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:28.954873 19397 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:29.027457 17284 raft_consensus.cc:614] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:29.063450 19829 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.066484 19829 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.066859 19829 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.067919 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.068768 18008 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:28.605836 19820 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.040367 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1446) took 1947 ms. Trace:
W20260709 12:10:29.052157 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.065199 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:29.062884 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:29.071319 17406 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.522s (SENT)
W20260709 12:10:29.071977 17406 leader_election.cc:336] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.549s (SENT)
I20260709 12:10:29.072084 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.072379 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:29.057335 19756 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.065289 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.074669 19779 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.074529 19756 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.014542 19641 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.055274 17361 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:29.057442 19830 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:29.064109 17432 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:29.073877 19566 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.069713 17438 rpcz_store.cc:276] 0709 12:10:27.092914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.990069 (+1897155us) service_pool.cc:224] Handling call
0709 12:10:28.990438 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.040123 (+ 49685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.040308 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:29.078009 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1455) took 1915 ms. Trace:
I20260709 12:10:29.078496 17432 rpcz_store.cc:276] 0709 12:10:27.162934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.058047 (+1895113us) service_pool.cc:224] Handling call
0709 12:10:29.063770 (+  5723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.077744 (+ 13974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.077951 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:29.078951 17441 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1448) took 1985 ms (client timeout 1658 ms). Trace:
I20260709 12:10:29.079861 17432 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:29.027761 18010 rpcz_store.cc:276] 0709 12:10:27.862156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.956177 (+ 94021us) service_pool.cc:224] Handling call
0709 12:10:27.956564 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.504932 (+548368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.509327 (+  4395us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.560408 (+ 51081us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.995712 (+435304us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:28.995772 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.999534 (+  3762us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.999653 (+   119us) raft_consensus.cc:1685] finished
0709 12:10:28.999672 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.999842 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":565494,"raft.queue_time_us":545004,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":22050,"thread_start_us":409165,"threads_started":1,"wal-append.queue_time_us":398132}
I20260709 12:10:29.080492 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1457) took 1917 ms. Trace:
I20260709 12:10:29.058264 17440 rpcz_store.cc:276] 0709 12:10:27.105007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.993073 (+1888066us) service_pool.cc:224] Handling call
0709 12:10:28.993446 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.039495 (+ 46049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.039744 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:29.058583 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 83065.7us
W20260709 12:10:29.079406 17441 rpcz_store.cc:269] 0709 12:10:27.093440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.105482 (+ 12042us) service_pool.cc:224] Handling call
0709 12:10:29.078762 (+1973280us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54001469d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:29.078874 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3947069312}
I20260709 12:10:29.081655 17980 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:29.078894 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.057555 19774 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.082859 19774 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.084959 19774 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:29.074738 17406 leader_election.cc:336] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.704s (SENT)
I20260709 12:10:29.070967 19710 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.086014 19826 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.087177 19826 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:29.064109 17333 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.087607 19826 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.067081 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.065264 19642 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.048194 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.088892 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:29.069142 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:29.085700 17439 raft_consensus.cc:2410] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:29.077364 19830 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.096927 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:29.089620 17432 rpcz_store.cc:276] 0709 12:10:27.163470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.079242 (+1915772us) service_pool.cc:224] Handling call
0709 12:10:29.079550 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.080255 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.080432 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:29.052016 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.021708 19738 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:29.061604 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:29.073833 17436 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:29.089277 17360 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:29.093340 17365 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:29.055967 19586 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.096467 17284 raft_consensus.cc:606] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.112738 17284 raft_consensus.cc:614] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:29.102917 17437 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:29.088474 19641 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:29.103530 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:29.091054 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:29.063663 19499 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:29.109534 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.012112 19827 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.111618 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:29.097335 19628 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.062287 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 614) took 1167 ms. Trace:
I20260709 12:10:29.108834 17436 pending_rounds.cc:85] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 6
I20260709 12:10:29.096967 19744 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.124918 17434 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:29.104388 19742 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:29.127210 19820 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:29.128723 19751 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:29.115410 19710 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.103752 19725 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.111133 19738 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.103425 19774 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:29.131325 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:29.130589 19805 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:29.102527 19777 raft_consensus.cc:2764] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:10:29.137152 17439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1445) took 2044 ms (client timeout 2572 ms). Trace:
I20260709 12:10:29.137830 17432 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:29.152392 19799 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.152872 19799 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.116648 19795 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.112533 19586 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:29.153095 19738 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.097505 19667 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:10:29.153546 19795 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:29.144511 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 69860.8us
I20260709 12:10:29.087201 19829 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:29.152143 17439 rpcz_store.cc:269] 0709 12:10:27.092647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.906372 (+813725us) service_pool.cc:224] Handling call
0709 12:10:29.136912 (+1230540us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400036e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:29.137070 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664600448}
I20260709 12:10:29.155714 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.155894 19795 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.156301 17439 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:29.156385 19829 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.153100 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:29.154422 19751 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:29.132851 17404 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:29.138294 17436 pending_rounds.cc:107] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:29.142546 19499 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:29.193804 17284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
W20260709 12:10:29.197425 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 64635us
I20260709 12:10:29.201732 17284 raft_consensus.cc:606] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:29.202314 17284 raft_consensus.cc:614] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:29.203135 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.203925 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:29.205794 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.206718 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:29.146425 19710 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.214802 19667 consensus_queue.cc:1059] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:29.215867 19667 raft_consensus.cc:3055] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.216234 19667 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:29.153239 19799 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.133213 18009 rpcz_store.cc:276] 0709 12:10:27.887538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.931647 (+ 44109us) service_pool.cc:224] Handling call
0709 12:10:29.054536 (+1122889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:29.210803 17404 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:29.218502 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 135942us
I20260709 12:10:29.199841 17436 raft_consensus.cc:2889] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:29.197947 19628 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.158360 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1452) took 1988 ms. Trace:
I20260709 12:10:29.221000 17432 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:29.227039 17404 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:29.142174 19748 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.198056 19751 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:29.203595 19566 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.247591 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1469) took 1952 ms. Trace:
W20260709 12:10:29.253959 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 207314us
W20260709 12:10:29.254735 17332 leader_election.cc:336] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.916s (SENT)
I20260709 12:10:29.218364 19710 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.195283 19774 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.222407 19586 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.196195 19805 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.256222 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:29.281795 17332 leader_election.cc:336] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.962s (SENT)
I20260709 12:10:29.292353 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1453) took 2129 ms. Trace:
I20260709 12:10:29.293164 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.296868 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.297107 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.297961 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.298496 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.298702 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.252729 19723 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.300038 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.253026 17437 rpcz_store.cc:276] 0709 12:10:27.304136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.964135 (+659999us) service_pool.cc:224] Handling call
0709 12:10:29.247336 (+1283201us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400115654. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:29.247507 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596091648}
I20260709 12:10:29.157641 19725 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.299247 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.145668 19742 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.259325 19499 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:29.256985 19820 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.255730 19400 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.291466 19779 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.320526 17432 raft_consensus.cc:2410] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:29.299772 19628 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:29.300609 19821 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:29.332165 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.307477 19566 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:29.332732 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.340756 18014 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:29.316627 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.335904 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.310235 19641 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:29.314779 19723 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.335906 17440 raft_consensus.cc:2410] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:29.343278 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 220826us
W20260709 12:10:29.344024 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 247146us
I20260709 12:10:29.309600 19748 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:10:29.329521 18008 raft_consensus.cc:2410] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:29.324111 19820 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.315989 18007 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:29.377424 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.378310 18014 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:29.351332 17439 raft_consensus.cc:2393] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:29.253559 17434 rpcz_store.cc:276] 0709 12:10:27.162145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.033513 (+1871368us) service_pool.cc:224] Handling call
0709 12:10:29.108739 (+ 75226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.141266 (+ 32527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.150846 (+  9580us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:29.383983 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.352046 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:29.352190 17333 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:29.362305 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 115873us
W20260709 12:10:29.365460 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 171029us
W20260709 12:10:29.366665 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 117661us
I20260709 12:10:29.330687 19499 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.388383 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.389178 19499 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:29.389783 19499 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.390273 19499 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:29.306051 17436 rpcz_store.cc:276] 0709 12:10:27.162411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.073066 (+1910655us) service_pool.cc:224] Handling call
0709 12:10:29.073455 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.292021 (+218566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.292276 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:29.390787 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.389848 19848 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.391610 19777 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.391505 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.393386 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:29.393625 17981 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.393951 17436 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.390650 19829 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:29.397034 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.352978 19723 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.398589 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:29.449716 18010 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.450182 19828 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:29.450318 19716 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:29.450963 19716 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.453188 19716 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:29.453791 19829 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.455021 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:29.455476 19566 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.456452 19848 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.456960 19848 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.457183 19642 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:29.457618 19848 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.456956 19850 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:10:29.459630 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.456660 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.460989 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.462565 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.453591 19799 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.463792 19751 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:29.398936 19845 log.cc:927] Time spent T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:29.339534 19779 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.398828 19821 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:29.399312 17258 connection.cc:256] RPC call timeout handler was delayed by -4.25551376500016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 12:10:29.467191 17258 connection.cc:256] RPC call timeout handler was delayed by -4.1538426550000622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 12:10:29.467528 17258 connection.cc:256] RPC call timeout handler was delayed by -3.9774426550000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 12:10:29.467818 17258 connection.cc:256] RPC call timeout handler was delayed by -3.9459426549999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:10:29.468111 17258 connection.cc:256] RPC call timeout handler was delayed by -3.8910426550000921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 12:10:29.399396 19826 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.399876 19809 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.468331 19779 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:29.468717 19809 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.336261 19400 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.469287 19827 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.470580 19856 raft_consensus.cc:2764] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:29.471025 19826 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:29.400290 19795 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.472003 19774 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:29.471776 19795 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.400878 19628 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.476002 19828 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:29.401978 19830 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:29.402872 19844 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:10:29.390648 19499 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.478574 19744 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.472668 19774 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:29.479286 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.479912 17440 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:29.480894 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.481657 17440 raft_consensus.cc:2410] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:29.482774 18008 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.482832 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:29.483464 17440 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:29.468384 17258 connection.cc:256] RPC call timeout handler was delayed by -3.81544265499997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 12:10:29.484149 17258 connection.cc:256] RPC call timeout handler was delayed by -3.7299426550000589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260709 12:10:29.484226 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:29.484472 17258 connection.cc:256] RPC call timeout handler was delayed by -3.6858426549999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 12:10:29.484774 17258 connection.cc:256] RPC call timeout handler was delayed by -3.6597426549999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 12:10:29.485121 17258 connection.cc:256] RPC call timeout handler was delayed by -3.6021426550000797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 12:10:29.484813 17439 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:29.406044 17437 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:29.447019 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.466369 19799 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:29.471284 19856 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.393589 19777 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.144s
I20260709 12:10:29.364053 19641 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.450062 19756 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:29.473902 19795 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.729187 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:29.729369 19667 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.721752 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 400) took 2426 ms. Trace:
I20260709 12:10:29.736388 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:29.737152 17359 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:29.738931 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 352139us
I20260709 12:10:29.743292 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.736397 17441 rpcz_store.cc:276] 0709 12:10:27.297444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.081655 (+1784211us) service_pool.cc:224] Handling call
0709 12:10:29.081952 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.121729 (+ 39777us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:29.211034 (+ 89305us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.422760 (+211726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.422824 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:29.422882 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.721451 (+298569us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b54000ff354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:29.721505 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.721667 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":92094,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":32067,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":56,"spinlock_wait_cycles":90954624,"thread_start_us":271770,"threads_started":3,"wal-append.queue_time_us":234976}
I20260709 12:10:29.750620 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:29.751410 17288 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.753971 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.757664 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:29.758252 19826 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.758857 19826 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.539831 19828 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:29.376573 19820 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:29.632972 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 94579.2us
I20260709 12:10:29.466617 19848 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.729938 18014 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:29.728986 19751 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:29.606232 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.679049 19563 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:29.758924 17441 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.730419 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:29.777230 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.651399 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:29.765862 17359 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:29.472774 19805 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:29.399329 19725 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:29.769512 17258 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:29.652369 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.776108 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.767836 19829 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:29.796290 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:29.802209 17283 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.803179 17441 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:29.779031 19667 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.805079 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:29.805730 17286 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:29.806452 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:29.809904 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 500372us
W20260709 12:10:29.811628 17332 leader_election.cc:336] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.036s (SENT)
I20260709 12:10:29.790639 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.815405 17332 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.773329 19828 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.774027 19748 consensus_queue.cc:1059] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:29.796262 19860 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.838091 17441 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.846715 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 403) took 1426 ms. Trace:
I20260709 12:10:29.847199 17441 rpcz_store.cc:276] 0709 12:10:28.420505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.806754 (+1386249us) service_pool.cc:224] Handling call
0709 12:10:29.837887 (+ 31133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.846374 (+  8487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.846643 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:29.805135 19805 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.853528 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 404) took 1432 ms. Trace:
I20260709 12:10:29.854013 17439 rpcz_store.cc:276] 0709 12:10:28.420747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.834493 (+1413746us) service_pool.cc:224] Handling call
0709 12:10:29.853042 (+ 18549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.853214 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.853238 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.853274 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:29.853307 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.853356 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.853461 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:29.860328 19853 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:29.806614 19848 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:29.863113 19860 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.842164 19563 tablet_bootstrap.cc:492] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:10:29.876801 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 107380us
W20260709 12:10:29.881053 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 69465.9us
I20260709 12:10:29.881704 17283 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
W20260709 12:10:29.881728 17332 leader_election.cc:336] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.124s (SENT)
I20260709 12:10:29.885409 17288 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
W20260709 12:10:29.886175 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 498718us
I20260709 12:10:29.888533 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:29.889199 17286 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:10:29.892119 17332 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.202s (SENT)
I20260709 12:10:29.892627 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.894223 17441 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:29.894613 17441 pending_rounds.cc:85] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 6
I20260709 12:10:29.895018 17441 pending_rounds.cc:107] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:29.895269 17441 raft_consensus.cc:2889] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:29.881003 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 344484us
I20260709 12:10:29.895704 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:29.899331 17288 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:29.899818 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.900245 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.899987 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.902578 17406 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:29.905652 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:29.907979 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:29.912633 17332 leader_election.cc:336] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.218s (SENT)
I20260709 12:10:29.913113 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:29.891594 19642 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:29.914739 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:29.920503 19866 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.898056 19400 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.896195 19848 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:29.928464 17332 leader_election.cc:336] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.397s (SENT)
I20260709 12:10:29.928524 17404 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:29.930630 17288 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:29.931098 17286 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:29.932706 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:29.935853 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.936636 17359 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:29.936931 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.939177 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:29.940171 17359 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:29.942436 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.943441 17365 raft_consensus.cc:2410] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:29.930092 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 401) took 2618 ms. Trace:
I20260709 12:10:29.944438 19859 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:29.927538 19642 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.946841 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.947466 17366 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:29.947535 19723 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:29.946089 19859 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.948566 19859 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:29.949702 19723 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:29.949440 19859 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.950309 19756 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.917893 19716 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.950881 19716 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:29.951314 19716 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.956235 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:29.957047 17365 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:29.958477 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:29.958977 19397 consensus_meta.cc:287] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.891s	user 0.016s	sys 0.002s
I20260709 12:10:29.959589 19593 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.960232 19593 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:29.961511 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:29.961783 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:29.962599 17288 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:29.962848 17435 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:29.963233 17441 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:29.966025 19799 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.966341 17290 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:29.931277 19864 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.969851 17439 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:29.974444 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:29.976487 19860 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:29.962548 19641 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:29.909611 19868 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:10:29.950465 19563 tablet_bootstrap.cc:492] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:10:29.978734 19563 ts_tablet_manager.cc:1403] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 3.021s	user 0.048s	sys 0.024s
W20260709 12:10:29.980024 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 51601us
W20260709 12:10:29.984175 17406 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.522s (SENT)
I20260709 12:10:29.984699 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:29.900956 19748 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:29.729843 17437 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.998615 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:30.000133 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:29.990228 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 59962.8us
W20260709 12:10:30.004490 17406 leader_election.cc:336] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.807s (SENT)
I20260709 12:10:30.004732 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:30.006536 17980 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:10:30.011754 17406 leader_election.cc:336] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.073s (SENT)
I20260709 12:10:30.013934 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:30.023859 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.023173 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:30.001775 19856 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:30.036124 17404 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:29.944049 17438 rpcz_store.cc:276] 0709 12:10:27.311252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.083038 (+1771786us) service_pool.cc:224] Handling call
0709 12:10:29.083304 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.083503 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:29.135725 (+ 52222us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.632579 (+496854us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.929658 (+297079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.929718 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:29.929775 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.929920 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.930034 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303555,"prepare.queue_time_us":132237,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":350252,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":12541,"thread_start_us":496310,"threads_started":3,"wal-append.queue_time_us":583778}
I20260709 12:10:30.039996 17360 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:30.042330 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:30.052022 17285 raft_consensus.cc:2410] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:30.027201 19499 consensus_meta.cc:287] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
W20260709 12:10:30.055704 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 44012us
W20260709 12:10:30.056391 17406 leader_election.cc:336] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.183s (SENT)
W20260709 12:10:30.056314 17333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.003s	sys 0.012s
W20260709 12:10:30.057251 17406 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.241s (SENT)
I20260709 12:10:30.057710 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:30.059231 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:30.057201 17333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.003s	sys 0.012s
I20260709 12:10:30.062222 17438 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:30.070917 19563 raft_consensus.cc:359] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:30.034524 19779 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.043506 19725 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.043008 19867 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:30.081640 17332 leader_election.cc:336] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.776s (SENT)
W20260709 12:10:30.064440 19849 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:30.043552 19805 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:30.075404 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 611652us
W20260709 12:10:30.133759 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 52168us
W20260709 12:10:30.138265 17332 leader_election.cc:336] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.869s (SENT)
I20260709 12:10:30.138767 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:30.054231 19866 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:30.065945 19586 consensus_meta.cc:287] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.002s
W20260709 12:10:30.103770 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46538.3us
I20260709 12:10:30.097481 17437 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
W20260709 12:10:30.087313 19628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.008s
I20260709 12:10:30.064693 19868 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:30.152336 17332 leader_election.cc:336] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.479s (SENT)
I20260709 12:10:30.152917 17332 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:30.104259 17440 raft_consensus.cc:2410] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:30.153970 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 416) took 1043 ms. Trace:
I20260709 12:10:30.154372 17440 rpcz_store.cc:276] 0709 12:10:29.110756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.482620 (+371864us) service_pool.cc:224] Handling call
0709 12:10:30.153889 (+671269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.087438 19756 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:30.151911 19628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.012s	sys 0.011s
W20260709 12:10:30.142896 18010 consensus_meta.cc:287] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.002s
I20260709 12:10:30.160813 17285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:30.166388 17285 raft_consensus.cc:606] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:30.166764 17285 raft_consensus.cc:614] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:30.080178 19779 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:30.160774 17332 leader_election.cc:336] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.509s (SENT)
I20260709 12:10:30.103134 19725 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.080338 19830 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:30.158430 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 163572us
W20260709 12:10:30.153502 19710 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.861s	user 0.008s	sys 0.003s
I20260709 12:10:30.156447 19756 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.082232 19563 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:10:30.103030 19400 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:30.065711 19499 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:30.173939 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:30.148255 19880 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:30.152297 19860 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.157611 19828 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:30.211079 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 50360.2us
W20260709 12:10:30.164834 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 160172us
I20260709 12:10:30.170672 18010 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:30.170080 19774 consensus_meta.cc:287] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.004s
W20260709 12:10:30.200929 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.182821 19779 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.198297 19756 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.184010 19725 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.209189 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1441) took 3117 ms. Trace:
W20260709 12:10:30.208696 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 185603us
W20260709 12:10:30.211897 17332 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.722s (SENT)
I20260709 12:10:30.244011 17332 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:30.183394 19830 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:30.213420 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:30.149770 19867 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.195252 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:30.153092 19805 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:30.214210 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 63864us
I20260709 12:10:30.198840 19850 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:30.230396 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 59995.3us
I20260709 12:10:30.155697 19586 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.170820 19820 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:30.247193 17980 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:10:30.252373 17406 leader_election.cc:336] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.739s (SENT)
I20260709 12:10:30.255791 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:30.256886 17406 leader_election.cc:336] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.778s (SENT)
I20260709 12:10:30.257296 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:30.196816 19710 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.206805 19871 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.211961 19628 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.183251 19716 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.243642 17433 rpcz_store.cc:276] 0709 12:10:27.091519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.984811 (+1893292us) service_pool.cc:224] Handling call
0709 12:10:28.985206 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.985635 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:29.052560 (+ 66925us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.697843 (+645283us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.992340 (+294497us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.992581 (+   241us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:29.992619 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.992695 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.208953 (+216258us) raft_consensus.cc:1685] finished
0709 12:10:30.208974 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.209127 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2697,"prepare.queue_time_us":227331,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":92395,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":174,"thread_start_us":650624,"threads_started":3,"wal-append.queue_time_us":270094}
W20260709 12:10:30.260289 17406 leader_election.cc:336] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.066s (SENT)
I20260709 12:10:30.260246 19828 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:30.261171 19877 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:10:30.261731 19586 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:30.262032 19865 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:10:30.262225 17291 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.262969 19863 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:30.263535 19875 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:30.258673 19860 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.263705 17980 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:30.266129 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:30.206664 19400 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.251133 19830 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:30.267426 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 129997us
W20260709 12:10:30.279172 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 66013.7us
W20260709 12:10:30.280422 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 85326.1us
I20260709 12:10:30.282140 17285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:30.308913 17285 raft_consensus.cc:606] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:30.309314 17285 raft_consensus.cc:614] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:30.287075 19809 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:30.287875 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:30.289688 19716 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:30.290200 19744 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.291267 19499 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:30.200500 19856 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.296054 19642 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:30.296916 19861 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:10:30.290349 17283 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:30.310269 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49990us
I20260709 12:10:30.316480 17284 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:30.273788 19881 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:30.325312 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 259290us
I20260709 12:10:30.282611 19828 raft_consensus.cc:697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:30.319532 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:10:30.314978 19751 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.005s
I20260709 12:10:30.249639 19563 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:30.315878 19868 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:30.345613 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 81989.2us
I20260709 12:10:30.394798 17980 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:30.395967 19563 ts_tablet_manager.cc:1434] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.417s	user 0.014s	sys 0.005s
I20260709 12:10:30.396060 17980 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:30.397258 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:30.397358 19827 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:30.398382 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:30.356010 17404 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:30.318621 19742 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:30.327207 19809 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:30.367419 19667 consensus_meta.cc:287] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 12:10:30.368705 19820 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:30.332888 19885 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:30.367338 17436 consensus_meta.cc:287] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.828s	user 0.007s	sys 0.008s
I20260709 12:10:30.344842 19744 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:30.373622 19400 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:30.374868 19867 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:30.375769 19593 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:30.377681 19873 raft_consensus.cc:2955] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:30.379067 19710 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:30.374887 19805 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:30.380977 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1429) took 1275 ms. Trace:
I20260709 12:10:30.383392 19828 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.327775 19892 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.388509 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1432) took 1270 ms. Trace:
I20260709 12:10:30.404377 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:30.408711 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 100506us
I20260709 12:10:30.558521 17359 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:30.558938 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:30.554831 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 404) took 1169 ms. Trace:
W20260709 12:10:30.411991 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 80063.9us
I20260709 12:10:30.562292 17359 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:30.562142 17291 rpcz_store.cc:276] 0709 12:10:29.385207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.385328 (+   121us) service_pool.cc:224] Handling call
0709 12:10:29.463343 (+ 78015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.281187 (+817844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.554592 (+273405us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54000514d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:30.554765 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836763520}
I20260709 12:10:30.564034 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:30.559136 17439 rpcz_store.cc:276] 0709 12:10:29.117964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.971770 (+853806us) service_pool.cc:224] Handling call
0709 12:10:29.972301 (+   531us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:29.972859 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.972889 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:30.047396 (+ 74507us) log.cc:844] Serialized 590 byte log entry
0709 12:10:30.186375 (+138979us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:30.186413 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.186487 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.388272 (+201785us) raft_consensus.cc:1685] finished
0709 12:10:30.388293 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.388443 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":313,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":138161,"threads_started":1,"wal-append.queue_time_us":316399}
I20260709 12:10:30.564700 17440 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:30.408638 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.565732 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:30.508369 17332 leader_election.cc:336] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 3.146s (SENT)
I20260709 12:10:30.567322 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:30.567441 17332 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:30.567637 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:30.567986 17438 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:30.568181 17432 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.566228 17441 rpcz_store.cc:276] 0709 12:10:29.105168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.964034 (+858866us) service_pool.cc:224] Handling call
0709 12:10:29.964339 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.964706 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.964732 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.004327 (+ 39595us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.214277 (+209950us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:30.214313 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.214385 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.380709 (+166324us) raft_consensus.cc:1685] finished
0709 12:10:30.380731 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.380900 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2955,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":149204,"threads_started":1,"wal-append.queue_time_us":336378}
I20260709 12:10:30.417380 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 411) took 1357 ms. Trace:
I20260709 12:10:30.569518 17434 rpcz_store.cc:276] 0709 12:10:29.060219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.843996 (+783777us) service_pool.cc:224] Handling call
0709 12:10:30.053245 (+209249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.053444 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.053470 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.053513 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.053552 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.053612 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.417144 (+363532us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400270450. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:30.417298 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480569216}
W20260709 12:10:30.512321 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 77773.8us
I20260709 12:10:30.571223 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:30.566159 17366 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:30.572147 17407 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:30.512956 17406 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.884s (SENT)
I20260709 12:10:30.573062 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:30.564344 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:30.578651 17333 connection.cc:256] RPC call timeout handler was delayed by -1.7315153550000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26680000000000004s for a response
W20260709 12:10:30.579149 17333 connection.cc:256] RPC call timeout handler was delayed by -1.47017734200017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24260000000000004s for a response
I20260709 12:10:30.580202 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.404639 19879 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.582571 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:30.586181 17439 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
W20260709 12:10:30.586557 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 73645.9us
W20260709 12:10:30.587728 17406 leader_election.cc:336] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.730s (SENT)
I20260709 12:10:30.588212 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:30.589007 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:30.590813 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:30.590566 19744 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.593771 19710 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:30.594354 19710 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.597435 17359 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:30.598381 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 289735us
I20260709 12:10:30.555269 17360 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:30.407656 19862 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.625488 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:30.627825 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 55755us
W20260709 12:10:30.625511 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 54369.3us
I20260709 12:10:30.625792 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:30.634704 17361 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.620707 19867 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:30.410156 19809 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:30.636452 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.621703 19879 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:30.639459 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.644076 17362 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 3: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:30.640442 17432 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:30.560369 17436 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:30.641141 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:30.646781 17440 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:30.641141 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:30.645587 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 57871.9us
I20260709 12:10:30.642863 17359 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:30.596446 19593 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.656199 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:30.656986 17440 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:30.658073 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:30.647562 17364 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:30.628491 19862 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.638052 19830 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.666517 19862 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.668222 19830 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:30.669251 19899 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:30.596884 19894 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.670307 19901 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.670639 19894 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.671025 19894 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.628201 19710 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:30.630611 19805 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:30.676182 19805 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:30.677104 19805 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.679458 19897 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.679944 19897 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.680271 19897 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.683022 19742 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.683586 19742 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:30.683964 19809 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.685755 19742 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:30.658505 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 150168us
I20260709 12:10:30.651602 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:30.644409 19860 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:30.670332 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1436) took 1551 ms. Trace:
I20260709 12:10:30.650094 19748 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.692682 17258 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:30.622762 19779 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.697283 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:30.700717 17332 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.802s (SENT)
I20260709 12:10:30.707376 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:30.693890 17432 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:30.694169 17361 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:30.571180 19885 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:30.643322 19827 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:30.705428 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.645360 19879 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:30.732877 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 334533us
I20260709 12:10:30.726938 17362 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:30.738905 17359 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.695874 19899 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.741904 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:30.759090 17432 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:30.770419 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:30.771227 17285 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
W20260709 12:10:30.771849 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 65910.4us
I20260709 12:10:30.711382 19860 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:30.806771 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:30.807547 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:30.812997 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.811378 17291 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:30.744022 19889 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.836787 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.837800 17361 raft_consensus.cc:2410] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:30.838243 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 130979us
I20260709 12:10:30.838973 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:30.820158 19899 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.843658 17258 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:30.836992 19725 consensus_meta.cc:287] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.001s
I20260709 12:10:30.849822 17258 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:30.845433 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:30.850657 18011 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:30.696233 17436 rpcz_store.cc:276] 0709 12:10:29.119167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.393107 (+273940us) service_pool.cc:224] Handling call
0709 12:10:30.670257 (+1277150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.847500 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:30.854571 17302 tablet_copy_service.cc:342] P 33539b233c2044afa31017244f6cc0d1: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-8f950276bbbb4642872e9280fad2a766 received from {username='slave'} at 127.0.0.1:36408
I20260709 12:10:30.855166 17302 tablet_copy_service.cc:434] P 33539b233c2044afa31017244f6cc0d1: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-8f950276bbbb4642872e9280fad2a766 on tablet 8f950276bbbb4642872e9280fad2a766 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:30.856245 19916 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.856514 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:30.857199 18008 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:30.837679 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:30.864385 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:30.844419 19756 consensus_meta.cc:287] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 12:10:30.873423 19826 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:30.842222 19867 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.848634 19889 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.865954 18011 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:30.882133 17285 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:30.889556 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:30.864562 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:30.864858 18014 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.839437 19710 consensus_queue.cc:1059] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:30.889407 18011 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:30.842979 19827 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.999505 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:30.956647 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 60173us
I20260709 12:10:30.891898 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:30.966457 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.197625 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:30.957091 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:31.134272 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 92231us
I20260709 12:10:30.852139 19586 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:31.247841 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:30.911887 17332 leader_election.cc:336] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.181s (SENT)
I20260709 12:10:31.250344 18011 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:31.248489 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.252599 17292 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:31.258692 17332 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:30.956382 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:31.250689 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:31.259390 17285 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:31.259613 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 347763us
I20260709 12:10:31.219031 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:31.263530 17365 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:31.264578 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.263657 17288 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.267269 17287 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:30.881043 19774 raft_consensus.cc:3055] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:31.190598 19862 consensus_meta.cc:287] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.523s	user 0.004s	sys 0.012s
I20260709 12:10:30.862809 19725 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.880776 19756 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:31.303304 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.208568 18009 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:30.967061 19906 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:10:31.274410 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.361717 17365 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:30.961925 19914 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:31.314209 17285 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:31.274791 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.301872 17283 raft_consensus.cc:2410] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:31.312925 17288 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:31.341472 17291 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
W20260709 12:10:30.965929 18007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 626) took 1480 ms (client timeout 1531 ms). Trace:
I20260709 12:10:31.134130 19916 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.357945 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:31.313495 19923 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:10:31.275115 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.970283 19829 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.936507 19899 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:30.889356 19889 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.216392 19779 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:31.290334 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:31.314749 19912 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:10:31.314033 19913 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:10:31.039173 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 623) took 1641 ms. Trace:
I20260709 12:10:31.377341 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:31.379136 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.382087 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.382537 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:31.401901 17361 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:31.401975 17291 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.303702 19826 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:10:30.893035 19867 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:30.974524 19744 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:31.386631 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:31.384253 19916 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:31.390576 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:31.425738 17288 raft_consensus.cc:2368] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5.
I20260709 12:10:31.426728 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:31.391765 17285 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:31.275028 19774 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:31.263744 19856 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:31.321024 19901 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:10:31.303926 19798 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 12:10:31.411744 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:30.889549 19860 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:31.415223 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:31.392588 19885 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:31.385108 19914 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:31.416316 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:31.392819 19889 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.498150 17291 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:31.360548 19862 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:31.361384 19848 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:10:31.423002 19756 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:31.422502 19879 consensus_meta.cc:287] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.651s	user 0.004s	sys 0.004s
I20260709 12:10:31.428300 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:31.427408 17288 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:31.421377 19894 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.750s	user 0.006s	sys 0.001s
I20260709 12:10:31.509865 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:31.511194 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:31.458673 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.443146 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:31.512493 17361 raft_consensus.cc:2410] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:31.371331 18007 rpcz_store.cc:269] 0709 12:10:29.485560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.586840 (+101280us) service_pool.cc:224] Handling call
0709 12:10:30.820406 (+1233566us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:30.964419 (+144013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29344128}
I20260709 12:10:31.474584 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.396411 19899 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:31.417053 17436 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:31.513051 17285 raft_consensus.cc:2393] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:31.511911 17289 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.493525 19723 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:31.427496 19744 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:31.523697 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:31.524343 17287 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:31.493851 19898 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.526768 17285 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:31.527238 17285 pending_rounds.cc:85] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 5
W20260709 12:10:31.525904 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 258790us
I20260709 12:10:31.527644 17285 pending_rounds.cc:107] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:31.527997 17285 raft_consensus.cc:2889] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:31.525051 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 166897us
I20260709 12:10:31.528618 19723 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:31.529083 17290 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:10:31.538312 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:31.541718 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:31.541249 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 73629.1us
I20260709 12:10:31.545436 17286 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:31.549036 17291 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:31.517424 19894 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:31.574826 19932 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:31.575520 17291 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:31.576771 17291 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:31.400808 18006 rpcz_store.cc:276] 0709 12:10:29.389005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.720425 (+331420us) service_pool.cc:224] Handling call
0709 12:10:30.387172 (+666747us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:30.387393 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.387613 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:30.570723 (+183110us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.843367 (+272644us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.883317 (+ 39950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.892679 (+  9362us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.956056 (+ 63377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.965022 (+  8966us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.030378 (+ 65356us) inbound_call.cc:177] Queueing success response
0709 12:10:31.147359 (+116981us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b180048ef80. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e3f3 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
Metrics: {"mutex_wait_us":22737,"prepare.queue_time_us":242702,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":46055,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":10655,"spinlock_wait_cycles":157758336,"thread_start_us":335541,"threads_started":2,"wal-append.queue_time_us":311288}
W20260709 12:10:31.579516 19919 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:10:31.581278 19924 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:31.557488 19898 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.582810 17333 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:31.582980 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2323) took 1180 ms. Trace:
I20260709 12:10:31.583740 19867 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:31.584475 19937 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:31.585072 19937 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.584414 19914 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:31.517154 19879 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:31.545148 19901 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.583367 17360 rpcz_store.cc:276] 0709 12:10:30.402447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.403544 (+  1097us) service_pool.cc:224] Handling call
0709 12:10:30.403851 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.555151 (+151300us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:30.703620 (+148469us) log.cc:844] Serialized 14 byte log entry
0709 12:10:31.199929 (+496309us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b180005c140. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2b455 00007f12295133c7 00007f1225b259a7 00007f1225b350bf 00007f1225b35038
0709 12:10:31.359602 (+159673us) log.cc:844] Serialized 14 byte log entry
0709 12:10:31.445685 (+ 86083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:31.445758 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:31.445817 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.581092 (+135275us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b180005c140. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e3f3 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
0709 12:10:31.582729 (+  1637us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000f50d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:31.582770 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.582922 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6832,"prepare.queue_time_us":15775,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":114146,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":4066,"spinlock_wait_cycles":384886272,"thread_start_us":379553,"threads_started":3,"wal-append.queue_time_us":176354}
I20260709 12:10:31.594441 17284 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:31.594734 19927 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:31.598644 17441 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:31.601352 17288 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:31.618810 19901 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:31.540032 19856 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:10:31.621157 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:31.542268 19885 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:10:31.622423 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:31.623008 17288 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:31.623803 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:31.603490 17291 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:31.625082 17291 pending_rounds.cc:85] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 2
I20260709 12:10:31.625190 17289 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:31.605935 19723 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:31.626601 19879 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:31.626258 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:31.627743 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:31.628417 19894 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:31.628780 17284 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:31.629503 19916 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:31.630479 19899 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:31.627322 17288 raft_consensus.cc:2376] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5. Re-sending same reply.
I20260709 12:10:31.620225 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1494) took 1031 ms. Trace:
I20260709 12:10:31.631495 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:31.632522 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:31.632779 17364 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:31.613575 17286 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:31.582856 19929 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:31.585431 19937 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.605469 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:31.518505 19774 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:31.632145 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:31.629328 19867 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:31.632375 17441 rpcz_store.cc:276] 0709 12:10:30.588448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.598049 (+1009601us) service_pool.cc:224] Handling call
0709 12:10:31.598447 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.619949 (+ 21502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.620165 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.625388 17291 pending_rounds.cc:107] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:31.635574 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:31.621097 19901 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:31.717378 17406 leader_election.cc:336] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.724s (SENT)
I20260709 12:10:31.665449 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:31.919991 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:31.920117 17363 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.911376 17364 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.653609 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1490) took 1066 ms. Trace:
I20260709 12:10:31.634088 19885 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:31.654706 19873 consensus_meta.cc:287] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.982s	user 0.008s	sys 0.007s
W20260709 12:10:31.651253 19897 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.971s	user 0.010s	sys 0.001s
I20260709 12:10:31.950291 19889 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:31.922255 19867 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.631232 19725 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:31.922803 19898 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.443895 19898 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:32.444384 19898 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.990468 19937 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:31.916004 19862 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:32.447044 17364 consensus_meta.cc:287] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.000s
I20260709 12:10:32.447572 17364 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:31.948729 19860 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:32.110021 17258 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53674 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:32.450960 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 424) took 1706 ms. Trace:
I20260709 12:10:32.451364 17284 rpcz_store.cc:276] 0709 12:10:30.744968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.745127 (+   159us) service_pool.cc:224] Handling call
0709 12:10:32.450802 (+1705675us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54002003d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:32.450902 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799342976}
I20260709 12:10:32.449085 17258 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53674 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2300)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2293)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2303)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2292)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1471)
I20260709 12:10:32.451241 19937 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:32.454697 19937 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.455150 19937 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.453842 17258 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2300)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2293)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2303)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2292)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1471)
I20260709 12:10:32.457240 19937 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:32.154964 19901 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.460196 19901 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:32.159047 19939 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.541s	user 0.002s	sys 0.001s
W20260709 12:10:32.161412 19941 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.544s	user 0.003s	sys 0.000s
I20260709 12:10:31.946617 19885 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:32.252161 19829 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:32.462734 19829 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:32.463279 17435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 394) took 5473 ms (client timeout 1751 ms). Trace:
I20260709 12:10:32.463526 19885 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:32.465713 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1489) took 1878 ms. Trace:
I20260709 12:10:32.466116 17440 rpcz_store.cc:276] 0709 12:10:30.587279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.657756 (+ 70477us) service_pool.cc:224] Handling call
0709 12:10:32.465509 (+1807753us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400115654. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:32.465642 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2856236800}
W20260709 12:10:32.262244 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.266664 19889 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:32.274662 19881 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:32.504241 19881 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.505336 17360 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:32.291831 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 594198us
W20260709 12:10:32.506819 17406 leader_election.cc:336] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.824s (SENT)
W20260709 12:10:32.296175 17292 consensus_meta.cc:287] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.892s	user 0.018s	sys 0.011s
I20260709 12:10:32.508368 17292 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:32.508936 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1418) took 1152 ms. Trace:
I20260709 12:10:32.509239 17292 rpcz_store.cc:276] 0709 12:10:31.356500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.356655 (+   155us) service_pool.cc:224] Handling call
0709 12:10:32.508871 (+1152216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.320611 19848 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:32.327996 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1411) took 1456 ms. Trace:
W20260709 12:10:32.332267 17287 consensus_meta.cc:287] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.805s	user 0.011s	sys 0.009s
I20260709 12:10:32.329932 17432 rpcz_store.cc:276] 0709 12:10:30.587517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.842497 (+254980us) service_pool.cc:224] Handling call
0709 12:10:30.842902 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.844238 (+  1336us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:30.888554 (+ 44316us) log.cc:844] Serialized 14 byte log entry
0709 12:10:31.228634 (+340080us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.266284 (+ 37650us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.266548 (+   264us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:31.266609 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.266733 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.653373 (+386640us) raft_consensus.cc:1685] finished
0709 12:10:31.653395 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.653542 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":404075,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":3235,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":17730,"thread_start_us":266313,"threads_started":2,"wal-append.queue_time_us":452925}
I20260709 12:10:31.658809 19777 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:32.357184 17363 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:32.363905 19867 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.963289 19897 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.512919 19777 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:32.513446 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.510167 19860 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:32.514245 19897 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:32.514026 19860 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:32.384917 18011 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.514896 19748 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:32.515424 19748 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.516196 19860 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:32.517432 19748 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:32.517647 19829 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.380110 17256 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2300)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2293)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2303)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2292)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1471)
I20260709 12:10:32.520147 19867 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.521382 19777 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:32.387313 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 781824us
I20260709 12:10:32.522251 19898 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.522855 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:31.729503 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 192878us
I20260709 12:10:32.523108 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:32.519960 17256 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2300)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2293)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2303)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2292)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 433)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 431)
I20260709 12:10:31.739303 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:32.526526 17361 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:31.635778 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.527848 17289 raft_consensus.cc:2410] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:32.402637 17286 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.529136 17287 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:32.529515 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1427) took 1136 ms. Trace:
I20260709 12:10:32.531095 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:32.531733 17361 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.532085 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:32.532896 18011 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:32.417199 17290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1409) took 1564 ms (client timeout 1905 ms). Trace:
W20260709 12:10:31.791651 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 133601us
I20260709 12:10:32.427078 19891 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:32.431807 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.439427 17365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.010s	sys 0.013s
W20260709 12:10:32.567334 17365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.011s	sys 0.014s
W20260709 12:10:32.502307 17978 leader_election.cc:336] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.627s (SENT)
I20260709 12:10:32.568109 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:32.568993 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 66719.8us
I20260709 12:10:32.510550 17283 rpcz_store.cc:276] 0709 12:10:30.871161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.871257 (+    96us) service_pool.cc:224] Handling call
0709 12:10:32.327717 (+1456460us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400200dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:32.327890 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945979136}
I20260709 12:10:32.510512 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:32.457882 17258 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53674 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2300)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2293)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2303)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2292)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1471)
I20260709 12:10:32.533576 18011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 631) took 1685 ms. Trace:
I20260709 12:10:32.571333 18011 rpcz_store.cc:276] 0709 12:10:30.863498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.865514 (+  2016us) service_pool.cc:224] Handling call
0709 12:10:30.865823 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.384606 (+1518783us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5800440fd0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225a770aa 00007f1225af9447 00007f1225b11fe7 00007f1225b137de 00007f1225b1db49 00007f1225b1e416 00007f1225b1ad8f 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4
0709 12:10:32.533305 (+148699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.533515 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584115200}
I20260709 12:10:32.537631 17360 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:32.541436 19885 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.542724 19898 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:32.542881 19937 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:32.519965 19829 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:32.529709 17287 rpcz_store.cc:276] 0709 12:10:31.393325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.523364 (+130039us) service_pool.cc:224] Handling call
0709 12:10:32.529472 (+1006108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.534686 17290 rpcz_store.cc:269] 0709 12:10:30.870377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.880107 (+  9730us) service_pool.cc:224] Handling call
0709 12:10:32.416992 (+1536885us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54000b8954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:32.417130 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637943680}
I20260709 12:10:32.526394 17256 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2300)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2293)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2303)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2292)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 431)
W20260709 12:10:32.548890 17332 connection.cc:256] RPC call timeout handler was delayed by -1.1331584949998614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 12:10:32.502152 19922 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.349s	user 0.002s	sys 0.003s
I20260709 12:10:32.558568 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:32.612010 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 53537.2us
I20260709 12:10:32.525548 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:32.560650 17361 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:32.463784 17435 rpcz_store.cc:269] 0709 12:10:26.990273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.993480 (+  3207us) service_pool.cc:224] Handling call
0709 12:10:32.463042 (+5469562us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b540006e354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:32.463174 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6035422592}
I20260709 12:10:32.541965 19901 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.533501 19641 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.546267 19400 raft_consensus.cc:3055] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.546865 19891 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:32.618706 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.625635 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.626689 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.619692 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.627386 17283 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 1.
I20260709 12:10:32.617717 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.628345 17290 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:32.574940 19885 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:32.619813 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:32.567093 19867 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:32.623737 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:32.633685 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:32.635105 17404 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:32.637612 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:32.614610 19897 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.639994 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.648380 17283 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:32.640760 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.651011 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.651696 17290 raft_consensus.cc:2376] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6. Re-sending same reply.
I20260709 12:10:32.642338 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:32.557116 19848 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:32.659031 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.652761 17361 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:32.659423 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.660775 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:32.661371 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:32.661962 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:32.662124 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.662407 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:32.622020 19898 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:32.646090 19891 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.621073 19860 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.662999 17367 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.619652 19901 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:32.645759 19777 consensus_queue.cc:1059] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:32.662642 17287 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:32.659741 19751 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:32.666718 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.662618 17362 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:32.620752 19400 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:10:32.671512 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 51804.8us
I20260709 12:10:32.594692 19894 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.673056 17361 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:32.631875 19879 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.631765 19885 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.619395 19829 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:32.623871 19641 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.665846 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.733465 17283 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:32.708763 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:32.734319 17437 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.697783 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:32.717732 17433 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: [3.3-6.4]
I20260709 12:10:32.717559 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.735860 17287 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:32.736745 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.737344 17287 raft_consensus.cc:2376] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6. Re-sending same reply.
I20260709 12:10:32.726812 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:32.738196 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.647049 19566 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:32.659559 19725 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:32.704460 17332 leader_election.cc:336] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.587s (SENT)
W20260709 12:10:32.740749 17332 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.589s (SENT)
I20260709 12:10:32.741158 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:32.723630 17290 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:32.660202 19756 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.728022 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:32.663872 19955 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.695058 19820 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:32.766999 17332 leader_election.cc:336] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.189s (SENT)
I20260709 12:10:32.767418 17367 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:32.694525 19860 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.696851 19901 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.744551 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.745756 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.718288 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:32.665364 19897 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.724165 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:32.742460 17438 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:10:32.729247 19891 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.763882 17285 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.762876 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.741209 19867 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.770640 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:32.698061 19898 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:32.814694 19952 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:10:32.770740 17283 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:32.769662 17437 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:32.771862 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:32.817055 17439 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.730963 19879 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:32.777583 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:32.800525 19957 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:32.729712 19932 consensus_queue.cc:1059] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:10:32.802704 17287 raft_consensus.cc:2376] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3. Re-sending same reply.
I20260709 12:10:32.844229 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1449) took 1041 ms. Trace:
I20260709 12:10:32.724795 19889 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.771231 17290 raft_consensus.cc:2368] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6.
I20260709 12:10:32.766508 19955 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:32.770138 19725 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:32.769870 19909 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.745240 19566 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.776955 19860 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.816109 17258 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53674 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2293)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1454)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2317)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2303)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2310)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1455)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2315)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2292)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1475)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 431)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2326)
W20260709 12:10:32.837452 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 311927us
I20260709 12:10:32.841491 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.863423 17283 raft_consensus.cc:2410] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:32.864279 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.864981 17283 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:32.844570 17287 rpcz_store.cc:276] 0709 12:10:31.802623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.762605 (+959982us) service_pool.cc:224] Handling call
0709 12:10:32.844159 (+ 81554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.840293 19879 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.788582 19756 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:32.870997 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.860514 17439 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:32.861109 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.872761 17290 raft_consensus.cc:2410] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:32.861622 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 195314us
I20260709 12:10:32.865726 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.874446 17287 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:10:32.822170 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 46284.9us
I20260709 12:10:32.777603 19820 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.818202 17435 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:10:32.845120 19748 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:32.882006 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.886994 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.887449 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.887472 17287 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:32.887846 17290 raft_consensus.cc:2368] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5.
I20260709 12:10:32.888257 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1463) took 1079 ms. Trace:
I20260709 12:10:32.888372 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1451) took 1085 ms. Trace:
I20260709 12:10:32.888628 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.889066 17290 rpcz_store.cc:276] 0709 12:10:31.803347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.886734 (+1083387us) service_pool.cc:224] Handling call
0709 12:10:32.888313 (+  1579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.847715 19955 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.888598 17283 rpcz_store.cc:276] 0709 12:10:31.808542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.887217 (+1078675us) service_pool.cc:224] Handling call
0709 12:10:32.888205 (+   988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.890141 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:32.893051 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 127931us
W20260709 12:10:31.922426 19723 consensus_queue.cc:1175] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaafaad0810b4e95983d2d73ec814346" responder_term: 3 status { last_received { term: 3 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 3 index: 4 } }
I20260709 12:10:32.891047 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:32.862887 19881 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:32.893850 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.895567 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:32.896234 17287 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:32.898813 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.899596 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1469) took 1089 ms. Trace:
I20260709 12:10:32.899904 17287 rpcz_store.cc:276] 0709 12:10:31.810010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.898543 (+1088533us) service_pool.cc:224] Handling call
0709 12:10:32.899539 (+   996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.900377 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1460) took 1092 ms. Trace:
W20260709 12:10:32.884449 17406 leader_election.cc:336] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.813s (SENT)
I20260709 12:10:32.821487 19867 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.900862 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.906811 17283 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:32.910171 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:32.902168 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.900794 17290 rpcz_store.cc:276] 0709 12:10:31.807827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.889866 (+1082039us) service_pool.cc:224] Handling call
0709 12:10:32.900311 (+ 10445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.913321 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.914158 17290 raft_consensus.cc:2410] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:32.857893 19889 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:32.921062 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.922034 17290 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:32.916473 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1452) took 1112 ms. Trace:
I20260709 12:10:32.923760 17439 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.923508 17283 rpcz_store.cc:276] 0709 12:10:31.803589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.893600 (+1090011us) service_pool.cc:224] Handling call
0709 12:10:32.916408 (+ 22808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.924793 19756 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:32.925339 17437 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:32.928807 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2329) took 1298 ms. Trace:
I20260709 12:10:32.929239 17360 rpcz_store.cc:276] 0709 12:10:31.629920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.631936 (+  2016us) service_pool.cc:224] Handling call
0709 12:10:32.928598 (+1296662us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b54003c4954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:32.928715 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184471296}
I20260709 12:10:32.920634 17978 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:32.892084 19748 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:32.930931 17404 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:32.930588 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.937263 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.911293 19909 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.940869 17290 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:32.915659 19862 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.886966 19751 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:32.940240 17283 raft_consensus.cc:2410] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:32.959867 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1453) took 1156 ms. Trace:
I20260709 12:10:32.960235 17283 rpcz_store.cc:276] 0709 12:10:31.803833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.930075 (+1126242us) service_pool.cc:224] Handling call
0709 12:10:32.959800 (+ 29725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.961190 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:32.947997 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.948812 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:32.951885 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:32.953073 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:32.932416 19958 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.954334 19864 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.957682 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:32.947305 19909 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.967988 17283 raft_consensus.cc:2368] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5.
I20260709 12:10:32.980387 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.969238 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:32.981560 18011 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:32.954259 19932 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:32.941222 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:32.951013 19848 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:32.949702 19894 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.984058 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.975250 19963 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.985597 18008 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEARNER]: Advancing to term 6
I20260709 12:10:32.987946 18015 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:32.969585 17221 debug-util.cc:398] Leaking SignalData structure 0x7b08000355a0 after lost signal to thread 16125
W20260709 12:10:32.997223 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800035580 after lost signal to thread 16128
I20260709 12:10:32.969841 17358 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:32.997740 17221 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5ba0 after lost signal to thread 17187
I20260709 12:10:32.993043 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.998787 17283 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:33.013460 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:33.014475 18011 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:32.974006 19898 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:32.984026 19909 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.966236 17434 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:33.061554 17434 pending_rounds.cc:85] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 5
I20260709 12:10:33.056741 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:32.930402 19725 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:32.983000 19932 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:32.978145 19864 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:33.075109 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.035638 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.079061 17290 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:33.063431 17434 pending_rounds.cc:107] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:33.080142 17434 raft_consensus.cc:2889] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.064270 18010 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.082038 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:33.067395 19901 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:33.063566 17283 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:32.996953 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:33.089226 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.060771 19965 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:33.102496 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.105425 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.109207 17283 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:33.081720 19932 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.062434 19897 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:33.003225 19894 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.110234 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.130919 17283 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:33.132037 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:33.113389 19960 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:10:33.114605 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.115964 19829 consensus_queue.cc:1059] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:33.119903 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:33.121266 17291 raft_consensus.cc:2889] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:33.122054 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800035280 after lost signal to thread 17224
I20260709 12:10:33.122700 19889 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:33.123162 19756 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:33.111470 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.136171 17284 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:33.138635 17283 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:33.138890 17284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1464) took 1330 ms (client timeout 1587 ms). Trace:
W20260709 12:10:33.139569 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800091660 after lost signal to thread 17244
W20260709 12:10:33.139370 17284 rpcz_store.cc:269] 0709 12:10:31.808779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.114384 (+1305605us) service_pool.cc:224] Handling call
0709 12:10:33.138831 (+ 24447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.081444 19748 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.144279 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.145249 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1455) took 1338 ms. Trace:
I20260709 12:10:33.145568 17283 rpcz_store.cc:276] 0709 12:10:31.806553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.143970 (+1337417us) service_pool.cc:224] Handling call
0709 12:10:33.145181 (+  1211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.146477 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.147079 17283 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:33.147910 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.148401 17283 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.152947 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.132529 19897 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.132071 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:33.164459 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.165481 17290 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.167269 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.168565 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.169732 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.170323 17284 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.152426 19889 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.162000 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1436) took 1559 ms. Trace:
I20260709 12:10:33.179086 17291 rpcz_store.cc:276] 0709 12:10:31.602673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.602863 (+   190us) service_pool.cc:224] Handling call
0709 12:10:31.603152 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.161703 (+1558551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.161939 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.180588 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.181834 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.182515 17291 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:33.106340 19965 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:33.161015 17258 connection.cc:256] RPC call timeout handler was delayed by -2.7413951809999162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 12:10:33.155668 19566 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:33.134661 19826 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:33.151742 19867 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:33.127590 19751 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.186164 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.191943 17284 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:33.192076 17291 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:10:33.184130 17258 connection.cc:256] RPC call timeout handler was delayed by -2.6873951809998289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 12:10:33.192903 17258 connection.cc:256] RPC call timeout handler was delayed by -2.6180951809997168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 12:10:33.193054 17283 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:33.193292 17258 connection.cc:256] RPC call timeout handler was delayed by -2.5577951809998467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 12:10:33.166772 19820 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:33.193608 17258 connection.cc:256] RPC call timeout handler was delayed by -2.4074951809998311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 12:10:33.193904 17258 connection.cc:256] RPC call timeout handler was delayed by -2.37599518099978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 12:10:33.194250 17258 connection.cc:256] RPC call timeout handler was delayed by -2.3417951809997248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:10:33.194555 17258 connection.cc:256] RPC call timeout handler was delayed by -2.2256951809997645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 12:10:33.194859 17258 connection.cc:256] RPC call timeout handler was delayed by -2.1968951809997179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 12:10:33.195137 17258 connection.cc:256] RPC call timeout handler was delayed by -2.0834951809997619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 12:10:33.195418 17258 connection.cc:256] RPC call timeout handler was delayed by -2.0258951809998962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22970000000000002s for a response
W20260709 12:10:33.195681 17258 connection.cc:256] RPC call timeout handler was delayed by -1.6442951809997339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2721s for a response
W20260709 12:10:33.195950 17258 connection.cc:256] RPC call timeout handler was delayed by -1.5470951809998041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28290000000000004s for a response
I20260709 12:10:33.197000 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:33.197157 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.193993 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.198576 17283 raft_consensus.cc:2368] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7.
I20260709 12:10:33.199023 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1456) took 1392 ms. Trace:
I20260709 12:10:33.199342 17283 rpcz_store.cc:276] 0709 12:10:31.806805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.193737 (+1386932us) service_pool.cc:224] Handling call
0709 12:10:33.198953 (+  5216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.200346 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.151548 19864 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.186060 19889 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.171905 19897 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:33.210368 19889 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:33.210678 19897 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:33.212862 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.213879 17291 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:33.214370 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2297) took 1107 ms. Trace:
I20260709 12:10:33.214705 17291 rpcz_store.cc:276] 0709 12:10:32.106639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.212534 (+1105895us) service_pool.cc:224] Handling call
0709 12:10:33.214298 (+  1764us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:33.215548 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 154866us
I20260709 12:10:33.215994 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.216704 17291 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:33.201006 17290 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:33.218631 19894 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:33.223358 19965 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:33.225971 19860 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:33.228188 19897 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.201098 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1467) took 1391 ms. Trace:
I20260709 12:10:33.238569 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.240162 17284 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.197883 19958 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:10:33.241149 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 44218.1us
I20260709 12:10:33.244719 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.247731 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:33.249974 17258 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:33.241627 17283 rpcz_store.cc:276] 0709 12:10:31.809500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.200048 (+1390548us) service_pool.cc:224] Handling call
0709 12:10:33.201037 (+   989us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.252496 17258 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:33.240919 19897 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:33.242231 19970 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:10:33.254841 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.241780 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:33.256153 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:33.247555 17290 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:33.263200 17283 raft_consensus.cc:2376] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9. Re-sending same reply.
I20260709 12:10:33.258942 17287 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:33.263906 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1466) took 1454 ms. Trace:
I20260709 12:10:33.263649 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2292) took 1158 ms. Trace:
I20260709 12:10:33.273129 17283 rpcz_store.cc:276] 0709 12:10:31.809265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.254567 (+1445302us) service_pool.cc:224] Handling call
0709 12:10:33.263841 (+  9274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.275427 17284 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:33.276487 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.265583 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:33.281478 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.284495 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.251573 19916 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.288666 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.289116 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.291549 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:33.293586 17437 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.289460 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:33.289614 17432 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:33.302207 17284 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:33.264619 17290 rpcz_store.cc:276] 0709 12:10:32.105289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.243938 (+1138649us) service_pool.cc:224] Handling call
0709 12:10:33.263579 (+ 19641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.257196 19889 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.262205 19897 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.292891 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.323161 17283 raft_consensus.cc:2410] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:33.267782 19891 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.293031 19901 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:33.296037 17288 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:33.325625 17288 pending_rounds.cc:85] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 6
I20260709 12:10:33.325896 17288 pending_rounds.cc:107] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:33.326152 17288 raft_consensus.cc:2889] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.298593 19955 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:33.300016 17332 leader_election.cc:336] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 3.564s (SENT)
I20260709 12:10:33.326982 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:33.307096 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.311736 17437 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:33.327981 17290 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:33.320979 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.290877 19795 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.292346 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.324407 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1475) took 1220 ms. Trace:
I20260709 12:10:33.329496 17283 rpcz_store.cc:276] 0709 12:10:32.104262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.292652 (+1188390us) service_pool.cc:224] Handling call
0709 12:10:33.324341 (+ 31689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.330183 17440 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:33.330506 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.331254 17283 raft_consensus.cc:2393] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:33.329073 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.332520 17283 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:33.332890 17290 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.333112 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1447) took 1593 ms. Trace:
I20260709 12:10:33.333748 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1471) took 1230 ms. Trace:
I20260709 12:10:33.334517 17290 rpcz_store.cc:276] 0709 12:10:32.103033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.332400 (+1229367us) service_pool.cc:224] Handling call
0709 12:10:33.332660 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.333519 (+   859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.333693 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.333521 17283 rpcz_store.cc:276] 0709 12:10:31.739429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.331921 (+1592492us) service_pool.cc:224] Handling call
0709 12:10:33.332228 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.332873 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.333052 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.331084 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:33.342969 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.319528 19980 raft_consensus.cc:2764] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:33.319974 19916 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.359889 19955 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:33.326685 19958 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.362417 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:33.363169 18010 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:33.364447 18010 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:33.367862 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1454) took 1561 ms. Trace:
I20260709 12:10:33.368302 17287 rpcz_store.cc:276] 0709 12:10:31.806232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.900601 (+1094369us) service_pool.cc:224] Handling call
0709 12:10:33.367673 (+467072us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54000b7554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:33.367791 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802520960}
I20260709 12:10:33.370270 18007 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:33.371970 18007 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:33.345528 17286 raft_consensus.cc:2368] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6.
I20260709 12:10:33.373610 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:33.374295 17286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1450) took 1571 ms (client timeout 1658 ms). Trace:
I20260709 12:10:33.301630 19879 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.349802 19860 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:33.374749 17286 rpcz_store.cc:269] 0709 12:10:31.803078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.332971 (+1529893us) service_pool.cc:224] Handling call
0709 12:10:33.374225 (+ 41254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280}
W20260709 12:10:33.376749 17221 debug-util.cc:398] Leaking SignalData structure 0x7b08003a02c0 after lost signal to thread 17316
W20260709 12:10:33.377110 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800035e60 after lost signal to thread 17317
I20260709 12:10:33.378551 17286 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 3. Current term is 4. Ops: [1.3-3.4]
I20260709 12:10:33.380071 17286 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:33.380198 19879 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:33.354393 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.375432 19751 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.383721 19751 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.357625 19641 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:33.387229 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1440) took 1782 ms. Trace:
I20260709 12:10:33.377866 17287 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.358232 17435 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:33.374325 17291 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:33.365980 18010 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:33.353230 19909 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.389066 18013 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:33.398378 17255 connection.cc:256] RPC call timeout handler was delayed by -1.2600988400001825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
I20260709 12:10:33.402637 17255 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:33.378476 19885 consensus_meta.cc:287] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.003s
W20260709 12:10:33.399292 17292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1465) took 1590 ms (client timeout 1509 ms). Trace:
I20260709 12:10:33.396166 19932 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.385928 19751 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:33.396710 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:33.410089 18006 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:33.387679 17288 rpcz_store.cc:276] 0709 12:10:31.604956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.676104 (+ 71148us) service_pool.cc:224] Handling call
0709 12:10:33.295655 (+1619551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.329529 (+ 33874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.387017 (+ 57488us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400200dd0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:33.387159 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3723597568}
I20260709 12:10:33.389214 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2332) took 1758 ms. Trace:
I20260709 12:10:33.411177 17366 rpcz_store.cc:276] 0709 12:10:31.630779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.631770 (+   991us) service_pool.cc:224] Handling call
0709 12:10:31.911156 (+279386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.522127 (+610971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.522156 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:32.522654 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:10:32.595893 (+ 73239us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:32.595941 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.388817 (+792876us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b540014e954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:33.388868 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.388914 (+    46us) raft_consensus.cc:1685] finished
0709 12:10:33.388927 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.389139 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404460800,"thread_start_us":72829,"threads_started":1,"wal-append.queue_time_us":73185}
W20260709 12:10:33.401000 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 111671us
I20260709 12:10:33.404312 18014 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:33.405181 19909 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:33.406785 17292 rpcz_store.cc:269] 0709 12:10:31.809014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.399058 (+1590044us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:33.399202 (+   144us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:33.418294 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:33.419085 17363 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:33.423374 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:33.424166 17360 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.415786 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:33.406301 19885 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:33.433759 17360 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:10:33.436807 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800335ae0 after lost signal to thread 17391
I20260709 12:10:33.437237 18011 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:10:33.438154 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800054980 after lost signal to thread 17465
I20260709 12:10:33.438359 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:33.438529 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800360920 after lost signal to thread 17466
I20260709 12:10:33.439818 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:33.439818 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800326ec0 after lost signal to thread 18039
W20260709 12:10:33.440755 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800250a80 after lost signal to thread 18040
W20260709 12:10:33.441051 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800336bc0 after lost signal to thread 19563
W20260709 12:10:33.441293 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800356bc0 after lost signal to thread 19586
I20260709 12:10:33.414724 19980 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:33.442493 17221 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4300 after lost signal to thread 19805
I20260709 12:10:33.442953 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:33.410982 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:33.443593 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800398f00 after lost signal to thread 19830
I20260709 12:10:33.445992 17436 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.442823 19860 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.444128 19748 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.448993 19860 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.449215 19748 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:33.448518 17289 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1458) took 1641 ms (client timeout 1589 ms). Trace:
W20260709 12:10:33.451619 17289 rpcz_store.cc:269] 0709 12:10:31.807306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.448316 (+1641010us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:33.448450 (+   134us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:33.431311 19897 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:33.454771 19889 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.446259 19980 raft_consensus.cc:697] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:33.452865 19860 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.450225 19748 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:33.471706 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800393480 after lost signal to thread 19878
I20260709 12:10:33.489094 19774 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:33.491616 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.006s	sys 0.005s
W20260709 12:10:33.492002 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.006s	sys 0.005s
W20260709 12:10:33.492550 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 982044us
I20260709 12:10:33.495627 19744 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:33.501458 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1431) took 2064 ms. Trace:
I20260709 12:10:33.501917 17285 rpcz_store.cc:276] 0709 12:10:31.436990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.538668 (+101678us) service_pool.cc:224] Handling call
0709 12:10:31.539042 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.802292 (+1263250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.501210 (+698918us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540043dad4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:33.501392 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816382720}
I20260709 12:10:33.503255 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:33.506531 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.511039 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 68388.6us
I20260709 12:10:33.513444 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:33.515816 17407 connection.cc:256] RPC call timeout handler was delayed by -1.2874775360000967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 12:10:33.514158 19986 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 12:10:33.534850 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.537037 19986 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:33.523931 17407 connection.cc:256] RPC call timeout handler was delayed by -1.1704775360001349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260709 12:10:33.540405 19980 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.544868 19885 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:33.511736 19891 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:33.513849 19988 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:10:33.555296 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.549312 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:33.552389 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.553553 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.547051 19932 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:33.554522 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.559379 17432 raft_consensus.cc:2410] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:33.562325 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.565021 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.523345 19667 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:33.548265 19795 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.555425 19864 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.570119 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.571184 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.572885 17285 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.574469 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.575193 17286 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:33.577167 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.578902 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:33.580538 17283 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:33.580778 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.582491 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.586009 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:33.586313 19937 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.591674 19937 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.594051 19937 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:33.620174 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 126947us
I20260709 12:10:33.620997 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:33.621243 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 431) took 1102 ms. Trace:
I20260709 12:10:33.621491 19400 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.622985 19400 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.623888 19744 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:33.624385 19744 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:33.624778 19744 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.588224 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.588500 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.589573 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.590147 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.590240 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.590970 19777 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.587008 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.638638 17286 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:33.599100 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:33.621589 17283 rpcz_store.cc:276] 0709 12:10:32.519061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.335539 (+816478us) service_pool.cc:224] Handling call
0709 12:10:33.580047 (+244508us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b58000b0498. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:33.580235 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.620979 (+ 40744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.621178 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6175104}
I20260709 12:10:33.639863 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:33.640942 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:33.599947 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:33.601114 17361 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:33.601977 17362 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:33.602591 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:33.622851 17980 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:33.643110 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:33.603345 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:33.604185 19894 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:33.604414 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:33.590767 19954 raft_consensus.cc:3055] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:33.643970 17364 raft_consensus.cc:2410] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:10:33.644585 19954 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:33.645490 17364 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.643953 19827 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:33.604238 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 304221us
I20260709 12:10:33.646235 19827 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:33.647236 19827 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.650285 19881 consensus_queue.cc:1059] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:33.651278 19881 consensus_queue.cc:1059] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:33.652361 19881 raft_consensus.cc:3055] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:33.652763 19881 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:33.653362 17360 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:33.654311 19848 raft_consensus.cc:3055] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:33.654737 19848 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:33.655553 19848 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.656570 17360 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:33.656857 19848 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.574385 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.661036 17359 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:33.644312 19894 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:33.662884 19894 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.664253 19894 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.605572 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.606686 19901 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.609175 17290 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:33.668176 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 435) took 1060 ms. Trace:
I20260709 12:10:33.668530 17290 rpcz_store.cc:276] 0709 12:10:32.607494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.335966 (+728472us) service_pool.cc:224] Handling call
0709 12:10:33.608623 (+272657us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b58000b0498. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:33.608830 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.667908 (+ 59078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.668115 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5383424}
W20260709 12:10:33.610965 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 267165us
I20260709 12:10:33.669481 19744 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.669907 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:33.671736 19744 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:33.672278 17333 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:33.611498 19798 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:33.675231 19777 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:33.677184 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:33.679515 19897 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:33.680378 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:33.681284 17435 raft_consensus.cc:2410] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:10:33.571647 19991 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.682721 19991 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:33.683380 17366 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:33.598287 19898 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:33.684079 19898 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:33.686496 19964 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:33.687439 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.613945 17367 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.688740 19864 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.682916 19860 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.702059 17285 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:33.689064 17362 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:10:33.698549 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49308.4us
I20260709 12:10:33.673725 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:33.706562 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 63167us
I20260709 12:10:33.645539 19954 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:33.708688 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:33.714684 17362 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:33.729267 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 143352us
I20260709 12:10:33.673957 17188 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55928 (request call id 324) took 8526 ms. Trace:
I20260709 12:10:33.750890 19897 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.515650 19916 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.196s
W20260709 12:10:33.762447 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 546117us
I20260709 12:10:33.763541 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:33.764973 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 120955us
W20260709 12:10:33.765580 17406 leader_election.cc:336] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.531s (SENT)
I20260709 12:10:33.706079 19898 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:33.653595 19881 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:33.764578 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2337) took 2013 ms. Trace:
I20260709 12:10:33.705444 19964 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:33.784749 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 74814.7us
I20260709 12:10:33.568938 19667 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:33.640933 17186 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 5, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 5 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:33.793975 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 62431.1us
I20260709 12:10:33.787665 17365 rpcz_store.cc:276] 0709 12:10:31.750908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.751109 (+   201us) service_pool.cc:224] Handling call
0709 12:10:31.751474 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.751709 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:31.758887 (+  7178us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.776346 (+1017459us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.581612 (+805266us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800156f40. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f1222a30a40 00007f1222a2b4e4 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:10:33.764238 (+182626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.764290 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:33.764333 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.764397 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.764515 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":799545,"prepare.queue_time_us":175357,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":87,"raft.queue_time_us":994120,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":15229,"spinlock_wait_cycles":32748800,"thread_start_us":1199146,"threads_started":4,"wal-append.queue_time_us":226975}
W20260709 12:10:33.800422 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 126757us
I20260709 12:10:33.801294 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:33.721520 19710 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.742027 17188 rpcz_store.cc:276] 0709 12:10:25.155839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.165695 (+  9856us) service_pool.cc:224] Handling call
0709 12:10:33.673867 (+8508172us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:28.570801 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:28.571437 (+   636us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:28.571497 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:10:28.571516 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:28.575226 (+  3710us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:28.575328 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:28.575355 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:10:28.576625 (+  1270us) tablet.cc:701] Row locks acquired
0709 12:10:28.576657 (+    32us) write_op.cc:260] PREPARE: finished
0709 12:10:28.598502 (+ 21845us) write_op.cc:270] Start()
0709 12:10:28.617709 (+ 19207us) write_op.cc:276] Timestamp: P: 1783599028576777 usec, L: 0
0709 12:10:28.617744 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:10:28.618544 (+   800us) log.cc:844] Serialized 6695 byte log entry
0709 12:10:29.062787 (+444243us) op_driver.cc:464] REPLICATION: finished
0709 12:10:29.353811 (+291024us) write_op.cc:301] APPLY: starting
0709 12:10:29.367732 (+ 13921us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:29.403366 (+ 35634us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:29.403498 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:29.873493 (+469995us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:29.874001 (+   508us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:10:29.874053 (+    52us) write_op.cc:312] APPLY: finished
0709 12:10:29.974316 (+100263us) log.cc:844] Serialized 113 byte log entry
0709 12:10:29.974552 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:29.974705 (+   153us) write_op.cc:454] Released schema lock
0709 12:10:29.974775 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:29.975260 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:29.975286 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":206276,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":253348,"apply.run_cpu_time_us":6597,"apply.run_wall_time_us":635774,"num_ops":16,"prepare.queue_time_us":624786,"prepare.run_cpu_time_us":18109,"prepare.run_wall_time_us":401227,"raft.queue_time_us":80882,"raft.run_cpu_time_us":16966,"raft.run_wall_time_us":167104,"replication_time_us":444866,"thread_start_us":1138648,"threads_started":4,"wal-append.queue_time_us":336588,"wal-append.run_cpu_time_us":19727,"wal-append.run_wall_time_us":2029342}]]}
I20260709 12:10:33.751672 19748 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:33.813360 17406 leader_election.cc:336] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53674 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:33.822263 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:33.827306 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:33.721470 19974 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:10:33.689203 19991 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:33.791836 19980 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.814779 19953 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:33.833797 17406 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:33.834259 18006 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:33.834589 19909 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.835150 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:33.871637 18014 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:33.835325 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:33.836220 18010 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.835978 19964 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:33.793905 19827 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:33.786659 17436 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
W20260709 12:10:33.877089 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 72127.6us
I20260709 12:10:33.839852 19667 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:33.840432 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:33.841815 19860 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:33.920396 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:33.844475 19774 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:33.845345 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:33.795745 17186 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65), VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66), VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67), VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 3 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:10:33.924548 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 148043us
I20260709 12:10:33.829437 19898 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.847792 19864 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:33.848034 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:33.803227 20011 consensus_queue.cc:1175] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e860f7e876b74ec589f447737822a4f6" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:10:33.751556 19897 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.823594 19748 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.848905 19777 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:33.812044 19942 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:33.793879 19995 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:10:33.850632 17434 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:33.850909 20009 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:33.828895 19798 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:33.805330 20003 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.866875 19953 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:33.880204 17978 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:33.838848 19916 consensus_queue.cc:1059] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:33.890743 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1503) took 1181 ms. Trace:
I20260709 12:10:33.870577 19980 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.900892 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:33.904495 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.852617 19710 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:33.915735 17406 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:33.926519 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.926791 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:33.927083 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 222774us
I20260709 12:10:33.929742 18013 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:33.925549 17186 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 6 to 8, now has a pending config: VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65), VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66), VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67), VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 8 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:33.930573 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.931351 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.867112 19744 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:33.937291 17288 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.942994 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.944602 19889 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:10:33.945886 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 126808us
I20260709 12:10:33.947325 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:33.876302 19909 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:33.951732 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.940050 19774 consensus_queue.cc:1243] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer 868a5e341d0a41b4ac0927342c8cd598 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:33.940322 19748 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:33.955214 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:33.955534 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:33.936813 19898 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:34.121250 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:33.963708 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:34.122203 19898 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.122689 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.122890 17441 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:34.123147 19953 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:34.123802 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:33.944284 19860 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.945462 19723 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.124980 19723 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.125190 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.127153 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:34.129110 17285 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:34.081991 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.948580 19901 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.130659 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:33.965216 17292 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:33.951592 19942 consensus_queue.cc:1243] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer e860f7e876b74ec589f447737822a4f6 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:34.128392 17286 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.134975 19980 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:34.137372 19756 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.128113 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:34.139783 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 134549us
I20260709 12:10:34.138003 17291 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:34.127518 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 211863us
I20260709 12:10:34.148515 17363 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:34.149089 17365 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:33.939706 19777 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:34.129191 19710 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.142158 19891 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.150400 17406 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:34.133093 19860 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:34.142081 20021 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:34.152266 19756 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.147008 17440 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:33.963189 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:34.148623 17364 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:34.150079 19777 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.150856 19891 raft_consensus.cc:3055] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.959928 17436 rpcz_store.cc:276] 0709 12:10:32.709585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.717069 (+  7484us) service_pool.cc:224] Handling call
0709 12:10:33.410868 (+693799us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6f8c 00007f12229f6ef6 000000000036eb39 00007f122aa6a1e0 00007f122ab330c4 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:33.890668 (+479800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14967680}
I20260709 12:10:34.124608 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:34.124466 18014 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:34.232348 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:34.233645 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.173846 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.157763 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:34.183949 18015 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:34.076104 17439 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.234810 18014 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:34.187292 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:34.235352 17285 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:34.234956 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 77288.2us
I20260709 12:10:34.237735 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:34.239393 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:34.239961 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.240736 18013 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:34.223666 17287 raft_consensus.cc:2376] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4. Re-sending same reply.
I20260709 12:10:34.242334 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:34.243244 20016 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.243438 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:34.244061 17286 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:34.244531 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:34.245252 17289 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:34.245888 19751 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.246403 19916 consensus_queue.cc:1059] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:34.247035 17406 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:34.277341 18012 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.245383 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:34.242415 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.241500 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:34.163157 19848 consensus_meta.cc:287] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.002s
I20260709 12:10:34.246423 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:34.238073 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:34.280478 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 329670us
I20260709 12:10:34.287016 18014 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:34.295540 18014 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:34.297150 17291 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:34.006645 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:34.298568 17284 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:34.293550 17289 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.097802 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 302099us
W20260709 12:10:34.292702 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 214859us
I20260709 12:10:34.127183 17290 raft_consensus.cc:2393] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:34.313539 17285 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:34.230903 19891 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:34.319933 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.335965 18012 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
W20260709 12:10:34.346792 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47886.1us
I20260709 12:10:34.349835 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:34.367396 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 88990.2us
I20260709 12:10:34.368261 18011 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:34.276463 20016 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:34.319599 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 439456us
I20260709 12:10:34.026543 20000 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.127382 20022 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.150s
I20260709 12:10:34.246940 19798 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:10:34.286536 19774 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.262133 19751 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:34.331476 19909 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:34.378293 17289 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:34.384745 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:34.247645 19995 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:10:34.248413 19980 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:10:34.396360 17980 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:34.375918 19958 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.318045 17186 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 4 to 5, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 5 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:34.428185 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 252521us
I20260709 12:10:34.432927 17186 catalog_manager.cc:5697] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 2 to 7, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 7 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.435633 20013 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:34.436223 19774 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:34.438194 19827 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.438720 19942 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.440675 20020 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:34.428680 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:34.447923 17332 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:34.430684 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 306200us
W20260709 12:10:34.431281 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 84070.6us
I20260709 12:10:34.466125 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:34.467350 17407 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:34.452476 17186 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 5 to 6, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 6 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.419785 19751 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.468466 19905 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:34.421414 20001 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:34.382851 20000 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.433264 19980 consensus_queue.cc:1243] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer aaafaad0810b4e95983d2d73ec814346 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:34.463788 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:34.478868 17980 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:34.487187 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:34.475260 19905 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:34.427894 20018 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:10:34.451628 19964 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:34.495918 17439 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:34.457217 19848 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:34.472460 20017 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:34.476325 20000 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.460927 20021 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:34.481261 20028 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.460642 20019 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:10:34.475257 19723 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:34.481470 19897 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:34.494602 20002 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.558172 20002 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:34.471244 17186 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:34.494243 19942 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:34.524643 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.457391 19891 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:34.496273 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:34.510950 19991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.022s	sys 0.042s
I20260709 12:10:34.480702 20016 consensus_queue.cc:1059] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:34.555204 17435 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:34.555631 19905 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.514672 19848 consensus_queue.cc:1243] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:10:34.581820 19937 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.010s	sys 0.013s
I20260709 12:10:34.520015 20017 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.601033 19864 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.579439 20023 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:34.608127 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 143495us
W20260709 12:10:34.600356 19991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.022s	sys 0.042s
I20260709 12:10:34.559324 20019 consensus_queue.cc:1243] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:34.474330 20020 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.605146 20013 raft_consensus.cc:697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:34.629302 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 281639us
I20260709 12:10:34.616895 19891 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.616396 19937 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.011s	sys 0.013s
I20260709 12:10:34.615209 19942 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:34.620209 19864 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:34.620417 20017 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.631028 19748 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.635859 20002 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.576963 17186 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 3, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 3 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:34.844247 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.807379 20010 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:34.851256 20010 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.851785 19998 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:34.723241 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 354671us
I20260709 12:10:34.653404 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:34.734620 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 96536.8us
I20260709 12:10:34.852469 19998 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:34.853238 18006 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:34.855170 19400 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:34.855656 19400 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:34.605540 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:34.735095 19748 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:34.736994 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:34.744253 19710 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.758172 19848 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:34.670694 19864 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:34.750751 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 302736us
I20260709 12:10:34.738867 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.736975 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:34.766865 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:34.768144 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 389671us
I20260709 12:10:34.768772 17358 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:34.761080 19777 consensus_meta.cc:287] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.000s
I20260709 12:10:34.684528 20020 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:34.670620 20013 consensus_queue.cc:237] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:34.776947 17363 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.785785 17362 pending_rounds.cc:85] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 6
I20260709 12:10:34.745559 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.781936 18013 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:34.785674 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1510) took 1497 ms. Trace:
I20260709 12:10:34.807381 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:34.782918 19901 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.815639 19751 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:34.786451 19942 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:34.839564 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 67967.9us
W20260709 12:10:34.600976 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.845837 19986 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.847395 19995 raft_consensus.cc:3055] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:34.851866 20010 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:34.734071 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:34.857816 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:34.839802 19964 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:10:34.857133 19400 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.926599 19400 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.928172 17436 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.930169 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:34.932359 19901 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:34.834702 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:34.936527 17440 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.908994 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:34.936517 17292 raft_consensus.cc:2376] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6. Re-sending same reply.
I20260709 12:10:34.924547 17362 pending_rounds.cc:107] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:34.910749 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:34.912926 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:34.913214 20026 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.358s	user 0.001s	sys 0.001s
I20260709 12:10:34.936794 18015 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:34.909862 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:34.904424 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:34.876228 18007 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.955822 19710 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.924100 17434 rpcz_store.cc:276] 0709 12:10:33.287892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.288429 (+   537us) service_pool.cc:224] Handling call
0709 12:10:34.785144 (+1496715us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54001478d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:34.785386 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287374208}
I20260709 12:10:34.979058 19710 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:34.980352 17434 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:34.910778 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:34.980573 19848 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.891718 19881 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.982352 18014 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:34.983383 20037 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:10:34.984313 19751 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:34.986416 19856 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:34.953667 19777 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:34.989459 19777 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:34.991070 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 438) took 1044 ms. Trace:
I20260709 12:10:34.913616 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:34.952726 17362 raft_consensus.cc:2889] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.923300 19995 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:34.991540 17437 rpcz_store.cc:276] 0709 12:10:33.946935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.947060 (+   125us) service_pool.cc:224] Handling call
0709 12:10:34.736510 (+789450us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:34.990975 (+254465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5570816}
I20260709 12:10:34.996729 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2351) took 1032 ms. Trace:
I20260709 12:10:34.997242 17283 rpcz_store.cc:276] 0709 12:10:33.962205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.133028 (+170823us) service_pool.cc:224] Handling call
0709 12:10:34.733576 (+600548us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b58000b0498. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:34.995003 (+261427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125463808}
W20260709 12:10:34.998041 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.998819 17367 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:34.997448 19889 consensus_queue.cc:1059] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:35.000777 17186 catalog_manager.cc:5697] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 3 to 5, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 5 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.002676 17361 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.854005 19998 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:34.923977 19986 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:34.881618 20014 raft_consensus.cc:3055] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.900746 19953 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.008652 17359 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:35.017160 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:35.017786 17441 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.018435 19848 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:35.023528 18012 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:35.024484 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:35.030292 19998 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.034346 19965 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:35.035265 19965 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:35.014633 20014 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:35.037775 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 133560us
W20260709 12:10:35.039304 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 46209.5us
I20260709 12:10:35.043916 18015 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.990972 20010 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.047775 20010 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:35.054291 20061 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:10:35.055176 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 449497us
I20260709 12:10:35.057420 20044 consensus_queue.cc:1059] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:35.058403 19881 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:35.058804 20044 consensus_queue.cc:1059] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:35.059897 20044 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.060293 20044 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:35.060755 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 123358us
I20260709 12:10:35.062568 19891 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.062990 19986 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:35.063349 19889 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:35.064340 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:35.086480 19748 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.087067 19748 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:35.087524 19748 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.091902 20017 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.092904 20014 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.094111 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:35.094308 19777 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:35.094971 20014 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.096146 19777 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.096591 19777 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:35.096974 19777 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.097702 17288 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:35.097494 19898 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:35.098814 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:35.098960 20047 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:35.100106 20047 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.100479 20047 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:35.101537 20047 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.103904 19995 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:35.105222 19995 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.106132 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 658) took 2121 ms. Trace:
W20260709 12:10:35.094012 20055 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:10:35.106472 20037 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:35.091801 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.117540 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.127664 17367 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:10:35.081773 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:35.061492 20044 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:35.082767 20012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.011s	sys 0.030s
I20260709 12:10:35.143276 20047 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.106184 20023 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:35.107394 19848 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.136559 17360 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.138466 20043 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.140254 17364 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:35.142792 20044 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.150002 17361 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:35.107683 20028 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.156668 17440 raft_consensus.cc:2410] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:35.158326 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:35.160487 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 96325.1us
W20260709 12:10:35.143422 20012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.011s	sys 0.031s
I20260709 12:10:35.162025 17439 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:35.164088 19864 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.166294 19723 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.166917 19723 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:35.169404 20022 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:35.169623 19667 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.170210 20022 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.170397 19667 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.171672 19777 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.172724 19667 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:35.160303 20057 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 12:10:35.155849 20028 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:35.152303 19848 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.174090 19777 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:35.187670 17404 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:35.150897 20023 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:35.189366 19667 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.189853 19667 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.189652 20023 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.190701 19667 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.157796 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:35.185223 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 118366us
I20260709 12:10:35.248401 17332 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:35.184684 19848 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.150708 19986 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:35.254767 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 120679us
W20260709 12:10:35.269182 17406 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.590s (SENT)
I20260709 12:10:35.269881 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:35.262285 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 656) took 1434 ms. Trace:
W20260709 12:10:35.273473 17406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.641s (SENT) [suppressed 45 similar messages]
I20260709 12:10:35.274122 19774 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.281579 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:35.347005 18012 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:10:35.341555 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:35.344118 18013 rpcz_store.cc:276] 0709 12:10:33.821289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.279705 (+458416us) service_pool.cc:224] Handling call
0709 12:10:34.781069 (+501364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.924330 (+143261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.245709 (+321379us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b540023da50. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:35.255624 (+  9915us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152023808}
I20260709 12:10:35.278339 17366 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:35.176338 20060 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:10:35.177527 20020 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.190900 20023 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.278781 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:35.192211 19965 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:35.172612 20022 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:35.351177 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 162067us
I20260709 12:10:35.348701 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:35.185465 20017 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:35.178243 20011 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:35.367401 18015 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.178418 20016 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.172s
I20260709 12:10:35.359100 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:35.359799 19954 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:35.360445 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.259665 19891 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.362242 20000 consensus_meta.cc:287] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.806s	user 0.014s	sys 0.004s
I20260709 12:10:35.340567 19751 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:35.373136 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:35.376372 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.350894 20020 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:35.106588 18008 rpcz_store.cc:276] 0709 12:10:32.984945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.985054 (+   109us) service_pool.cc:224] Handling call
0709 12:10:32.985418 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.866976 (+881558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.870456 (+  3480us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.890921 (+ 20465us) log.cc:844] Serialized 26 byte log entry
0709 12:10:34.286341 (+395420us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.316320 (+ 29979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.339534 (+ 23214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.912197 (+572663us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:35.064789 (+152592us) raft_consensus.cc:1685] finished
0709 12:10:35.067121 (+  2332us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.105874 (+ 38753us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":397068,"raft.queue_time_us":413200,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":2612096,"thread_start_us":618273,"threads_started":2,"wal-append.queue_time_us":640870}
I20260709 12:10:35.389663 17367 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.393090 18014 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:35.399019 18014 pending_rounds.cc:85] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 6
I20260709 12:10:35.399261 18014 pending_rounds.cc:107] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:35.183813 20028 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.399511 18014 raft_consensus.cc:2889] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:35.396206 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:35.378963 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:35.397307 20000 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:35.397187 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 148943us
I20260709 12:10:35.403986 17332 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:35.386794 17360 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:35.404682 20000 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:35.412066 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 62563.5us
W20260709 12:10:35.416859 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.417390 19964 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:35.419162 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.422333 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.422494 17432 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:35.422999 19756 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.422770 20020 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.423868 20024 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.424424 20020 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.375625 18007 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:10:35.428896 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 87450.2us
W20260709 12:10:35.428399 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 346710us
I20260709 12:10:35.391546 20013 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:35.410210 18006 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:35.407989 20011 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.423645 19756 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:35.451596 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:35.459300 17361 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:35.411151 19901 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:35.422168 20019 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.392040 19710 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:10:35.391721 19828 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 12:10:35.472713 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 68829.9us
I20260709 12:10:35.454169 20028 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.480166 19798 raft_consensus.cc:2764] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:35.482751 19756 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:35.485562 18007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 640) took 1654 ms (client timeout 1942 ms). Trace:
I20260709 12:10:35.488304 18011 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:35.415459 19891 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:35.503525 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 230065us
I20260709 12:10:35.503865 17359 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:35.507211 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 55714.5us
I20260709 12:10:35.516448 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:35.524374 20069 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:10:35.524551 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 82983.1us
W20260709 12:10:35.527125 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 110040us
W20260709 12:10:35.541313 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.508311 19723 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:35.565649 17406 leader_election.cc:336] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.815s (SENT)
W20260709 12:10:35.565784 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 93206.2us
I20260709 12:10:35.571795 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:35.510960 20017 consensus_queue.cc:1059] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:10:35.581717 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.526654 20016 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 12:10:35.575424 20010 consensus_meta.cc:287] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.002s
I20260709 12:10:35.590039 20023 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.502140 18007 rpcz_store.cc:269] 0709 12:10:33.830749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.126728 (+295979us) service_pool.cc:224] Handling call
0709 12:10:35.485280 (+1358552us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b5400680954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:35.485460 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719728000}
I20260709 12:10:35.588327 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:35.597649 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 119012us
I20260709 12:10:35.593925 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:35.541772 19774 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 12:10:35.612684 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46361us
W20260709 12:10:35.637264 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 96830.8us
I20260709 12:10:35.607308 19798 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.646279 18011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 648) took 1161 ms. Trace:
I20260709 12:10:35.600598 20003 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.181s
I20260709 12:10:35.646275 17289 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:35.607604 20023 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:35.627837 19995 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:35.646798 18011 rpcz_store.cc:276] 0709 12:10:34.480274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.480808 (+   534us) service_pool.cc:224] Handling call
0709 12:10:35.487746 (+1006938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.502381 (+ 14635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.631600 (+129219us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b5400680950. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:35.641688 (+ 10088us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264065408}
W20260709 12:10:35.663345 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 75090.7us
I20260709 12:10:35.645787 20010 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.644838 20022 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:35.699048 17288 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:35.685758 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:35.706579 17285 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:35.703531 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 70552.4us
I20260709 12:10:35.677227 17292 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:35.704648 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:35.719575 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 55464.8us
W20260709 12:10:35.686779 20037 consensus_meta.cc:287] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
W20260709 12:10:35.682617 19996 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 12:10:35.683916 20073 log.cc:927] Time spent T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:10:35.686655 20071 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:10:35.685534 20076 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:10:35.732928 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:35.674317 20082 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.782577 17258 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:35.688426 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:35.674351 20018 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.784180 20065 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 12:10:35.794327 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 61506.1us
W20260709 12:10:35.797603 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 152179us
I20260709 12:10:35.727082 19964 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.782397 20037 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:35.795477 20074 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:10:35.668696 19667 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.720829 19751 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:10:35.664496 19798 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:35.827293 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 100741us
I20260709 12:10:35.726471 19965 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:10:35.682818 19897 consensus_queue.cc:1059] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.201s
I20260709 12:10:35.795449 20023 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:35.808864 19964 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:35.785202 20022 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:35.836866 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:35.837829 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 117530us
I20260709 12:10:35.849311 17333 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:35.821853 20010 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.790478 19995 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:35.834697 19748 consensus_meta.cc:287] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.004s
W20260709 12:10:35.866775 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.838377 20082 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.848969 18011 raft_consensus.cc:2376] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7. Re-sending same reply.
I20260709 12:10:35.877570 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:35.879046 19667 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:35.837278 18006 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.882627 19751 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.887750 19751 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.882772 20022 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.935577 17285 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
W20260709 12:10:35.916956 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 49151.3us
W20260709 12:10:35.950875 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.868705 20024 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.868436 20023 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:35.873720 20011 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.882040 20043 consensus_meta.cc:287] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.687s	user 0.006s	sys 0.002s
W20260709 12:10:35.965894 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 66115us
W20260709 12:10:35.915055 19954 consensus_meta.cc:287] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.003s
W20260709 12:10:35.980857 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 112597us
I20260709 12:10:35.885497 19891 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:35.915786 19995 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:35.884378 19667 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.998402 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:35.998533 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:35.990016 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 403439us
I20260709 12:10:35.995086 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:35.995447 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:35.996270 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:35.997561 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:35.982944 20043 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:35.873565 19748 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:35.979413 20011 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:35.844765 20018 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.053194 17362 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:35.860955 19964 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:36.020165 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 191997us
I20260709 12:10:36.052855 17364 raft_consensus.cc:2410] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:35.970643 20023 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:36.065836 17367 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:36.074496 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:36.074899 19751 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:36.077637 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 449) took 1068 ms. Trace:
I20260709 12:10:36.078459 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:36.079391 17364 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.079957 17367 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.080763 20023 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.078080 17283 rpcz_store.cc:276] 0709 12:10:34.999051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.009741 (+ 10690us) service_pool.cc:224] Handling call
0709 12:10:35.033272 (+ 23531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.134694 (+101422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.134725 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.153894 (+ 19169us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.489884 (+335990us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:35.489923 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.490231 (+   308us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.066596 (+576365us) raft_consensus.cc:1685] finished
0709 12:10:36.066619 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.066770 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43946,"raft.queue_time_us":42628,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":17228,"thread_start_us":145497,"threads_started":1,"wal-append.queue_time_us":345193}
W20260709 12:10:36.083493 20014 consensus_meta.cc:287] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.988s	user 0.006s	sys 0.005s
I20260709 12:10:35.984738 20024 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:36.085517 20018 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:36.080642 17364 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:35.915472 19848 consensus_meta.cc:287] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.004s
I20260709 12:10:36.078591 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:36.086545 20024 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:35.910431 20082 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:35.998631 19777 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.083600 20103 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:36.091161 20085 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:10:36.091533 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.095986 17360 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:36.079221 20080 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:35.905731 19798 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:36.106737 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:36.086690 20044 consensus_meta.cc:287] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.924s	user 0.007s	sys 0.004s
I20260709 12:10:36.137059 17363 raft_consensus.cc:2410] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:36.137360 20082 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:36.113489 19777 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:36.138929 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 65007.6us
I20260709 12:10:36.147521 20099 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.148247 20099 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:36.153489 20013 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.695s	user 0.003s	sys 0.007s
I20260709 12:10:36.164541 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:35.914503 20087 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:36.103736 19864 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.939s	user 0.003s	sys 0.011s
I20260709 12:10:36.186196 20082 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:36.163036 19995 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.070647 19891 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:10:36.129904 20010 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.212209 17433 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:10:36.114792 20103 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:36.162303 20013 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.103266 19848 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.213948 17433 pending_rounds.cc:85] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 6
I20260709 12:10:36.220324 17433 pending_rounds.cc:107] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:10:36.220606 17433 raft_consensus.cc:2889] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:36.223310 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.056s	sys 0.125s
W20260709 12:10:36.224313 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.056s	sys 0.125s
I20260709 12:10:36.224395 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:36.212471 19998 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.148s	user 0.006s	sys 0.006s
I20260709 12:10:36.121165 19667 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:36.235780 17366 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:36.186352 20014 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:10:36.282707 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.283726 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.284571 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.285691 17359 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:36.286996 17365 raft_consensus.cc:2410] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:36.231038 19748 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:36.283211 19710 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.016s	sys 0.036s
W20260709 12:10:36.383126 19710 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.016s	sys 0.037s
I20260709 12:10:36.383738 17362 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:36.386273 17360 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:36.386737 17283 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:36.230113 19891 consensus_queue.cc:1243] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer aaafaad0810b4e95983d2d73ec814346 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:36.282758 19864 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.381203 20028 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.807s	user 0.005s	sys 0.007s
I20260709 12:10:36.221753 20087 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.291548 19798 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.226336 20023 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.399068 20091 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:36.356074 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.386739 17360 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:36.404165 17440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.013s	sys 0.017s
W20260709 12:10:36.404606 17440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.014s	sys 0.017s
I20260709 12:10:36.388851 20099 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:36.390578 20096 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.398459 20082 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.412151 20081 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:10:36.396240 19723 raft_consensus.cc:3055] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:36.412107 20020 consensus_meta.cc:287] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.987s	user 0.000s	sys 0.013s
I20260709 12:10:36.419474 17362 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:36.426496 17404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.030s	sys 0.052s
W20260709 12:10:36.431283 17404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.030s	sys 0.052s
W20260709 12:10:36.432031 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.472978 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.520529 17405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.011s	sys 0.027s
W20260709 12:10:36.522114 17405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.011s	sys 0.027s
W20260709 12:10:36.524026 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 67089.4us
W20260709 12:10:36.518422 20022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.023s
I20260709 12:10:36.402493 19798 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.412483 19864 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:36.549456 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.427227 19723 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:36.536496 17360 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:36.553527 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.557744 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:36.519800 20028 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:36.536526 19986 consensus_meta.cc:287] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.193s	user 0.011s	sys 0.002s
I20260709 12:10:36.558408 18011 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:36.558964 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 131486us
W20260709 12:10:36.548146 20022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.007s	sys 0.024s
W20260709 12:10:36.547083 19756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.023s	sys 0.027s
W20260709 12:10:36.578919 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.575160 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:36.422710 20096 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:36.539491 20020 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:36.533517 20082 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:36.566115 20011 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:36.600437 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:36.607620 17358 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:36.599977 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 59298.1us
I20260709 12:10:36.603678 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:36.430480 20103 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:36.614490 17360 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:36.589589 19756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.023s	sys 0.035s
I20260709 12:10:36.615352 17361 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:36.616775 17287 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:36.586724 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 652) took 2026 ms. Trace:
I20260709 12:10:36.631039 17440 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.599538 19848 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:36.639406 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:36.612366 19667 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:36.617090 19963 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:36.641180 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:36.622496 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:36.636319 17333 connection.cc:256] RPC call timeout handler was delayed by -1.768000554000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 12:10:36.619477 20105 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:36.630142 20106 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:36.657765 18008 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:36.659032 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:36.660320 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:36.661661 20023 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:36.608645 20020 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:36.638851 20103 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.638724 20111 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.617530 20028 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:36.644354 19860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.029s	sys 0.026s
I20260709 12:10:36.648373 19963 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:36.684504 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:36.689013 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:36.685400 17359 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:36.675046 19860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.030s	sys 0.026s
I20260709 12:10:36.694535 17432 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.655779 19891 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:36.695912 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:36.698280 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 180223us
I20260709 12:10:36.753037 19963 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.750248 20020 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:36.697067 19864 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:36.691666 20023 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:36.726318 17441 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:36.769438 20096 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:36.800511 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 157893us
I20260709 12:10:36.720193 17360 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:36.703595 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 94566.4us
I20260709 12:10:36.883811 20028 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:36.748512 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.771185 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:36.931843 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:36.932103 18012 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:36.932515 17360 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:36.655711 19723 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.799461 18011 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:36.695503 19848 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.748652 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:36.667153 20106 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:36.756497 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:36.724066 19986 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:36.670349 20087 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:36.748957 20002 raft_consensus.cc:3055] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.679704 20111 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.693822 20105 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.956262 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:36.850914 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:36.866618 20082 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:36.960923 17363 raft_consensus.cc:2410] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:36.933995 20083 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.840801 19860 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:36.733877 20107 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.884809 17358 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:36.727965 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:36.811627 20099 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:10:36.766553 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:36.949409 20096 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:36.936306 17406 leader_election.cc:336] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.991s (SENT)
I20260709 12:10:36.938735 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:36.939009 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:36.948514 19986 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.944983 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:36.943068 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:36.946349 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:36.870368 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.998023 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.998406 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.935263 20023 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.968252 17438 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:36.973232 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 318212us
I20260709 12:10:36.945524 20112 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.931097 17258 connection.cc:256] RPC call timeout handler was delayed by -1.8594862410002406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 12:10:36.955067 17435 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:36.983871 17360 raft_consensus.cc:2410] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:37.006837 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:36.943682 19848 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:36.988335 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.990744 20122 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.991212 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:36.992137 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.992841 20105 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:36.994819 20078 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:10:36.955710 20002 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:36.940976 19963 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.997140 17432 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
W20260709 12:10:37.004107 17258 connection.cc:256] RPC call timeout handler was delayed by -1.8378862410002057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 12:10:37.004196 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:36.956213 19723 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.976600 20082 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.005626 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 65556.4us
I20260709 12:10:36.932349 19891 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:36.980353 20099 consensus_queue.cc:1243] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:37.010133 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:37.025671 17358 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:36.969388 20087 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:10:37.001816 19964 consensus_meta.cc:287] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.904s	user 0.012s	sys 0.000s
I20260709 12:10:37.021956 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:37.022558 17258 connection.cc:256] RPC call timeout handler was delayed by -1.7856862410001213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
I20260709 12:10:36.974529 20083 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.054078 17363 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.054690 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:36.988016 19860 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:37.057785 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46524us
I20260709 12:10:37.061136 17432 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:37.012776 20090 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:37.069738 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.008987 20112 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:37.077344 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.984279 20107 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.095609 19891 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.096329 19891 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:37.096895 19891 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:37.098269 20115 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:37.099634 20107 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.101593 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:37.102347 17292 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:37.106843 20121 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.107455 20121 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.108352 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:37.109176 19860 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.065368 20090 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.109988 20090 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.110057 20121 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:36.621001 18009 rpcz_store.cc:276] 0709 12:10:34.557712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.935285 (+377573us) service_pool.cc:224] Handling call
0709 12:10:34.935827 (+   542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.116248 (+180421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.124496 (+  8248us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.263763 (+139267us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.572140 (+308377us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:35.614007 (+ 41867us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.634680 (+ 20673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.639789 (+  5109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.558196 (+918407us) raft_consensus.cc:1685] finished
0709 12:10:36.558224 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.583873 (+ 25649us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9999,"prepare.queue_time_us":20069,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":1517,"raft.queue_time_us":113177,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":11762,"thread_start_us":128706,"threads_started":1,"wal-append.queue_time_us":485082}
I20260709 12:10:37.111773 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:37.060451 19964 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.021137 19942 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:10:37.114849 19964 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.014258 20096 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.115994 19905 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.115954 20124 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:37.117300 20023 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.117502 20096 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:37.130003 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 198813us
I20260709 12:10:37.131693 17438 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
W20260709 12:10:37.141265 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.065023 20020 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:37.143698 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:37.143754 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 61286.3us
I20260709 12:10:37.071725 20122 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:37.148552 17363 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:37.156981 17406 leader_election.cc:336] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.005s (SENT)
I20260709 12:10:37.124910 20096 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.162812 17438 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:37.164812 17439 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.059450 20082 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.165560 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:37.169799 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:37.175328 17363 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.150926 20023 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.186523 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:37.198050 17363 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:37.208757 17358 raft_consensus.cc:1217] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-7.5]   Dedup: 3.3->[5.4-7.5]
I20260709 12:10:37.162273 19964 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:10:37.178544 20105 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.165315 20020 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:37.209406 17358 pending_rounds.cc:85] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 3
I20260709 12:10:37.220019 17358 pending_rounds.cc:107] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:37.220319 17358 raft_consensus.cc:2889] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.191938 20099 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.193373 20078 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.173166 20096 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:37.227548 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 80582us
W20260709 12:10:37.231122 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 75951.3us
I20260709 12:10:37.210320 18008 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:10:37.218542 20103 consensus_meta.cc:287] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 12:10:37.191030 20023 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.235610 17290 raft_consensus.cc:1217] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-5.7]   Dedup: 2.5->[4.6-5.7]
I20260709 12:10:37.239506 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 450) took 2078 ms. Trace:
I20260709 12:10:37.193560 20121 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:37.240285 17433 rpcz_store.cc:276] 0709 12:10:35.156665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.157047 (+   382us) service_pool.cc:224] Handling call
0709 12:10:35.264942 (+107895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.223710 (+958768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.232732 (+1009022us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400161f54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:37.235231 (+  2499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166415104}
I20260709 12:10:37.239462 17290 pending_rounds.cc:85] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 5
I20260709 12:10:37.246970 17290 pending_rounds.cc:107] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:37.247457 17290 raft_consensus.cc:2889] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.229804 20106 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:37.249818 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.227164 20099 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.234349 17435 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:37.207731 20119 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:10:37.278537 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.287165 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 54528.2us
I20260709 12:10:37.244146 19986 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.246878 19848 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.280882 20099 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.218317 20002 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.291163 19891 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:37.294216 20136 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:10:37.231485 20122 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.297217 20142 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.310405 19848 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.307565 20083 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:37.328694 17406 leader_election.cc:336] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.143s (SENT)
I20260709 12:10:37.338371 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:37.348163 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:37.349069 17367 raft_consensus.cc:2410] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:37.350613 20133 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 12:10:37.350976 20134 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:37.352696 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:37.355429 20139 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.355873 20148 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:37.356093 20139 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:37.358788 19980 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.347379 20016 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:37.346895 18006 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.243s	user 0.014s	sys 0.000s
I20260709 12:10:37.363870 20139 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:37.335719 20112 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:37.340246 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:37.345017 20002 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.332072 20078 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:10:37.369585 17258 connection.cc:256] RPC call timeout handler was delayed by -1.5696862410002268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 12:10:37.374383 17258 connection.cc:256] RPC call timeout handler was delayed by -1.5597862410002108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 12:10:37.369068 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:37.330518 19964 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:37.373626 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:37.376349 17258 connection.cc:256] RPC call timeout handler was delayed by -1.4211862410002141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260709 12:10:37.336496 20142 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:37.371263 20100 log.cc:927] Time spent T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 1.529s	user 0.015s	sys 0.017s
W20260709 12:10:37.388711 17258 connection.cc:256] RPC call timeout handler was delayed by -1.3437862410000889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 12:10:37.374532 20132 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:10:37.348482 19848 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.368495 18006 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:10:37.401595 18012 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:10:37.396708 17258 connection.cc:256] RPC call timeout handler was delayed by -1.1520862410002337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22999999999999998s for a response
I20260709 12:10:37.359491 19980 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:37.402671 17258 connection.cc:256] RPC call timeout handler was delayed by -1.1133862410001711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2343s for a response
W20260709 12:10:37.406370 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 87542.9us
W20260709 12:10:37.407078 17406 leader_election.cc:336] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.143s (SENT)
W20260709 12:10:37.408248 17406 connection.cc:256] RPC call timeout handler was delayed by -1.1815284180001981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2757s for a response
I20260709 12:10:37.408314 20082 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.411139 19965 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:37.411747 19965 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:37.413055 19980 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:37.414542 20151 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:37.414685 19723 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.414678 18006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 659) took 1790 ms (client timeout 1744 ms). Trace:
I20260709 12:10:37.415223 19723 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.417471 19723 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:37.415431 18006 rpcz_store.cc:269] 0709 12:10:35.624065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.634483 (+ 10418us) service_pool.cc:224] Handling call
0709 12:10:37.414331 (+1779848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:37.420574 18006 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:37.420909 20090 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:37.404419 17286 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:37.371150 19986 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:37.413808 19965 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:37.426889 17406 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:37.438279 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:37.439249 17359 raft_consensus.cc:2393] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:37.372687 19889 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:37.441532 19889 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:37.442288 19965 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:37.440888 17406 leader_election.cc:336] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.682s (SENT)
I20260709 12:10:37.433492 20090 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:37.451061 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:37.443964 19889 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:37.452513 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:37.461316 17367 raft_consensus.cc:2410] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:37.462844 17287 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:37.463825 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:37.468163 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.405257 20096 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:37.435461 20148 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:37.464586 17289 raft_consensus.cc:2376] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6. Re-sending same reply.
I20260709 12:10:37.427817 20151 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:37.476536 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.482770 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:37.483560 17286 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:37.488757 19777 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:37.492750 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:37.472595 20132 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:10:37.497099 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:37.500080 17287 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.501843 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:37.471204 20023 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.470557 19986 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:37.728341 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.604250 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:37.747910 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.827139 17287 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:37.722854 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 660) took 2098 ms. Trace:
I20260709 12:10:37.474476 20148 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:37.826524 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2379) took 1271 ms. Trace:
W20260709 12:10:37.831979 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.840021 17286 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:10:37.566920 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:37.828197 18014 rpcz_store.cc:276] 0709 12:10:35.624384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.624500 (+   116us) service_pool.cc:224] Handling call
0709 12:10:35.636698 (+ 12198us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:35.747645 (+110947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.747792 (+   147us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:35.774675 (+ 26883us) log.cc:844] Serialized 52 byte log entry
0709 12:10:35.797557 (+ 22882us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:35.831966 (+ 34409us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.839426 (+  7460us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.862044 (+ 22618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.862144 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.345418 (+1483274us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b2400354818. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12228b49c4 00007f12228b2acb 00007f1222a6ddc9 00007f1222a6da55 00007f1222a6d09d 00007f122569f10e 00007f12256b688c 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221
0709 12:10:37.722526 (+377108us) raft_consensus.cc:1685] finished
0709 12:10:37.722564 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.722770 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22341,"prepare.queue_time_us":114997,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":9053,"raft.queue_time_us":217601,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":62310,"spinlock_wait_cycles":11637504,"thread_start_us":121032,"threads_started":2,"wal-append.queue_time_us":22293}
I20260709 12:10:37.831337 17362 rpcz_store.cc:276] 0709 12:10:36.547849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.548895 (+  1046us) service_pool.cc:224] Handling call
0709 12:10:36.565059 (+ 16164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.593421 (+ 28362us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:36.884087 (+290666us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.063477 (+179390us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.130364 (+ 66887us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.147024 (+ 16660us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:37.147068 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.147134 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.819359 (+672225us) raft_consensus.cc:1685] finished
0709 12:10:37.819377 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.819508 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48177,"prepare.queue_time_us":418385,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":63327,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":12225,"spinlock_wait_cycles":27970432,"thread_start_us":336778,"threads_started":2,"wal-append.queue_time_us":240671}
I20260709 12:10:37.885566 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:37.886281 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:37.665307 19963 consensus_meta.cc:287] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.641s	user 0.006s	sys 0.005s
I20260709 12:10:37.902923 17286 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.565333 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 664) took 1010 ms. Trace:
I20260709 12:10:37.717468 20154 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.914501 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:37.904096 18013 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:37.562634 20157 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.904383 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 411688us
I20260709 12:10:37.922876 17981 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:37.511794 19848 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.903237 17287 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:37.827520 20023 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.551625 19777 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:37.826483 19864 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.929903 17364 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:37.931561 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:37.933792 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:37.906858 20000 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.510280 20151 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.926913 20154 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.942931 20023 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.907619 18010 rpcz_store.cc:276] 0709 12:10:36.554877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.558553 (+  3676us) service_pool.cc:224] Handling call
0709 12:10:37.355870 (+797317us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6eee 000000000036eb39 00007f122aa6a1e0 00007f122ab330c4 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:37.356092 (+   222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.356538 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.356574 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.357214 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.387131 (+ 29917us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:37.387614 (+   483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.396836 (+  9222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.516030 (+119194us) raft_consensus.cc:1685] finished
0709 12:10:37.551713 (+ 35683us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.565254 (+ 13541us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2476,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":52,"spinlock_wait_cycles":11981056,"thread_start_us":29405,"threads_started":1,"wal-append.queue_time_us":93573}
I20260709 12:10:37.948462 20142 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.979120 20023 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.960402 20087 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.961624 20002 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:37.962284 19905 consensus_queue.cc:1059] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:37.980624 19905 raft_consensus.cc:3055] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.980981 19905 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:37.981851 19905 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.982407 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:37.962422 20084 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:37.983341 17362 raft_consensus.cc:2410] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:37.963176 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:37.986038 20099 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.000s
I20260709 12:10:37.986320 20142 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.946278 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:37.963488 19986 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.987026 17287 raft_consensus.cc:2376] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7. Re-sending same reply.
I20260709 12:10:37.975617 20148 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:37.956532 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:37.988090 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:37.985970 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:37.988791 17287 raft_consensus.cc:2376] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10. Re-sending same reply.
I20260709 12:10:37.989465 20092 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.974674 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:37.989931 20011 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:37.997295 17365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1569) took 3175 ms (client timeout 2554 ms). Trace:
I20260709 12:10:37.935154 19848 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:37.984202 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:37.978978 20154 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:37.987053 20142 consensus_queue.cc:1059] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:38.002267 20154 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:38.002636 20142 raft_consensus.cc:3055] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:38.002833 20154 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.003228 20142 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:38.003647 19986 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.989753 17333 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:37.989759 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:38.003264 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:37.991086 17285 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:38.006052 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:37.997751 17365 rpcz_store.cc:269] 0709 12:10:34.765374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.766159 (+   785us) service_pool.cc:224] Handling call
0709 12:10:37.929362 (+3163203us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003c5854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:37.940721 (+ 11359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3135089536}
I20260709 12:10:38.006433 17287 raft_consensus.cc:2376] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4. Re-sending same reply.
I20260709 12:10:38.004278 20142 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:38.011085 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.011751 17285 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:38.012205 17289 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:37.988111 20148 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.013567 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1580) took 2420 ms. Trace:
I20260709 12:10:38.014170 17366 rpcz_store.cc:276] 0709 12:10:35.589657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.590533 (+   876us) service_pool.cc:224] Handling call
0709 12:10:35.590897 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.242646 (+651749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.009628 (+1766982us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b540006fed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:38.009790 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482506112}
I20260709 12:10:38.014241 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.017911 20142 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.018116 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.018571 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.019316 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.020002 17287 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
W20260709 12:10:38.020754 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.009176 20023 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:38.032493 20023 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.032914 20023 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.015715 19905 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.037180 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.038163 17366 raft_consensus.cc:2410] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:38.039038 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:38.007529 19848 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.044449 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.019346 17284 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:10:37.986805 19864 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.026832 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.031986 20154 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:38.014930 19986 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.048806 17285 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:38.049297 17286 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:38.020105 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.047662 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.050611 17365 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:37.991459 19777 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:37.990051 20092 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.001168 20099 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.050774 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.053718 20154 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.054661 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.054539 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.060123 17289 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:38.063014 17286 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:38.063446 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.065838 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:38.067478 17284 raft_consensus.cc:2410] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:38.069811 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.066555 17365 raft_consensus.cc:2376] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7. Re-sending same reply.
I20260709 12:10:38.071702 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.073685 17289 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:38.021893 20011 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:37.930799 20157 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.083633 17366 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:38.088128 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.092684 17285 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:38.096781 17365 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:38.093101 17284 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:38.087857 19777 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:38.099942 19777 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:38.100457 19777 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:38.099321 17365 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:38.102833 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 473) took 1003 ms. Trace:
I20260709 12:10:38.079156 19986 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:38.107415 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 44516.9us
I20260709 12:10:38.085597 19848 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:38.103281 17288 rpcz_store.cc:276] 0709 12:10:37.099674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.103154 (+  3480us) service_pool.cc:224] Handling call
0709 12:10:37.103448 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.117065 (+ 13617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.117097 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:37.117137 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:37.117165 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.102583 (+985418us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b54002017d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:38.102637 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.102757 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30904192}
I20260709 12:10:38.092020 19864 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:38.125985 17291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.036s	sys 0.024s
W20260709 12:10:38.129820 17291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.037s	sys 0.024s
I20260709 12:10:38.104535 20111 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:38.133785 19777 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:38.138721 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:38.142448 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 136470us
W20260709 12:10:38.147017 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 186962us
I20260709 12:10:38.151782 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.153821 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.142444 20154 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.155246 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.155802 17441 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:38.152518 19848 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:38.175420 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.175356 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:38.163132 19986 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.186951 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:38.188221 18013 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.188930 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.169797 19777 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:38.199991 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47121.5us
I20260709 12:10:38.202857 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:38.204217 17404 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:38.204979 20092 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:38.204622 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.207885 18015 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:38.207667 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:38.225564 17404 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:38.226220 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.207901 19777 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:38.236383 19777 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.238039 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 666) took 1140 ms. Trace:
I20260709 12:10:38.238489 18006 rpcz_store.cc:276] 0709 12:10:37.097643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.426856 (+329213us) service_pool.cc:224] Handling call
0709 12:10:37.451669 (+ 24813us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:37.823062 (+371393us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:37.886429 (+ 63367us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.972648 (+ 86219us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b1800445540. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb23a 00007f1225b25a2a
0709 12:10:38.146654 (+174006us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.148397 (+  1743us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:38.151239 (+  2842us) log.cc:844] Serialized 52 byte log entry
0709 12:10:38.151413 (+   174us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:38.151598 (+   185us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.163725 (+ 12127us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.188188 (+ 24463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.188636 (+   448us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.237822 (+ 49186us) raft_consensus.cc:1685] finished
0709 12:10:38.237840 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.237971 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77724,"prepare.queue_time_us":63171,"raft.queue_time_us":386084,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":20292,"spinlock_wait_cycles":33594240,"thread_start_us":168626,"threads_started":1,"wal-append.queue_time_us":255742}
I20260709 12:10:38.209789 20154 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:38.228771 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.229514 19860 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.231201 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2389) took 1232 ms. Trace:
I20260709 12:10:38.243368 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.228466 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:38.241930 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.243717 17363 rpcz_store.cc:276] 0709 12:10:36.998997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.207786 (+208789us) service_pool.cc:224] Handling call
0709 12:10:37.226536 (+ 18750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.236708 (+ 10172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.236738 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:37.236777 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:37.236807 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.230948 (+994141us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b5400081e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:38.230996 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.231141 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22911744}
I20260709 12:10:38.245213 18014 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:10:38.247587 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 86511.7us
I20260709 12:10:38.243198 19860 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.200928 19848 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.257274 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:38.241883 20157 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:38.257968 18015 raft_consensus.cc:2376] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8. Re-sending same reply.
I20260709 12:10:38.264003 19848 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:38.258944 20154 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.269233 19777 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:38.270363 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 81520.7us
I20260709 12:10:38.280184 20154 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:38.282541 20154 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:38.258858 19860 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.246289 20180 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.287969 18006 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:38.301741 18006 pending_rounds.cc:85] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 5
I20260709 12:10:38.302044 18006 pending_rounds.cc:107] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:38.302284 18006 raft_consensus.cc:2889] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:38.292990 20185 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.273700 20023 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:38.303196 17258 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.306221 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:38.307853 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:38.308611 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 58797.7us
I20260709 12:10:38.309008 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:38.368575 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 70608.3us
I20260709 12:10:38.371376 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.372042 18007 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
W20260709 12:10:38.380211 17361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 430) took 2385 ms (client timeout 1835 ms). Trace:
I20260709 12:10:38.383806 20023 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:38.393667 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.310321 19848 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:38.320760 20185 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:38.387449 20092 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.434998 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.370383 20154 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.392829 20157 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.424167 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 88715.2us
I20260709 12:10:38.428757 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:38.433091 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:38.433091 17361 rpcz_store.cc:269] 0709 12:10:35.994370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.998264 (+  3894us) service_pool.cc:224] Handling call
0709 12:10:38.379955 (+2381691us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54002913d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:38.380110 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196425600}
I20260709 12:10:38.434806 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.438621 17439 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:38.439324 19986 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:38.434324 19848 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.445475 20157 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:38.439414 19777 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:38.444360 20092 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.446017 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:38.451763 17441 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:38.460707 18013 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
W20260709 12:10:38.454582 17978 leader_election.cc:336] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.566s (SENT)
I20260709 12:10:38.454571 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.463846 17978 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.464010 17436 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:38.461257 17980 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:38.465618 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:38.467672 20157 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:38.467767 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.453007 20142 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:10:38.452632 19798 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:38.468602 20152 log.cc:927] Time spent T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.904s	user 0.002s	sys 0.019s
I20260709 12:10:38.453135 20023 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.503218 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 193516us
I20260709 12:10:38.450707 20193 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.505241 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:38.510848 17284 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:10:38.464926 19848 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:38.509718 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 55190us
W20260709 12:10:38.509789 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49794.2us
I20260709 12:10:38.498435 19777 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.501710 20003 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.519358 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:38.523130 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 153903us
I20260709 12:10:38.513568 19710 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.538578 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:38.458173 20185 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.522413 19777 raft_consensus.cc:697] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:38.511129 20023 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.548285 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.540210 19710 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.557057 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1590) took 1728 ms. Trace:
I20260709 12:10:38.539804 20022 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:38.557535 17358 rpcz_store.cc:276] 0709 12:10:36.829328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.191508 (+362180us) service_pool.cc:224] Handling call
0709 12:10:37.208523 (+ 17015us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:37.228211 (+ 19688us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:37.228248 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:37.233493 (+  5245us) log.cc:844] Serialized 52 byte log entry
0709 12:10:37.378313 (+144820us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:37.378363 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.378443 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.467964 (+1089521us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:38.553526 (+ 85562us) raft_consensus.cc:1685] finished
0709 12:10:38.553548 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.556961 (+  3413us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13045,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4882,"spinlock_wait_cycles":10558208,"thread_start_us":78791,"threads_started":1,"wal-append.queue_time_us":242456}
I20260709 12:10:38.530885 20193 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:38.550581 20184 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:38.555645 19710 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.554505 20154 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:38.578225 20022 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:38.579298 20022 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.549654 20173 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:10:38.583436 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.585505 17434 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:38.584220 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:38.586365 17434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1527) took 1862 ms (client timeout 1912 ms). Trace:
W20260709 12:10:38.587251 17434 rpcz_store.cc:269] 0709 12:10:36.723811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.724286 (+   475us) service_pool.cc:224] Handling call
0709 12:10:38.445848 (+1721562us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b5800177398. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:38.586217 (+140369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4682624}
W20260709 12:10:38.590118 17978 leader_election.cc:336] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.701s (SENT)
I20260709 12:10:38.590698 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.571861 20184 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:38.594267 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 78242.1us
W20260709 12:10:38.603869 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 85178.4us
I20260709 12:10:38.595201 20184 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:38.611915 20092 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:38.612157 20197 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:10:38.595199 20154 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.626034 20023 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:38.610261 19777 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.631412 20099 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:38.636585 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:38.636816 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.644927 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 440) took 2535 ms. Trace:
I20260709 12:10:38.645347 17364 rpcz_store.cc:276] 0709 12:10:36.109191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.109337 (+   146us) service_pool.cc:224] Handling call
0709 12:10:37.929508 (+1820171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.933663 (+  4155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.644733 (+711070us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54003c5850. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:38.644869 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4176070400}
I20260709 12:10:38.645985 17366 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.646374 17978 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:38.647405 20203 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.648983 20193 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:38.043649 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:38.637616 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.652011 17361 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:38.638394 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.652995 17363 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:38.639083 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.639796 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:38.626432 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 53255.7us
I20260709 12:10:38.654080 17362 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:38.640483 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.655345 17365 raft_consensus.cc:2410] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:38.643271 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:38.644649 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.656718 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.659138 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:38.659487 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.659170 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:38.661115 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 56995.5us
I20260709 12:10:38.660290 17362 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:38.659418 20200 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.672084 17366 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:38.674197 17978 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:38.675558 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 55417.8us
I20260709 12:10:38.676728 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.677265 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.678918 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.679445 17365 raft_consensus.cc:2410] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:38.679906 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.680559 17441 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:38.683248 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.685647 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.686458 18007 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:38.795877 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.918426 17333 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:38.775787 20200 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.919526 19964 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.757727 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.920183 19964 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.920531 18014 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:38.920600 19964 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.695832 17434 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:38.696732 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:38.677982 20203 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:38.922698 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.792397 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 679) took 2189 ms. Trace:
I20260709 12:10:38.777498 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:38.687239 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 82072.6us
W20260709 12:10:38.935721 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 238738us
I20260709 12:10:38.866832 19860 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.821112 20184 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:38.934852 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.922894 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:38.946471 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.947417 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.687616 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.802462 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.757370 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:38.797330 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 1.35189e+06us
W20260709 12:10:38.789508 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.804149 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:38.961294 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.962442 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:38.696448 19986 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.228s
I20260709 12:10:38.926386 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.964700 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:38.965286 17434 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:38.965365 17440 raft_consensus.cc:2376] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5. Re-sending same reply.
I20260709 12:10:38.968991 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.969887 17364 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:38.881567 20020 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:38.943177 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:38.935961 18012 rpcz_store.cc:276] 0709 12:10:36.602475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.953679 (+351204us) service_pool.cc:224] Handling call
0709 12:10:37.401323 (+447644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.402075 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.792134 (+1390059us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540045c4d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:38.792318 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990447872}
I20260709 12:10:38.980052 18014 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.914804 20151 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.971886 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.825052 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 667) took 1727 ms. Trace:
I20260709 12:10:38.856969 20154 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:38.940145 17435 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.972643 18011 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:38.972564 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:38.972983 17333 leader_election.cc:336] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 1.649s (SENT)
W20260709 12:10:38.989260 17406 connection.cc:256] RPC call timeout handler was delayed by -1.4515890740001396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2667s for a response
I20260709 12:10:38.934945 20205 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:38.975425 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:38.979158 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:38.954600 18006 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:38.981319 17361 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:38.994280 17440 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.982218 17359 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:38.987316 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:38.995795 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:38.987965 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:38.973380 17438 raft_consensus.cc:2368] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5.
I20260709 12:10:38.998762 17283 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.813333 19710 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:38.994565 17437 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
W20260709 12:10:38.994407 17406 connection.cc:256] RPC call timeout handler was delayed by -1.3867624350000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2644s for a response
I20260709 12:10:39.005468 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:39.000901 17406 leader_election.cc:336] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.641s (SENT)
I20260709 12:10:39.008438 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:39.015481 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 357833us
I20260709 12:10:39.016824 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:39.031769 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:39.061348 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.032613 17359 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:39.096947 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 75821.9us
I20260709 12:10:39.097275 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:39.102525 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 95483.7us
I20260709 12:10:39.104516 18013 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:38.979153 19848 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:39.108474 17333 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:39.112479 17255 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:39.126395 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 125513us
I20260709 12:10:38.992139 20154 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:39.096179 19777 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.130366 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:39.131237 17366 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:10:39.135043 20204 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:10:39.114751 19998 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.140111 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:39.119527 20188 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.119899 20023 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.155719 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:39.132938 17363 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:39.146940 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 472797us
W20260709 12:10:39.150666 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.153083 17359 raft_consensus.cc:2410] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:39.140937 17364 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:39.003609 20205 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:39.168841 17978 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:39.160966 17440 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:10:39.184490 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 66730.1us
I20260709 12:10:39.146770 19986 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.155197 20023 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:39.208050 20185 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:39.163787 20207 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.080s	user 0.001s	sys 0.001s
I20260709 12:10:39.161737 19777 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:39.217983 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 62345us
W20260709 12:10:39.220953 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 52198.2us
I20260709 12:10:39.226230 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:39.205976 19986 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:39.206852 18010 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:39.221349 20112 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.241748 20226 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.244393 20188 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.246976 17406 leader_election.cc:336] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.524s (SENT)
W20260709 12:10:39.408056 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 161115us
W20260709 12:10:39.408751 17406 leader_election.cc:336] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.533s (SENT)
I20260709 12:10:39.409134 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:39.248914 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 135647us
W20260709 12:10:39.226559 20159 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:10:39.241798 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 133122us
I20260709 12:10:39.219966 20023 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:39.444607 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 221122us
I20260709 12:10:39.256942 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:39.224009 19777 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.264282 17359 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:39.410508 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:39.439046 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1536) took 1010 ms. Trace:
W20260709 12:10:39.451121 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.451004 17438 rpcz_store.cc:276] 0709 12:10:38.428324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.428448 (+   124us) service_pool.cc:224] Handling call
0709 12:10:39.438781 (+1010333us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400162454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:39.438963 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217311104}
I20260709 12:10:39.472334 18015 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:39.255470 19986 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.477097 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:39.260288 20200 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:39.485292 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 76571.7us
W20260709 12:10:39.430855 20207 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
W20260709 12:10:39.481424 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 277281us
I20260709 12:10:39.565178 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:39.627579 17285 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.487816 20167 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.635354 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.077s	sys 0.150s
W20260709 12:10:39.628837 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 402715us
W20260709 12:10:39.568372 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 122403us
W20260709 12:10:39.630205 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.633657 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:39.554140 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.636837 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:39.635887 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.077s	sys 0.151s
W20260709 12:10:39.637236 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.639266 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.639731 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.493368 20179 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.488085 20097 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:39.639326 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 162316us
W20260709 12:10:39.654954 18014 consensus_meta.cc:287] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.002s
I20260709 12:10:39.655501 18014 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:39.656212 18007 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:39.658366 20154 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:39.659068 20154 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.659787 20154 consensus_queue.cc:1059] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.448614 20188 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:39.633836 19964 consensus_meta.cc:287] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.001s
I20260709 12:10:39.626144 19710 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:39.634133 18009 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 665) took 2471 ms (client timeout 1796 ms). Trace:
I20260709 12:10:39.693495 17285 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:39.661228 20084 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.651906 20203 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.697484 17980 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:39.666085 19848 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:39.721946 20003 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:39.722643 20228 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.722584 20003 raft_consensus.cc:697] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:38.982825 18008 rpcz_store.cc:276] 0709 12:10:37.097891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.471406 (+373515us) service_pool.cc:224] Handling call
0709 12:10:37.515391 (+ 43985us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:37.909032 (+393641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.909068 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:37.909664 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 12:10:38.145971 (+236307us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:38.223557 (+ 77586us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.261970 (+ 38413us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.279565 (+ 17595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.288403 (+  8838us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.820470 (+532067us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18002d8ce0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e3f3 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
0709 12:10:38.824774 (+  4304us) raft_consensus.cc:1685] finished
0709 12:10:38.824798 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.824974 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1474282,"prepare.queue_time_us":96992,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":72,"raft.queue_time_us":377761,"raft.run_cpu_time_us":568,"raft.run_wall_time_us":1090955,"spinlock_wait_cycles":5312256,"thread_start_us":267343,"threads_started":2,"wal-append.queue_time_us":257477}
W20260709 12:10:39.728645 20221 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:39.732506 20237 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:39.777807 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 367376us
I20260709 12:10:39.765317 19710 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:10:39.700152 20084 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.781311 20084 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.701310 19860 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:39.784770 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:39.693090 18009 rpcz_store.cc:269] 0709 12:10:37.097398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.111456 (+ 14058us) service_pool.cc:224] Handling call
0709 12:10:39.486335 (+2374879us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400633dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:39.500402 (+ 14067us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802087296}
I20260709 12:10:39.789157 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:39.790460 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:39.792048 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:39.776094 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 343984us
W20260709 12:10:39.735131 20211 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.583s	user 0.001s	sys 0.000s
I20260709 12:10:39.810546 20003 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:39.765614 20228 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:39.814049 20228 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.685488 19964 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:39.822995 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 170103us
W20260709 12:10:39.831600 17283 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.817s	user 0.006s	sys 0.003s
I20260709 12:10:39.832050 17283 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:39.804718 19848 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.778321 20237 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.833717 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:10:39.842547 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 205774us
I20260709 12:10:39.848222 17258 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:39.830241 20205 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:39.842192 20237 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:39.858831 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 225241us
I20260709 12:10:39.846684 19400 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:39.867980 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.868671 17440 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:10:39.868723 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:39.837165 20232 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.866231 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.858741 20236 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:39.846200 20224 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:39.874377 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.845513 20235 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.844586 19848 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:39.876677 17439 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:39.868716 20206 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 12:10:39.877823 20084 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:39.898939 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:39.878901 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.879429 19964 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:39.899618 18015 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:39.871454 20232 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:39.880532 17437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:10:39.900079 17358 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:39.900418 17437 raft_consensus.cc:606] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:39.900779 17437 raft_consensus.cc:614] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:39.901101 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.877444 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.901818 17438 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:39.901597 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:39.892822 17432 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:39.902091 17433 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:39.902416 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:39.903664 20232 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.893281 20235 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.900102 19964 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.904771 19964 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.905113 19964 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.905931 19848 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:39.901660 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.883975 19400 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:39.899569 20084 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:39.877385 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.893687 20224 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:39.896116 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 259624us
I20260709 12:10:39.910900 17437 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:39.910866 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:39.911556 17367 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.904340 20235 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.872604 20022 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.900422 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:39.925758 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 133761us
I20260709 12:10:39.926764 17333 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:39.926836 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:39.894266 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:39.925273 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:39.937656 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.939055 17434 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:39.941409 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:39.939750 17358 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:39.918824 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:39.942195 17434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:10:39.920382 20013 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.941362 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:39.916461 20239 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.947811 18015 raft_consensus.cc:2410] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:39.954802 18006 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:39.938949 20151 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.955s	user 0.009s	sys 0.002s
I20260709 12:10:39.946872 17434 raft_consensus.cc:606] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:39.952080 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:39.921574 20236 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:39.670008 20097 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:39.943578 17435 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.937s	user 0.010s	sys 0.001s
I20260709 12:10:39.966142 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.968801 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:39.968983 17433 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:39.969545 17440 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:39.962006 18011 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:39.871030 20241 consensus_queue.cc:1059] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:10:39.943842 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:39.981931 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.717072 20203 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:39.984350 20223 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:10:39.985510 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1549) took 1068 ms. Trace:
I20260709 12:10:39.986495 20151 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.985888 17436 rpcz_store.cc:276] 0709 12:10:38.916923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.968228 (+ 51305us) service_pool.cc:224] Handling call
0709 12:10:38.985671 (+ 17443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.986019 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:38.986049 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:38.992089 (+  6040us) log.cc:844] Serialized 26 byte log entry
0709 12:10:39.428436 (+436347us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:39.428476 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.428548 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.985298 (+556750us) raft_consensus.cc:1685] finished
0709 12:10:39.985319 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.985452 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29459,"raft.queue_time_us":2961,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8622,"thread_start_us":322487,"threads_started":1,"wal-append.queue_time_us":694724}
I20260709 12:10:39.986084 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:39.988425 17434 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:39.927693 19942 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:40.002657 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:40.003258 18013 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.961750 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 139339us
I20260709 12:10:40.004268 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:39.902886 20191 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:10:39.974789 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 680) took 1197 ms. Trace:
I20260709 12:10:39.965116 19848 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:39.979388 20236 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:39.654644 20167 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:39.982259 19400 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:39.982923 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:40.007268 17432 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:39.971065 17366 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:40.008078 17366 pending_rounds.cc:85] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 7
I20260709 12:10:40.008353 17366 pending_rounds.cc:107] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:40.008584 17366 raft_consensus.cc:2889] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:39.963770 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:40.009408 17437 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.001519 17367 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:40.005275 18007 rpcz_store.cc:276] 0709 12:10:38.777780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.960256 (+182476us) service_pool.cc:224] Handling call
0709 12:10:39.656029 (+695773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.656648 (+   619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.974587 (+317939us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b540061a150. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:39.974723 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553901824}
I20260709 12:10:40.032430 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:40.034461 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.961392 20238 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.939662 20245 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 12:10:40.037526 17258 connection.cc:256] RPC call timeout handler was delayed by -1.9554195609998715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 12:10:40.045059 17258 connection.cc:256] RPC call timeout handler was delayed by -1.862719560999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 12:10:40.045444 17258 connection.cc:256] RPC call timeout handler was delayed by -1.2732195609999053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2554s for a response
I20260709 12:10:40.044528 18011 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:39.987210 20151 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:10:40.049911 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.970842 17435 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:40.002525 20188 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:40.010299 20185 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:40.054514 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 93095.5us
W20260709 12:10:40.055714 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 50976.1us
I20260709 12:10:39.965236 20179 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:10:40.059214 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.061419 17255 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.033382 20239 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:40.064271 20238 raft_consensus.cc:3055] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.064792 17433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:10:40.071623 17433 raft_consensus.cc:606] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:40.071993 17433 raft_consensus.cc:614] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:40.065606 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:40.040865 20191 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:40.040758 20246 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.037528 19848 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:40.068456 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:40.075582 18013 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:39.960353 20242 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 12:10:40.078603 17361 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.077374 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.067373 20185 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.082338 20151 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.083406 20185 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:40.085460 20234 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.840s	user 0.003s	sys 0.000s
W20260709 12:10:40.072840 20112 consensus_meta.cc:287] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.000s
I20260709 12:10:40.086998 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:40.091035 17437 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:40.097337 20154 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:40.097790 20242 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.098191 20154 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.098721 20242 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.100739 20154 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.100984 20242 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.101624 20242 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:40.101378 20154 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:40.102679 17255 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.062083 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 475) took 1395 ms. Trace:
I20260709 12:10:40.106835 20261 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.108974 17435 rpcz_store.cc:276] 0709 12:10:38.666525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.673760 (+  7235us) service_pool.cc:224] Handling call
0709 12:10:40.056268 (+1382508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:40.109140 20261 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.109874 20261 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.110127 20112 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.112372 17361 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:40.113513 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:40.074654 20239 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.075255 20191 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:40.095177 20246 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:40.095489 20023 consensus_meta.cc:287] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.602s	user 0.004s	sys 0.007s
I20260709 12:10:40.071267 20238 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:40.115124 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:40.130648 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:40.131523 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:40.134330 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:40.135382 17361 raft_consensus.cc:2410] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:40.137394 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:40.138067 18013 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:40.082701 20013 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:40.135843 17978 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:40.102020 20242 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:40.153955 17358 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:40.137566 17333 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:40.156790 20151 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.157210 20151 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.157554 20151 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.150484 20013 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.041064 20224 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.161958 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:40.118251 20239 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.115653 19964 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.150408 19942 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:40.122540 20023 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.160193 20242 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.117466 20261 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.114071 20232 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:40.172960 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 92123.4us
I20260709 12:10:40.161306 20250 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.161836 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:40.182507 20263 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:40.183020 20263 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:40.183396 20263 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.183605 20167 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.119589 20191 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.184598 20191 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.116058 19848 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.189668 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:40.194658 17283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f462146b97ed46f2821bee27630d0218"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:33950
I20260709 12:10:40.175247 20224 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.199669 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.203166 20232 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.204276 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:40.204856 20261 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.205729 17366 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:40.207594 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:40.208354 18013 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:40.174192 20084 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:10:40.198128 20250 raft_consensus.cc:697] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:40.198196 20253 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:40.199024 17435 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:40.200925 20246 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.221923 20232 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.224582 20261 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.220885 20254 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:40.269399 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.270067 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.275722 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.290390 17333 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.542s (SENT) [suppressed 31 similar messages]
W20260709 12:10:40.290833 17332 connection.cc:256] RPC call timeout handler was delayed by -1.4877049070000794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 12:10:40.291356 17332 connection.cc:256] RPC call timeout handler was delayed by -1.3806049069999062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 12:10:40.291695 17332 connection.cc:256] RPC call timeout handler was delayed by -1.2834049069999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 12:10:40.250496 20261 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:40.293502 17332 connection.cc:256] RPC call timeout handler was delayed by -1.2303049069998906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 12:10:40.294374 20265 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.294149 20257 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:40.294512 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:40.274595 20259 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:40.288172 20023 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.286804 20203 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:10:40.286024 19964 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.309206 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:40.181785 20238 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.313055 17433 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.323807 20184 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.310971 20261 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.240264 20253 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.325320 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 681) took 1502 ms. Trace:
W20260709 12:10:40.328135 17406 leader_election.cc:336] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.948s (SENT)
I20260709 12:10:40.332335 17255 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:40.254431 20254 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.341588 18012 rpcz_store.cc:276] 0709 12:10:38.822562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.993546 (+170984us) service_pool.cc:224] Handling call
0709 12:10:39.008071 (+ 14525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.097812 (+ 89741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:39.097848 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:39.226117 (+128269us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b1800397ba0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229fc2a6 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a
0709 12:10:39.980713 (+754596us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b2c000b05a8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:10:39.981250 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.048715 (+ 67465us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:40.048751 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.048823 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.325046 (+276223us) raft_consensus.cc:1685] finished
0709 12:10:40.325074 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.325235 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87982,"raft.queue_time_us":96841,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4975,"spinlock_wait_cycles":28531200,"thread_start_us":67080,"threads_started":1,"wal-append.queue_time_us":177857}
W20260709 12:10:40.344116 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 144517us
I20260709 12:10:40.269624 20228 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.339478 17435 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.387159 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:40.387434 20235 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.387871 20023 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.391294 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 63200.9us
W20260709 12:10:40.355203 20003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.014s
W20260709 12:10:40.391933 17406 leader_election.cc:336] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.058s (SENT)
I20260709 12:10:40.396448 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:40.392345 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 60111.9us
I20260709 12:10:40.392903 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:40.393151 17438 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:40.397694 17358 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.347323 20232 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.399307 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.401751 17284 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:40.394290 20003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.004s	sys 0.014s
I20260709 12:10:40.414561 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:40.417798 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.418368 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.414678 17292 raft_consensus.cc:1217] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 12:10:40.419137 17292 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:40.417205 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:40.420704 17358 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:40.316716 20265 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:40.426389 19777 consensus_meta.cc:287] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.933s	user 0.008s	sys 0.004s
I20260709 12:10:40.393949 20262 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.395951 20022 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.434257 17255 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:40.418781 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.440718 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 150345us
W20260709 12:10:40.428194 19986 consensus_meta.cc:287] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.927s	user 0.012s	sys 0.000s
I20260709 12:10:40.404970 19864 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:40.399262 20023 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.458676 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2393) took 1509 ms. Trace:
I20260709 12:10:40.504050 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:40.492708 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:40.497781 17406 leader_election.cc:336] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.314s (SENT)
I20260709 12:10:40.442437 17333 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:40.481922 17433 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:40.527786 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:40.530671 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:40.531261 17434 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
W20260709 12:10:40.533315 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 90950.7us
W20260709 12:10:40.542547 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 44820.5us
I20260709 12:10:40.545493 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:40.456696 20232 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:40.528915 17365 rpcz_store.cc:276] 0709 12:10:38.949230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.949341 (+   111us) service_pool.cc:224] Handling call
0709 12:10:38.971333 (+ 21992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.971540 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:39.123045 (+151505us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.458039 (+1334994us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b180029dd60. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12256c34bc 00007f1222a1148b 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb23a
0709 12:10:40.458289 (+   250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:40.458345 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:40.458402 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.458468 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.458601 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8287,"prepare.queue_time_us":278578,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":1657,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":35861632,"thread_start_us":417342,"threads_started":2,"wal-append.queue_time_us":551441}
I20260709 12:10:40.541770 17981 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:40.551908 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:40.552222 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:40.552837 18012 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.552603 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:40.492565 20203 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:40.411712 20264 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 12:10:40.555493 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:10:40.472198 20215 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 1.470s	user 0.018s	sys 0.036s
I20260709 12:10:40.498327 20020 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:40.531513 20225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.283s	user 0.006s	sys 0.002s
I20260709 12:10:40.559403 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:40.554730 19998 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:10:40.562429 19942 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:40.562691 20272 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:10:40.388487 20250 consensus_queue.cc:237] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.436182 19777 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.590521 17360 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:40.564895 20265 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.594869 17406 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:40.567492 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.455888 20235 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.542183 20249 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:40.576831 20225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.007s	sys 0.003s
I20260709 12:10:40.580906 18012 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:40.614705 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:40.575867 20232 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:40.583997 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:40.592548 17365 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 4. Ops: []
I20260709 12:10:40.581714 20167 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.579764 19942 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.623183 17333 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.624120 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.597692 20246 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:40.529314 19986 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.468017 20151 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:40.577159 20271 log.cc:927] Time spent T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:10:40.615527 18012 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:40.550643 20193 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.552469 20191 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:40.566620 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:40.621284 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.638728 18013 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.639196 17287 raft_consensus.cc:2410] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:40.605412 20249 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.613974 19864 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:40.571898 20203 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.645262 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.596426 20255 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:10:40.576678 20020 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.642233 20246 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:40.645939 20249 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.627264 19942 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.629949 19848 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:40.637228 20265 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.657173 18012 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:40.610570 20227 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:40.637784 20169 raft_consensus.cc:3055] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:40.670518 20169 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:40.671433 18013 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:40.671620 20169 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.618381 20179 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:40.664335 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.645802 19964 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:40.673619 19964 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:40.678447 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.706640 19848 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:40.710183 17283 raft_consensus.cc:606] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:40.700014 20271 log.cc:927] Time spent T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:40.658090 20253 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.705119 19964 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.719094 17407 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:40.662329 19864 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:10:40.722321 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:40.720068 20265 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:40.723717 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:40.717468 17466 heartbeater.cc:646] Failed to heartbeat to 127.15.191.126:37225 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.191.126:37225 timed out after 15.000s (SENT)
W20260709 12:10:40.720364 20283 log.cc:927] Time spent T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:40.664726 20013 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.733647 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.733196 20023 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:40.737025 20281 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:10:40.738358 20013 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.729241 20179 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:10:40.739332 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:40.728974 20278 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:10:40.740001 17290 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:40.727239 20191 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:40.740752 20280 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:40.757867 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:40.758720 20289 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.759358 20289 raft_consensus.cc:697] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:40.760365 20289 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:40.763393 20219 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 1.479s	user 0.004s	sys 0.000s
I20260709 12:10:40.764973 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1543) took 2020 ms. Trace:
I20260709 12:10:40.766300 20265 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.765424 17441 rpcz_store.cc:276] 0709 12:10:38.744930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.776303 (+ 31373us) service_pool.cc:224] Handling call
0709 12:10:38.808369 (+ 32066us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:38.934218 (+125849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:38.934252 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:38.945348 (+ 11096us) log.cc:844] Serialized 52 byte log entry
0709 12:10:39.155892 (+210544us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:39.449457 (+293565us) log.cc:844] Serialized 14 byte log entry
0709 12:10:39.488789 (+ 39332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.488871 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.719698 (+1230827us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:40.764567 (+ 44869us) raft_consensus.cc:1685] finished
0709 12:10:40.764707 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.764897 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42427,"prepare.queue_time_us":575035,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":41758,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":72578,"spinlock_wait_cycles":27417344,"thread_start_us":421199,"threads_started":2,"wal-append.queue_time_us":275865}
I20260709 12:10:40.742609 20239 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:40.747140 20263 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 12:10:40.779157 20263 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.780771 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.781489 20263 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.781819 17292 raft_consensus.cc:2410] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:40.711133 20232 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.735666 20203 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.733624 20261 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.782632 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:40.755908 20237 consensus_meta.cc:287] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.886s	user 0.012s	sys 0.000s
I20260709 12:10:40.739959 20246 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.785574 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:40.851500 17432 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.842841 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:40.843371 20243 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.838596 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.836745 20228 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:40.844727 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:40.853654 18007 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.845664 17441 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:40.846211 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:40.846877 20261 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.836881 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:40.855851 18010 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:40.785868 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:40.852350 17292 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.852684 17258 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:40.859871 17433 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.837276 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:40.861272 20264 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:40.862203 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.862646 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:40.856781 20243 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.863399 20264 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:40.863782 20264 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:40.864130 20264 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:40.864675 20243 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:40.862838 17288 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
W20260709 12:10:40.865442 17406 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.911s (SENT)
I20260709 12:10:40.865080 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.735473 19848 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.867547 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:40.805823 20239 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:40.873872 18007 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:40.874612 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.876236 17288 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:40.854712 20237 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.882512 20222 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:40.884467 20237 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.884352 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.858191 20154 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.885246 17288 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:40.875574 20013 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:40.885499 20154 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:40.886086 20013 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.886708 20013 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.861560 18008 raft_consensus.cc:2376] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8. Re-sending same reply.
I20260709 12:10:40.857295 20151 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.888583 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:40.894778 20154 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:40.879966 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:40.897584 18007 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:10:40.888429 17433 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:40.865255 19986 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:40.903455 17406 leader_election.cc:336] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.949s (SENT)
I20260709 12:10:40.911188 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:40.913012 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:40.915890 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:40.907617 17292 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:40.908174 20255 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.923979 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:40.909608 20231 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.099s	user 0.003s	sys 0.000s
I20260709 12:10:40.917244 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:40.917400 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.890197 20261 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:40.919559 20242 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.000s
I20260709 12:10:40.938280 20261 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:40.938745 20261 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.938455 20242 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.939165 20249 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:40.940694 20242 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:40.908730 20293 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:10:40.925443 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:40.927363 19986 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.942152 19942 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.942967 20255 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:40.944344 19942 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:10:40.914402 19864 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.928530 20295 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:40.935150 17435 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.531s	user 0.002s	sys 0.006s
I20260709 12:10:40.936896 19964 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.942580 19986 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:40.943912 20255 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.934346 20239 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.945343 17290 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:40.931738 20013 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.945997 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:40.951117 17432 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
W20260709 12:10:40.938856 20224 consensus_meta.cc:287] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.000s
I20260709 12:10:40.923182 20154 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.954073 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.959856 17292 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:40.960546 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:40.960747 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:40.961903 19864 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.962378 19864 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:40.961871 20289 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.960407 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:40.964423 17288 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.964712 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:40.954700 19986 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.962741 19864 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.950598 20242 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.951768 17435 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:40.973179 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:40.959334 20222 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:40.966945 20154 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.982548 20013 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.984792 19964 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:40.988142 20264 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:40.970048 20224 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.997037 20251 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:40.997545 20251 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:40.998446 20251 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:40.999212 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1479) took 1017 ms. Trace:
I20260709 12:10:40.999444 20251 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.001127 17438 rpcz_store.cc:276] 0709 12:10:39.982203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.982332 (+   129us) service_pool.cc:224] Handling call
0709 12:10:39.982639 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:40.397702 (+415063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.998954 (+601252us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5400037854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:40.999151 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943635840}
I20260709 12:10:41.003504 19986 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:41.000650 20154 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.011840 20242 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.013471 20274 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:41.013947 17256 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items [suppressed 6 similar messages]
I20260709 12:10:41.015328 20264 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:41.017647 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:41.018831 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:41.014324 17256 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
I20260709 12:10:41.019515 18006 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:41.014155 20224 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:41.020334 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:41.020231 20224 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:41.021570 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:41.022616 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:41.022711 20224 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:41.020166 17256 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
I20260709 12:10:41.015010 20242 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:41.031069 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:41.031675 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:41.032364 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 670) took 1157 ms. Trace:
I20260709 12:10:41.032665 18014 rpcz_store.cc:276] 0709 12:10:39.874532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.874701 (+   169us) service_pool.cc:224] Handling call
0709 12:10:41.031544 (+1156843us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:41.032310 (+   766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20159872}
I20260709 12:10:41.024705 17256 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
I20260709 12:10:41.039430 20154 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:41.041209 20173 raft_consensus.cc:993] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:10:41.047341 20173 raft_consensus.cc:1081] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:10:41.047911 20154 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:41.049264 17292 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:41.041816 17256 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 511)
W20260709 12:10:41.044669 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.045259 20242 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:41.050402 17288 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:41.042649 20261 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:41.060148 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:41.062952 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:41.063620 17288 raft_consensus.cc:2376] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5. Re-sending same reply.
I20260709 12:10:41.037236 19864 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:41.063769 20249 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:41.066780 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:41.067625 20249 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.068616 18014 raft_consensus.cc:1217] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 12:10:41.069103 18014 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:41.053139 17258 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
I20260709 12:10:41.070499 20242 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:41.071058 20242 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:41.073125 20242 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:41.076130 17332 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:41.077179 20023 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.079214 19864 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:41.071427 17258 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
I20260709 12:10:41.082031 20238 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.082734 17289 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:10:41.084180 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.064553 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:41.065021 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:41.084796 20222 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.085165 17291 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:41.065316 19986 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:41.085208 20222 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.091888 20254 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:41.080909 17258 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36408 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
I20260709 12:10:41.095047 19986 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:41.095678 19986 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:41.093767 17258 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 513)
I20260709 12:10:41.097352 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:41.098065 17283 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:41.100432 20233 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.335s	user 0.004s	sys 0.000s
I20260709 12:10:41.097895 17258 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 513)
I20260709 12:10:41.101835 17258 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 513)
I20260709 12:10:41.105733 17283 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:41.106880 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:41.107601 17283 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:41.108565 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:41.109210 17283 raft_consensus.cc:2376] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5. Re-sending same reply.
I20260709 12:10:41.110167 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:41.111173 17333 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:41.124639 20258 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.942s	user 0.000s	sys 0.005s
I20260709 12:10:41.125759 20249 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.261435 20261 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:41.163616 20226 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:41.513163 20222 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:41.290499 20250 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.260874 20304 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:10:41.707762 20226 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:41.707947 20250 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:41.707182 20249 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:41.707984 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2417) took 1801 ms. Trace:
I20260709 12:10:41.125998 20097 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:41.124624 20239 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.586s
I20260709 12:10:41.124650 17283 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:41.291534 20251 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.710258 20249 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:41.712255 20251 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:10:41.488171 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.711649 20023 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:41.714432 20023 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:41.715292 20023 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:41.716507 20023 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.710500 17362 rpcz_store.cc:276] 0709 12:10:39.906624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.917949 (+ 11325us) service_pool.cc:224] Handling call
0709 12:10:39.918563 (+   614us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:39.929502 (+ 10939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:39.929551 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:39.946664 (+ 17113us) log.cc:844] Serialized 616 byte log entry
0709 12:10:40.032607 (+ 85943us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:40.032651 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.032720 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.109218 (+1076498us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b24003f3188. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12228b49c4 00007f12228b2acb 00007f1222a6ddc9 00007f1222a6da55 00007f1222a6d09d 00007f122569f10e 00007f12256b688c 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221
0709 12:10:41.705879 (+596661us) raft_consensus.cc:1685] finished
0709 12:10:41.705902 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.707916 (+  2014us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2750,"raft.queue_time_us":23070,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4415,"spinlock_wait_cycles":4457216,"thread_start_us":51809,"threads_started":1,"wal-append.queue_time_us":141960}
I20260709 12:10:41.710027 20226 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:41.711616 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1523) took 1276 ms. Trace:
I20260709 12:10:41.726517 17283 rpcz_store.cc:276] 0709 12:10:40.435758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.109915 (+674157us) service_pool.cc:224] Handling call
0709 12:10:41.711548 (+601633us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:41.727643 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:41.735998 17283 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:41.738023 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1505) took 1332 ms. Trace:
I20260709 12:10:41.738929 17283 rpcz_store.cc:276] 0709 12:10:40.405479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.727395 (+1321916us) service_pool.cc:224] Handling call
0709 12:10:41.737958 (+ 10563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:41.740456 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:41.742125 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1527) took 1195 ms. Trace:
I20260709 12:10:41.743192 17283 rpcz_store.cc:276] 0709 12:10:40.546947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.740197 (+1193250us) service_pool.cc:224] Handling call
0709 12:10:41.742046 (+  1849us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:41.322381 17406 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.076s (SENT)
I20260709 12:10:41.750351 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:41.758942 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:41.764081 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2394) took 1114 ms. Trace:
I20260709 12:10:41.764500 17283 rpcz_store.cc:276] 0709 12:10:40.649951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.758635 (+1108684us) service_pool.cc:224] Handling call
0709 12:10:41.763980 (+  5345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:41.768925 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:41.776623 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:41.753126 20023 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:41.780128 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:41.441566 19964 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:41.772256 17258 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 513)
I20260709 12:10:41.450013 20020 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:41.788938 19986 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:41.789954 20255 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:41.786594 20023 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:41.811215 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:41.813841 17286 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:41.816164 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2395) took 1152 ms. Trace:
W20260709 12:10:41.806962 20238 consensus_meta.cc:287] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.724s	user 0.006s	sys 0.004s
I20260709 12:10:41.816576 17286 rpcz_store.cc:276] 0709 12:10:40.663599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.798499 (+1134900us) service_pool.cc:224] Handling call
0709 12:10:41.816088 (+ 17589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:41.789530 19964 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:41.810354 20255 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:41.855922 17285 raft_consensus.cc:2410] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:41.871265 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:41.878931 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2392) took 1260 ms. Trace:
I20260709 12:10:41.879328 17286 rpcz_store.cc:276] 0709 12:10:40.626207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.853954 (+1227747us) service_pool.cc:224] Handling call
0709 12:10:41.875165 (+ 21211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:41.887643 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:41.889919 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 472) took 1448 ms. Trace:
I20260709 12:10:41.889110 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:41.892840 17286 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:41.891075 17366 rpcz_store.cc:276] 0709 12:10:40.441894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.478590 (+ 36696us) service_pool.cc:224] Handling call
0709 12:10:40.492121 (+ 13531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.524455 (+ 32334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.524486 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.540066 (+ 15580us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.856168 (+316102us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:40.875887 (+ 19719us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.876111 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.885577 (+1009466us) spinlock_profiling.cc:243] Waited 7.21 ms on lock 0x7b5400242cd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:41.885650 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.885714 (+    64us) raft_consensus.cc:1685] finished
0709 12:10:41.889646 (+  3932us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.889828 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1498,"prepare.queue_time_us":19992,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":27579,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":28356,"spinlock_wait_cycles":16577792,"thread_start_us":254438,"threads_started":1,"wal-append.queue_time_us":294659}
I20260709 12:10:41.897014 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:41.903627 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.905061 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.125501 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:42.126557 19964 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.126753 20003 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.128330 20003 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.130551 20003 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:42.131582 19400 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:42.131979 20262 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:41.888626 19986 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.132547 20262 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.189743 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:41.891515 20188 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.185647 20003 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:42.197115 19986 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:42.177176 19400 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.197943 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:42.192276 20255 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:42.230515 20305 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
W20260709 12:10:42.213188 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 890775us
W20260709 12:10:42.247826 17406 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.190s (SENT)
I20260709 12:10:42.248309 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:42.208211 17283 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:10:42.249287 17283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1528) took 1693 ms (client timeout 2214 ms). Trace:
W20260709 12:10:42.250654 17283 rpcz_store.cc:269] 0709 12:10:40.555547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.189437 (+1633890us) service_pool.cc:224] Handling call
0709 12:10:42.249223 (+ 59786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.252807 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:42.217267 20003 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.218003 19986 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:42.258975 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:42.262291 19710 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:42.263679 20306 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:42.264880 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.268347 20251 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:42.229830 20023 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:42.272339 17981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.130s	sys 0.158s
W20260709 12:10:42.274217 17406 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.230s (SENT)
I20260709 12:10:42.291098 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:42.270977 20022 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.277906 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:42.278262 19964 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:42.280372 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:42.281697 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:42.294396 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:42.295217 17365 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:42.294361 17364 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.297719 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:42.298481 17360 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:42.306324 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:42.306978 17360 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:42.280417 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1537) took 1186 ms. Trace:
I20260709 12:10:42.283953 17286 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:10:42.286232 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.286748 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1489) took 1884 ms. Trace:
W20260709 12:10:42.308094 17286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1504) took 1902 ms (client timeout 2454 ms). Trace:
W20260709 12:10:42.308120 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.288813 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:42.289518 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:42.310045 17361 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.290192 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:42.292331 17981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.130s	sys 0.158s
I20260709 12:10:42.293018 17363 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:42.308535 17286 rpcz_store.cc:269] 0709 12:10:40.405310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.245152 (+1839842us) service_pool.cc:224] Handling call
0709 12:10:42.308033 (+ 62881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.310642 17360 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:42.335732 18007 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:42.307799 17283 rpcz_store.cc:276] 0709 12:10:41.093454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.252523 (+1159069us) service_pool.cc:224] Handling call
0709 12:10:42.280354 (+ 27831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.335729 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:42.337522 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:42.338359 17283 raft_consensus.cc:2368] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4.
I20260709 12:10:42.309707 17285 rpcz_store.cc:276] 0709 12:10:40.398905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.399020 (+   115us) service_pool.cc:224] Handling call
0709 12:10:42.283320 (+1884300us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54000514d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:42.283457 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3339796352}
I20260709 12:10:42.338801 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1531) took 1288 ms. Trace:
I20260709 12:10:42.337806 17359 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:42.339152 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.341383 17285 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:42.293915 20022 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.342741 18011 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:42.291369 19710 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.342949 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:42.339553 17366 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:42.300995 20306 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:42.339193 17283 rpcz_store.cc:276] 0709 12:10:41.050799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.337280 (+1286481us) service_pool.cc:224] Handling call
0709 12:10:42.338747 (+  1467us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:42.341964 17333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.002s	sys 0.013s
W20260709 12:10:42.345296 17333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.002s	sys 0.013s
I20260709 12:10:42.345919 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:42.345597 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:42.347255 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1534) took 1266 ms. Trace:
I20260709 12:10:42.347553 17283 rpcz_store.cc:276] 0709 12:10:41.080540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.345302 (+1264762us) service_pool.cc:224] Handling call
0709 12:10:42.347198 (+  1896us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:42.345604 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 566355us
I20260709 12:10:42.348886 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.349557 17283 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:42.350322 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2406) took 1570 ms. Trace:
I20260709 12:10:42.350684 17283 rpcz_store.cc:276] 0709 12:10:40.779603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.348660 (+1569057us) service_pool.cc:224] Handling call
0709 12:10:42.350268 (+  1608us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:42.303414 20265 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.005s	sys 0.009s
I20260709 12:10:42.344705 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2405) took 1565 ms. Trace:
I20260709 12:10:42.351938 17285 rpcz_store.cc:276] 0709 12:10:40.779306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.338909 (+1559603us) service_pool.cc:224] Handling call
0709 12:10:42.344644 (+  5735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.352849 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.352981 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.353425 17285 raft_consensus.cc:2376] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8. Re-sending same reply.
I20260709 12:10:42.353926 17283 raft_consensus.cc:2410] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:42.354562 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1529) took 1410 ms. Trace:
I20260709 12:10:42.353926 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1535) took 1260 ms. Trace:
I20260709 12:10:42.355512 17285 rpcz_store.cc:276] 0709 12:10:41.093079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.352574 (+1259495us) service_pool.cc:224] Handling call
0709 12:10:42.353870 (+  1296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.356472 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.357321 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2407) took 1577 ms. Trace:
I20260709 12:10:42.357715 17285 rpcz_store.cc:276] 0709 12:10:40.779865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.356224 (+1576359us) service_pool.cc:224] Handling call
0709 12:10:42.357267 (+  1043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.358654 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.359263 17285 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:42.359807 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2408) took 1579 ms. Trace:
I20260709 12:10:42.354923 17283 rpcz_store.cc:276] 0709 12:10:40.943795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.352772 (+1408977us) service_pool.cc:224] Handling call
0709 12:10:42.354510 (+  1738us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.360658 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.360858 17361 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:42.361351 17285 rpcz_store.cc:276] 0709 12:10:40.780142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.358416 (+1578274us) service_pool.cc:224] Handling call
0709 12:10:42.359752 (+  1336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.362427 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.363018 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.308732 20262 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.305167 20308 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:42.365465 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 502) took 1397 ms. Trace:
I20260709 12:10:42.366065 17283 rpcz_store.cc:276] 0709 12:10:40.967988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.360422 (+1392434us) service_pool.cc:224] Handling call
0709 12:10:42.365384 (+  4962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.363636 17286 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
W20260709 12:10:42.367390 17286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2393) took 1731 ms (client timeout 2230 ms). Trace:
I20260709 12:10:42.363927 17285 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:42.368371 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 501) took 1401 ms. Trace:
I20260709 12:10:42.368754 17285 rpcz_store.cc:276] 0709 12:10:40.966712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.362203 (+1395491us) service_pool.cc:224] Handling call
0709 12:10:42.368315 (+  6112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.371315 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.371855 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.300840 19964 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.372006 17283 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:42.372709 17285 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:42.308532 19400 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:42.367787 17286 rpcz_store.cc:269] 0709 12:10:40.635748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.336582 (+1700834us) service_pool.cc:224] Handling call
0709 12:10:42.367334 (+ 30752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.373135 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1501) took 1969 ms. Trace:
I20260709 12:10:42.373853 17283 rpcz_store.cc:276] 0709 12:10:40.403955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.371043 (+1967088us) service_pool.cc:224] Handling call
0709 12:10:42.373063 (+  2020us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.375895 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.376899 17286 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:42.377348 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2409) took 1597 ms. Trace:
I20260709 12:10:42.377740 17286 rpcz_store.cc:276] 0709 12:10:40.780425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.375617 (+1595192us) service_pool.cc:224] Handling call
0709 12:10:42.377287 (+  1670us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.347790 20239 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.374348 20262 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.364528 20265 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.005s	sys 0.014s
I20260709 12:10:42.377280 20310 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:42.380491 19986 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:42.381819 17363 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:42.382071 19710 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:42.378747 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.383759 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:42.390400 17286 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:42.391043 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:42.379021 20307 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.397915 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1496) took 1995 ms. Trace:
I20260709 12:10:42.398778 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2400) took 1672 ms. Trace:
I20260709 12:10:42.383016 20240 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.382400 20251 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:42.363950 20306 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.403075 17286 rpcz_store.cc:276] 0709 12:10:40.726551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.378467 (+1651916us) service_pool.cc:224] Handling call
0709 12:10:42.398711 (+ 20244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.384225 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:42.407425 17404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.014s
I20260709 12:10:42.400230 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:42.383713 20226 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.403620 17289 rpcz_store.cc:276] 0709 12:10:40.402475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.402582 (+   107us) service_pool.cc:224] Handling call
0709 12:10:40.414836 (+ 12254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.083138 (+668302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.397645 (+1314507us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b540043eed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:42.397855 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535444352}
W20260709 12:10:42.407923 17404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.009s	sys 0.015s
I20260709 12:10:42.417280 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:42.417620 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:42.418238 17432 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.410791 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.419121 17289 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:42.419727 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1526) took 1890 ms. Trace:
I20260709 12:10:42.420063 17289 rpcz_store.cc:276] 0709 12:10:40.529341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.410564 (+1881223us) service_pool.cc:224] Handling call
0709 12:10:42.419667 (+  9103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.421010 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.421623 17289 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:42.397231 20241 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.407184 19986 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.406154 20003 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:42.443815 20119 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.444753 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.461565 17286 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:42.462010 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2401) took 1731 ms. Trace:
I20260709 12:10:42.379565 20308 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.462323 17286 rpcz_store.cc:276] 0709 12:10:40.730568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.406683 (+1676115us) service_pool.cc:224] Handling call
0709 12:10:42.461949 (+ 55266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.445722 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:42.468405 17437 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.454699 19400 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:42.449761 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 49628.2us
I20260709 12:10:42.426544 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.506512 17289 raft_consensus.cc:2410] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:42.449865 17439 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:42.386958 20262 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.483348 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:42.504262 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 694) took 1780 ms. Trace:
I20260709 12:10:42.388514 20239 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.458017 19986 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:42.458638 20313 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.409618 20251 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.484516 20119 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.392122 20310 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.423348 20226 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.483033 20003 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.424190 17432 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:42.407871 19710 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:42.408561 20307 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.531286 20306 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.534726 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:42.648578 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:42.518065 17437 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:42.525102 20312 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.649744 20312 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:42.651881 20312 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:42.534008 18010 rpcz_store.cc:276] 0709 12:10:40.723682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.856455 (+132773us) service_pool.cc:224] Handling call
0709 12:10:40.856825 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.866222 (+  9397us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:40.866257 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.278134 (+1411877us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b180048a120. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229fc2a6 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a
0709 12:10:42.278829 (+   695us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b2c000b05a8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:10:42.279325 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.444139 (+164814us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:42.444182 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.444529 (+   347us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.503999 (+ 59470us) raft_consensus.cc:1685] finished
0709 12:10:42.504021 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.504181 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1860,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":2369,"spinlock_wait_cycles":22396032,"thread_start_us":160839,"threads_started":1,"wal-append.queue_time_us":164792}
I20260709 12:10:42.536032 20254 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:42.654824 20254 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:42.656886 20254 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:42.657378 20254 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:42.524560 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.649168 17283 raft_consensus.cc:2376] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8. Re-sending same reply.
I20260709 12:10:42.614734 17364 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:42.665625 17361 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:42.645921 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:42.667376 17365 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.530973 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.669056 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:42.669649 17289 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.524869 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:42.646728 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.670894 17288 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
W20260709 12:10:42.716321 17288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1507) took 2297 ms (client timeout 2072 ms). Trace:
I20260709 12:10:42.645915 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:42.716790 17288 rpcz_store.cc:269] 0709 12:10:40.419492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.482116 (+2062624us) service_pool.cc:224] Handling call
0709 12:10:42.716245 (+234129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.671562 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:42.717135 17432 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.592932 17363 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:42.658385 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2390) took 2064 ms. Trace:
I20260709 12:10:42.721751 17286 rpcz_store.cc:276] 0709 12:10:40.593900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.463039 (+1869139us) service_pool.cc:224] Handling call
0709 12:10:42.658322 (+195283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.725775 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:42.726536 18010 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:42.728245 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:42.729091 18010 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:42.662467 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.730605 17283 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:42.661142 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:42.740471 17432 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:42.742213 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1510) took 2316 ms. Trace:
I20260709 12:10:42.742728 17283 rpcz_store.cc:276] 0709 12:10:40.426039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.662238 (+2236199us) service_pool.cc:224] Handling call
0709 12:10:42.742143 (+ 79905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.743913 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.744552 17283 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:42.745389 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.748533 20313 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:42.749039 18010 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:42.588323 19986 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.623427 20226 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.614725 19964 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.662979 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:42.589021 20309 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.617664 20251 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.615887 20239 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.618991 20310 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.533196 20262 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.634385 20119 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:42.626833 20235 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 12:10:42.763185 17283 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:42.595222 20022 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.765085 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:42.795509 17286 raft_consensus.cc:2410] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:42.796005 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1546) took 1025 ms. Trace:
I20260709 12:10:42.796329 17286 rpcz_store.cc:276] 0709 12:10:41.770869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.725167 (+954298us) service_pool.cc:224] Handling call
0709 12:10:42.795938 (+ 70771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.615579 19777 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.621923 20308 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:42.769403 17437 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:42.592741 20003 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.771296 17435 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.633399 19710 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.555575 20241 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.206s
W20260709 12:10:42.925954 20328 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 12:10:42.926311 20241 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:42.926683 20241 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:42.927518 20241 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:42.724160 17364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48992
I20260709 12:10:42.662533 20254 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.773577 20307 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:42.776548 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 502322us
I20260709 12:10:42.777654 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:42.780580 17289 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:42.781668 17432 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:42.932202 17432 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:42.588562 19400 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.784919 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:42.785626 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:42.786451 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:42.787362 17434 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:42.789304 18010 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:42.937531 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 204938us
I20260709 12:10:42.789404 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:42.791450 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:42.938426 18011 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.762563 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:42.941474 17288 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:10:42.941831 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 177407us
I20260709 12:10:42.791905 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:42.619017 20318 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:10:42.793840 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:42.944157 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:42.942657 17363 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:10:42.914973 17283 raft_consensus.cc:1217] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-4.6]   Dedup: 4.6->[]
I20260709 12:10:42.944113 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:42.920099 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:42.767902 19964 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:42.922777 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:42.923026 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:42.922787 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 678) took 1941 ms. Trace:
I20260709 12:10:42.947903 18006 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:42.915032 20312 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:42.924783 17286 raft_consensus.cc:1217] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:10:42.949398 17286 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:42.925335 19710 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:42.929388 17364 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:42.928725 20241 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.934406 17289 raft_consensus.cc:1217] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 12:10:42.954011 17364 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.954499 17289 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:42.955071 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1500) took 2551 ms. Trace:
I20260709 12:10:42.916925 20308 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:42.793321 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.932957 17432 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.943053 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:42.945371 17283 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:10:42.946802 17434 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: [3.3-7.5]
I20260709 12:10:42.948192 18014 rpcz_store.cc:276] 0709 12:10:40.981615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.033479 (+ 51864us) service_pool.cc:224] Handling call
0709 12:10:41.068468 (+ 34989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.069400 (+   932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.922538 (+1853138us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b5400623ed0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:42.922710 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79741824}
I20260709 12:10:42.923414 20003 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:42.949594 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:42.951303 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:42.930054 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:42.955452 17289 rpcz_store.cc:276] 0709 12:10:40.403711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.933960 (+2530249us) service_pool.cc:224] Handling call
0709 12:10:42.934315 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.954827 (+ 20512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.955015 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.957674 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:42.976872 17292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1513) took 2550 ms (client timeout 2013 ms). Trace:
I20260709 12:10:42.978730 17440 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:42.956067 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1498) took 2553 ms. Trace:
I20260709 12:10:42.941944 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1545) took 1178 ms. Trace:
I20260709 12:10:42.749562 20313 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:42.776772 20309 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:42.978927 17289 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:43.635841 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:43.107053 17291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2403) took 2328 ms (client timeout 1720 ms). Trace:
W20260709 12:10:43.091450 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.981281 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:43.637867 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.638187 17439 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:43.638531 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.636646 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.639249 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.061080 18011 raft_consensus.cc:2410] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:43.087877 20306 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.098256 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 413110us
W20260709 12:10:43.052415 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 336529us
W20260709 12:10:42.977330 17292 rpcz_store.cc:269] 0709 12:10:40.426919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.960487 (+533568us) service_pool.cc:224] Handling call
0709 12:10:42.976651 (+2016164us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b540043dfd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:42.976800 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201674624}
I20260709 12:10:43.641741 20306 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:43.643328 17292 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:43.052349 20317 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.644345 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:43.644869 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1497) took 3242 ms. Trace:
I20260709 12:10:43.643939 17359 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:43.645707 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.646817 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:43.647315 17440 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.648118 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:43.649207 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:43.088140 20316 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.650311 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:43.650627 20316 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:43.633569 17365 consensus_meta.cc:287] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.926s	user 0.010s	sys 0.000s
I20260709 12:10:43.268014 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:43.651680 17365 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:10:43.652068 17432 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.652539 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2434) took 1036 ms. Trace:
I20260709 12:10:42.955327 18009 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:43.652998 17365 rpcz_store.cc:276] 0709 12:10:42.616517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.645619 (+ 29102us) service_pool.cc:224] Handling call
0709 12:10:43.652478 (+1006859us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:43.640050 20241 consensus_meta.cc:287] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.001s
I20260709 12:10:43.654065 20241 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.651151 17359 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:42.981249 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:43.654224 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:43.655272 20241 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:42.954706 20222 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:43.656780 17365 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:43.099560 17290 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:43.704457 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1511) took 3278 ms. Trace:
I20260709 12:10:43.075116 17364 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:43.655536 17291 rpcz_store.cc:269] 0709 12:10:40.778646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.106769 (+2328123us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:43.106946 (+   177us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:43.657608 17436 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:42.957472 19964 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:43.658538 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:43.636727 17286 rpcz_store.cc:276] 0709 12:10:40.403209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.914475 (+2511266us) service_pool.cc:224] Handling call
0709 12:10:42.924671 (+ 10196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.955799 (+ 31128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.956004 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.267620 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:43.641359 17288 rpcz_store.cc:276] 0709 12:10:41.764111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.724184 (+960073us) service_pool.cc:224] Handling call
0709 12:10:42.941876 (+217692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.651046 17367 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:43.662159 17283 rpcz_store.cc:276] 0709 12:10:40.402880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.914375 (+2511495us) service_pool.cc:224] Handling call
0709 12:10:42.914839 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:43.644636 (+729797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.644814 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.269997 20254 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:43.636435 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1506) took 3224 ms. Trace:
I20260709 12:10:43.712491 17289 rpcz_store.cc:276] 0709 12:10:40.411955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.978285 (+2566330us) service_pool.cc:224] Handling call
0709 12:10:42.978590 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.636148 (+657558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.636371 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.641192 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:43.655369 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:43.654155 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:43.636652 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 679002us
I20260709 12:10:43.714455 17406 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:43.244145 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:43.714596 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.716035 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.716830 17364 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:43.643911 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1520) took 3214 ms. Trace:
W20260709 12:10:43.680691 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.689559 17432 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:43.719228 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.719411 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:43.720332 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.720630 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:43.718014 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.721436 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.717104 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.718294 17291 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:43.673300 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:43.717813 17292 rpcz_store.cc:276] 0709 12:10:40.429077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.642815 (+3213738us) service_pool.cc:224] Handling call
0709 12:10:43.643164 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.643697 (+   533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.643862 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.728619 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1521) took 3299 ms. Trace:
I20260709 12:10:42.957113 20307 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:43.722337 17434 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:43.729086 17291 rpcz_store.cc:276] 0709 12:10:40.429320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.710281 (+3280961us) service_pool.cc:224] Handling call
0709 12:10:43.710576 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.722801 (+ 12225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.728535 (+  5734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.730527 17434 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:43.661093 20317 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:43.704828 17290 rpcz_store.cc:276] 0709 12:10:40.426360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.098844 (+2672484us) service_pool.cc:224] Handling call
0709 12:10:43.099196 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.704147 (+604951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.704395 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.710633 17440 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:43.732999 17289 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:10:43.702999 17981 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.015s	sys 0.059s
I20260709 12:10:43.711553 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.720822 17432 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:43.644447 20306 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:43.183490 20332 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.738809 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:43.744823 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2389) took 3168 ms. Trace:
I20260709 12:10:43.745416 17289 rpcz_store.cc:276] 0709 12:10:40.576234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.728804 (+3152570us) service_pool.cc:224] Handling call
0709 12:10:43.729118 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.733589 (+  4471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.744737 (+ 11148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.747248 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2413) took 2797 ms. Trace:
I20260709 12:10:43.747619 17289 rpcz_store.cc:276] 0709 12:10:40.949739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.746335 (+2796596us) service_pool.cc:224] Handling call
0709 12:10:43.746712 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.746911 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.746939 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.746980 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:43.747021 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.747072 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.747183 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.752679 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:43.731248 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:48992 (request call id 2435) took 1066 ms. Trace:
W20260709 12:10:43.717705 17332 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:43.731758 17434 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 2. Current term is 4. Ops: [2.2-2.2]
I20260709 12:10:43.101943 20250 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:43.734468 17441 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.735213 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.735428 17440 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:10:43.734308 17981 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.015s	sys 0.060s
W20260709 12:10:43.759044 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 825034us
I20260709 12:10:43.734354 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:43.736418 17432 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:43.709246 17405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.005s
W20260709 12:10:43.760695 17405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.008s	sys 0.005s
I20260709 12:10:43.762486 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:42.977088 20312 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:43.754633 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:43.754518 17364 rpcz_store.cc:276] 0709 12:10:42.715682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.715835 (+   153us) service_pool.cc:224] Handling call
0709 12:10:43.731183 (+1015348us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":227}
I20260709 12:10:43.760255 17292 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:43.766417 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.730894 20254 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:43.768059 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 50465.1us
W20260709 12:10:43.771727 17332 leader_election.cc:336] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:43.058662 20308 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:43.772673 17332 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:43.735896 20222 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:43.766409 17439 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.767664 17440 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:43.779558 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:43.781037 17364 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:43.781186 17437 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:43.728668 20249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.016s	sys 0.028s
W20260709 12:10:43.777086 17332 leader_election.cc:336] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53688 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:43.782401 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:43.708902 18013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.008s	sys 0.006s
W20260709 12:10:43.778115 17284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1530) took 2828 ms (client timeout 1559 ms). Trace:
W20260709 12:10:43.783252 18013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.008s	sys 0.006s
W20260709 12:10:43.783329 17284 rpcz_store.cc:269] 0709 12:10:40.944054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.772612 (+2828558us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:43.772720 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:43.779109 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2404) took 3000 ms. Trace:
I20260709 12:10:43.784320 17292 rpcz_store.cc:276] 0709 12:10:40.779003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.728993 (+2949990us) service_pool.cc:224] Handling call
0709 12:10:43.759914 (+ 30921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.778724 (+ 18810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.779031 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.785065 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 503) took 2814 ms. Trace:
I20260709 12:10:43.785492 17292 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.785449 17284 rpcz_store.cc:276] 0709 12:10:40.970406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.784226 (+2813820us) service_pool.cc:224] Handling call
0709 12:10:43.784534 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.784719 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.784743 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.784783 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:43.784821 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.784897 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.785009 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.786875 17406 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:43.786154 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 504) took 2814 ms. Trace:
I20260709 12:10:43.787858 17292 rpcz_store.cc:276] 0709 12:10:40.971473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.785038 (+2813565us) service_pool.cc:224] Handling call
0709 12:10:43.785335 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.785895 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.786077 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.769515 20240 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:43.791600 17292 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:43.791752 17284 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:43.794687 17406 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:43.766566 20340 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.738916 20307 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:43.801661 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 506) took 2819 ms. Trace:
W20260709 12:10:43.789032 20249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.017s	sys 0.028s
I20260709 12:10:43.803306 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 507) took 2811 ms. Trace:
I20260709 12:10:43.768827 20250 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:43.798233 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:43.805389 17284 rpcz_store.cc:276] 0709 12:10:40.975294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.786670 (+2811376us) service_pool.cc:224] Handling call
0709 12:10:43.791572 (+  4902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.793870 (+  2298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.794072 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.808473 17292 rpcz_store.cc:276] 0709 12:10:40.981500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.788865 (+2807365us) service_pool.cc:224] Handling call
0709 12:10:43.791440 (+  2575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.792341 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.792527 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.792577 20346 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.794005 20188 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.814210 17362 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:43.801841 20306 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.813696 17437 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:43.813297 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:43.794744 20309 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:43.795403 20240 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:43.819936 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:43.786895 20222 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:43.780262 20254 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:43.810070 20314 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.811980 20333 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.810448 20316 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:43.839955 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:43.848069 17406 leader_election.cc:336] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.720s (SENT)
I20260709 12:10:43.848742 17406 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:43.855882 17364 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:43.860826 17333 connection.cc:256] RPC call timeout handler was delayed by -1.1971018699998695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260709 12:10:43.861353 17333 connection.cc:256] RPC call timeout handler was delayed by -1.1527826479998566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:10:43.826283 20340 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.905107 20340 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.909984 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:43.902175 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:43.835335 20240 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.820338 20249 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.817415 20250 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:43.842564 20333 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:43.852437 20306 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.894009 20316 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:43.944770 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:43.819969 20346 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:43.966413 17439 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:43.821997 20188 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:43.919579 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 71552.7us
I20260709 12:10:43.921258 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 718) took 1559 ms. Trace:
I20260709 12:10:43.919715 20314 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:43.941939 20345 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 12:10:43.968894 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 191824us
I20260709 12:10:44.002055 17332 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:43.945191 20317 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:43.970603 20339 log.cc:927] Time spent T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:10:43.967428 20306 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:44.001822 20312 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.008788 17332 leader_election.cc:400] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4.
I20260709 12:10:43.962800 20003 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:10:44.010869 20341 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:43.967213 20343 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.941864 20333 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:43.984354 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 82307.8us
I20260709 12:10:44.026795 20308 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.028090 20314 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:44.014637 20241 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:44.028900 20306 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:44.029875 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2430) took 1435 ms. Trace:
I20260709 12:10:44.051774 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.055421 17361 rpcz_store.cc:276] 0709 12:10:42.594014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.594151 (+   137us) service_pool.cc:224] Handling call
0709 12:10:42.665431 (+ 71280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.666048 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.029645 (+1363597us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b54000f4bd0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:44.029793 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123799808}
I20260709 12:10:44.056305 17292 raft_consensus.cc:2410] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:43.968637 20347 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:43.979565 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 180211us
I20260709 12:10:44.000946 20352 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.031780 17332 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.001417 18013 rpcz_store.cc:276] 0709 12:10:42.361809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.361926 (+   117us) service_pool.cc:224] Handling call
0709 12:10:42.373078 (+ 11152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.373296 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:42.732811 (+359515us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.906937 (+1174126us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.920822 (+ 13885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.920880 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:43.920934 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.921003 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.921191 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13631,"prepare.queue_time_us":627937,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":82,"raft.queue_time_us":77,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":1525144,"threads_started":3,"wal-append.queue_time_us":1089898}
W20260709 12:10:44.002285 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 160250us
I20260709 12:10:44.036746 20307 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:44.026958 20250 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:44.043076 17439 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
W20260709 12:10:44.002336 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 237367us
W20260709 12:10:44.055042 19986 consensus_meta.cc:287] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.289s	user 0.010s	sys 0.002s
I20260709 12:10:44.006455 20249 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.053510 20188 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:44.053653 20169 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:44.056692 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 93121.5us
W20260709 12:10:44.060004 17435 consensus_meta.cc:287] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.129s	user 0.005s	sys 0.010s
I20260709 12:10:44.060094 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.064845 17981 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.045449 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:44.100173 17435 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:10:44.100833 17435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1573) took 1438 ms (client timeout 1769 ms). Trace:
W20260709 12:10:44.101248 17435 rpcz_store.cc:269] 0709 12:10:42.662297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.662743 (+   446us) service_pool.cc:224] Handling call
0709 12:10:44.100764 (+1438021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:44.140825 20313 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.142486 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:44.147161 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.145856 20361 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.148684 17292 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:44.149178 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.135562 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 70808.5us
I20260709 12:10:44.148284 20313 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:44.152371 20313 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.153493 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:44.143843 20341 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:10:44.087505 20249 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:44.099435 20353 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:44.148265 20370 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.058602 20343 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.144218 20356 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.150801 20222 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.193305 20317 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:44.196012 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.196707 17436 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:44.197710 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.088039 19986 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.198590 17441 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:44.159965 20306 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:44.199162 17284 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.155524 20314 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.165035 20346 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:44.201036 19986 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.155757 20240 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.203325 19986 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.155944 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 124233us
W20260709 12:10:44.168193 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 108164us
I20260709 12:10:44.205452 17332 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.206643 20353 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:44.207059 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.065173 20352 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:44.208372 17332 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.209542 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.205533 19986 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.175405 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.185482 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:44.186714 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:44.190781 20188 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 12:10:44.213871 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.166393 20312 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:44.209681 17287 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:10:44.204097 20240 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:44.100795 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 55436.5us
I20260709 12:10:44.215737 20250 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:44.219444 17332 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.219983 17292 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:44.221458 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.164132 20003 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.239580 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.157722 20249 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.231030 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.224215 20222 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.216769 20312 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:44.170365 20370 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:44.240275 17292 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:44.238574 20265 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.252427 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2411) took 3471 ms. Trace:
W20260709 12:10:44.241847 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 87219.5us
I20260709 12:10:44.246977 20343 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.240469 20319 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:10:44.224471 20241 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.251312 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 500) took 1151 ms. Trace:
I20260709 12:10:44.217336 20238 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.258708 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.250700 19986 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.252803 17290 rpcz_store.cc:276] 0709 12:10:40.781044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.733591 (+2952547us) service_pool.cc:224] Handling call
0709 12:10:43.756371 (+ 22780us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.948411 (+192040us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:44.062962 (+114551us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.228155 (+165193us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.228890 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.229025 (+   135us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:44.229925 (+   900us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.240390 (+ 10465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.240467 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.252218 (+ 11751us) raft_consensus.cc:1685] finished
0709 12:10:44.252249 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.252371 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43050,"prepare.queue_time_us":205742,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":157882,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":8996,"thread_start_us":426480,"threads_started":3,"wal-append.queue_time_us":158404}
I20260709 12:10:44.238687 20353 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.283499 20353 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:44.283922 20353 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.284559 20124 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:44.285007 20124 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:44.230644 20346 raft_consensus.cc:2764] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:44.209769 20352 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:44.263010 17332 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.250792 20360 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:44.297008 20254 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.300427 20353 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.270635 20361 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.260226 20370 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.280946 20241 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.302722 20353 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.303630 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.239471 20354 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.304344 20241 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.303959 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2410) took 3523 ms. Trace:
I20260709 12:10:44.274674 17434 rpcz_store.cc:276] 0709 12:10:43.100385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.755215 (+654830us) service_pool.cc:224] Handling call
0709 12:10:43.755522 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.792592 (+ 37070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.792636 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.792677 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:43.792713 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.251070 (+458357us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b540036e554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:44.251115 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.251246 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84810624}
I20260709 12:10:44.280622 20313 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.307086 20313 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.304888 17291 rpcz_store.cc:276] 0709 12:10:40.780725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.729939 (+2949214us) service_pool.cc:224] Handling call
0709 12:10:43.730373 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.906281 (+175908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.906310 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.935416 (+ 29106us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.066168 (+130752us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:44.281441 (+215273us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.303656 (+ 22215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.303732 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.303774 (+    42us) raft_consensus.cc:1685] finished
0709 12:10:44.303785 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.303900 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80405,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":104871,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":7460,"thread_start_us":377571,"threads_started":3,"wal-append.queue_time_us":277598}
I20260709 12:10:44.307977 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:44.272053 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 118630us
I20260709 12:10:44.277107 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:44.279291 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.224673 20169 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:44.310379 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.254272 20222 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:44.282939 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.300892 19400 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:44.302461 17437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1489) took 1352 ms (client timeout 1630 ms). Trace:
I20260709 12:10:44.311640 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.282066 20265 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:44.304409 17288 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:44.313679 20347 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:44.314373 20368 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:44.359334 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 47772.5us
I20260709 12:10:44.268903 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.360176 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:44.360415 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 91618.6us
I20260709 12:10:44.361197 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:44.319099 17437 rpcz_store.cc:269] 0709 12:10:42.950519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.950656 (+   137us) service_pool.cc:224] Handling call
0709 12:10:44.302290 (+1351634us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54001473d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:44.302399 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332737280}
I20260709 12:10:44.318181 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.309489 20370 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.363047 17291 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:44.363392 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.364230 17292 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:44.368301 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.356842 17434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:10:44.370216 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.370353 17434 raft_consensus.cc:606] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:44.370823 17434 raft_consensus.cc:614] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:44.288689 20238 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:44.374182 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.377301 17291 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:44.317440 20376 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.327018 20240 raft_consensus.cc:3055] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.376391 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.378386 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.375785 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.381457 17288 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:44.375191 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:44.381626 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.371322 20313 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:44.382822 17291 raft_consensus.cc:2393] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:44.383395 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.380719 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:44.384840 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:44.385685 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.387583 17292 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:44.372659 20352 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.371757 20347 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:44.392808 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 121340us
I20260709 12:10:44.377211 20250 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.380352 20307 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.394591 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.388899 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:44.384024 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 96409.2us
I20260709 12:10:44.382526 20240 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:44.386464 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 123531us
I20260709 12:10:44.312017 20377 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:10:44.321693 20169 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.391592 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.392053 20367 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.370216 19400 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.396569 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:44.397624 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.386402 19986 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:44.386530 20003 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.378328 20241 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:44.396642 20313 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:44.400933 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.402452 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.386644 20376 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.401521 20003 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.394423 20250 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:44.395895 20374 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:44.405109 17285 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.422490 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.402910 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:44.423346 17360 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:44.425102 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:44.408175 17332 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.317885 20354 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:44.416460 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1566) took 2000 ms. Trace:
I20260709 12:10:44.447706 17438 rpcz_store.cc:276] 0709 12:10:42.415899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.416008 (+   109us) service_pool.cc:224] Handling call
0709 12:10:42.416271 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.422675 (+  6404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.422714 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:42.422753 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:42.422788 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.416221 (+1993433us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b540006d954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:44.416265 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.416399 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14271872}
I20260709 12:10:44.417349 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1612) took 2140 ms. Trace:
I20260709 12:10:44.390164 20309 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:44.408751 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 513) took 3320 ms. Trace:
W20260709 12:10:44.464810 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.460253 17366 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:44.450685 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 56221.3us
I20260709 12:10:44.451800 17332 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.407410 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.469671 17284 rpcz_store.cc:276] 0709 12:10:41.088859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.811763 (+2722904us) service_pool.cc:224] Handling call
0709 12:10:43.816107 (+  4344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.199551 (+383444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.408499 (+208948us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54001b6a54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:44.408685 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880466816}
I20260709 12:10:44.473400 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.473701 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.474246 17363 raft_consensus.cc:2393] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:44.474609 17364 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:44.448756 17362 rpcz_store.cc:276] 0709 12:10:42.276936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.279629 (+  2693us) service_pool.cc:224] Handling call
0709 12:10:42.279951 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.816398 (+1536447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.417097 (+600699us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000f55d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:44.417274 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3527935360}
I20260709 12:10:44.472272 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:44.477077 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.477662 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.451002 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.479272 17358 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.479575 17361 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:10:44.459496 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.406822 20359 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:44.483593 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.479528 17285 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:44.406337 20360 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.411113 20346 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:44.524755 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 73041.2us
W20260709 12:10:44.524410 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 63904.4us
I20260709 12:10:44.527468 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.562747 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.563760 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:44.564260 17437 raft_consensus.cc:2376] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7. Re-sending same reply.
I20260709 12:10:44.523787 17284 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.528543 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.566941 17432 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:44.568501 20382 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:44.569366 17432 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:44.531196 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.527745 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:44.525427 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.571625 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:44.572085 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:44.572216 17439 raft_consensus.cc:2376] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8. Re-sending same reply.
I20260709 12:10:44.527185 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.452123 20377 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:44.411580 20041 consensus_queue.cc:1059] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:10:44.579859 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.580358 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:44.580586 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:44.571488 17434 raft_consensus.cc:3055] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.581368 17434 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:44.470852 20306 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:44.573791 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 64458.2us
I20260709 12:10:44.409178 20254 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:44.560650 17290 raft_consensus.cc:2376] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8. Re-sending same reply.
I20260709 12:10:44.572638 17440 raft_consensus.cc:2376] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5. Re-sending same reply.
I20260709 12:10:44.587937 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.559096 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.582221 17434 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:44.560814 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 89070us
I20260709 12:10:44.589321 17434 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.576128 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:44.412914 20250 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.405978 20313 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:44.406510 20343 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.524987 20378 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:44.574610 17367 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:44.524179 20308 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.583359 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.445065 20112 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 12:10:44.559540 20360 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:44.406297 19986 raft_consensus.cc:697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:44.592972 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.412608 20003 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.571878 20013 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.608831 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:44.609357 20375 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:10:44.573031 20353 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:10:44.612221 20222 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:44.613703 20169 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.601377 20041 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:10:44.600384 17284 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:44.409026 20249 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.616509 20249 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.587942 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:44.617920 18008 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.583891 20381 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:44.599385 20343 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:44.618755 20343 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.616696 17284 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:44.602346 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 194992us
W20260709 12:10:44.591626 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.523196 20240 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.627799 20240 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.630391 17284 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.631273 20354 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:44.585094 20306 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.632066 20306 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.584100 20347 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.634428 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.635697 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:44.636462 17358 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:44.637328 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.637979 17360 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:44.639242 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.590960 20380 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.585301 20359 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.641064 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:44.645031 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.650159 17434 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:44.637373 20360 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.596632 20377 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:44.641626 17362 raft_consensus.cc:2376] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8. Re-sending same reply.
I20260709 12:10:44.584440 20374 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:44.596073 20312 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:44.570667 20382 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:10:44.578213 20379 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:10:44.664868 17284 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:44.667189 17367 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:44.666366 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.600401 20346 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:10:44.637511 20308 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.671703 17366 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:44.740211 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:44.739845 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.739099 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:44.739481 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:44.777042 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 171302us
I20260709 12:10:44.738533 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.779290 18008 raft_consensus.cc:2410] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:10:44.779790 18008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 713) took 2468 ms (client timeout 1711 ms). Trace:
W20260709 12:10:44.780162 18008 rpcz_store.cc:269] 0709 12:10:42.311447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.313520 (+  2073us) service_pool.cc:224] Handling call
0709 12:10:44.583597 (+2270077us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6eee 000000000036eb39 00007f122aa6a1e0 00007f122ab330c4 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:44.779710 (+196113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7785088}
I20260709 12:10:44.777209 17362 raft_consensus.cc:2376] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4. Re-sending same reply.
W20260709 12:10:44.723278 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 138743us
W20260709 12:10:44.783401 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.788494 20238 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:44.789464 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.790475 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:44.792321 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.796209 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:44.796600 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:44.796538 20378 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:44.798492 20378 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.798796 17283 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:44.803524 17434 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:44.776399 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 212109us
I20260709 12:10:44.805100 17367 raft_consensus.cc:2376] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8. Re-sending same reply.
I20260709 12:10:44.808902 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:44.682286 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:44.820175 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:44.653785 20254 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 12:10:44.813278 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:44.763823 20356 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:44.829655 17333 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:44.831949 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 46864.9us
I20260709 12:10:44.681684 20370 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.864295 18007 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:44.885713 17435 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:44.903040 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:44.911026 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:44.911955 18011 raft_consensus.cc:2410] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:44.824790 20371 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.913283 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:44.828414 20319 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:44.826997 20356 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:44.917002 18015 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:10:44.664562 20384 consensus_queue.cc:1059] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.259s
I20260709 12:10:44.717175 20360 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.954623 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:44.953158 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:44.957267 20308 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:44.957778 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:44.962845 20314 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:44.950747 20388 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:44.762773 20306 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:44.801937 20250 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:44.899890 20333 consensus_meta.cc:287] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.000s
I20260709 12:10:44.992051 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:44.876560 20346 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.963410 20314 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:10:44.915975 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 83711.6us
I20260709 12:10:44.812377 19986 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.000802 18014 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:44.828464 20343 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:44.971625 18011 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:44.749737 20313 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.020733 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:44.987792 20319 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:45.001128 20346 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.041602 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:45.022650 17438 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:45.042145 18014 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:45.046119 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:45.048736 20318 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:45.048904 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 95887.7us
I20260709 12:10:45.049329 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.050529 20346 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.053141 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:45.020016 20353 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:45.055390 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:45.055862 17363 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:44.933259 20371 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.057548 17288 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.057900 17362 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:44.992177 20370 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:10:45.019095 20003 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.067138 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.065909 20320 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:10:45.073199 20390 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:45.073650 20390 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:45.075130 20250 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:45.074688 20390 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.076177 20390 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.076560 20314 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.077133 20346 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.077950 20314 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.079890 20319 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.082713 20343 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:45.083382 20360 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:45.086556 18012 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:45.090174 20356 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.091746 20356 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.900089 20377 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:44.913666 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 328396us
I20260709 12:10:45.099761 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1554) took 1023 ms. Trace:
I20260709 12:10:45.100447 17290 rpcz_store.cc:276] 0709 12:10:44.076449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.316626 (+240177us) service_pool.cc:224] Handling call
0709 12:10:45.099556 (+782930us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54002cfbd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:45.099682 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459544320}
I20260709 12:10:45.101622 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:45.045694 20388 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.096745 17406 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:45.056995 20312 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.056839 20389 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:45.058394 20353 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:45.007521 20333 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:45.181104 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 79575.8us
I20260709 12:10:45.064244 20317 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.242776 18012 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:45.248528 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.168107 20347 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:10:45.253432 17283 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:45.096572 20374 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
I20260709 12:10:45.208968 20386 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.179993 20312 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:45.168300 20308 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:10:45.278889 20307 raft_consensus.cc:3055] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.279343 20307 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:45.279465 20353 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.280196 20307 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.281213 20307 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.285267 20378 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.290371 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:45.295454 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.299492 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:45.300441 19964 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:45.300745 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.301378 18014 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:45.302253 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:45.302860 20333 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:45.303783 20306 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:45.302939 18014 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:45.303153 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:45.269886 20394 consensus_queue.cc:1059] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:45.305034 17441 raft_consensus.cc:2376] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8. Re-sending same reply.
I20260709 12:10:45.305507 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:45.305872 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.305265 20353 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.306448 18015 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.290197 20360 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.312433 20360 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:45.312850 20360 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.317196 18006 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:45.319739 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.306173 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:45.322929 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:45.326014 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:45.277647 20312 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.327332 18015 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:45.327711 20343 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.341703 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:45.326963 20332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.540s	user 0.007s	sys 0.014s
I20260709 12:10:45.343479 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:45.351639 20332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.570s	user 0.007s	sys 0.014s
I20260709 12:10:45.351895 17441 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:45.339840 20343 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.352962 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:45.355985 20346 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:45.344340 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:45.303222 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.302963 20371 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:45.349608 20003 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:45.350422 20378 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:45.351101 20316 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:45.357318 20370 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:10:45.337939 20379 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.351960 20332 raft_consensus.cc:697] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:45.407656 20332 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.401901 19964 raft_consensus.cc:3055] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.403111 20316 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:45.416479 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:45.417218 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.406280 20379 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.409266 19964 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:45.423183 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.423904 18008 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:45.424297 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:45.424137 19964 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.424932 18009 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.425045 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.425909 18008 raft_consensus.cc:2410] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:45.421614 20124 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.427641 20124 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.421506 20316 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.435405 20316 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.435643 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:45.438048 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.439054 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.439875 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:45.445336 20381 raft_consensus.cc:3055] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.445868 20381 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:45.446827 20381 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.447929 20381 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.452986 20374 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.464892 20376 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:45.476253 20325 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.476827 20325 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:45.479797 18011 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:45.477747 20325 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.487550 20325 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:45.626993 17255 connection.cc:256] RPC call timeout handler was delayed by -1.279934909000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 12:10:45.628755 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.629256 17255 connection.cc:256] RPC call timeout handler was delayed by -1.0063349090000884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
I20260709 12:10:44.915899 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:45.634861 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:45.637136 17286 raft_consensus.cc:2410] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:45.637393 17258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 2.594s (SENT) [suppressed 57 similar messages]
W20260709 12:10:45.641116 17287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1519) took 5212 ms (client timeout 1764 ms). Trace:
I20260709 12:10:45.639444 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:45.640296 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2420) took 1374 ms. Trace:
I20260709 12:10:45.682256 20351 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:45.683804 19964 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.387444 20377 raft_consensus.cc:2955] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:45.683225 17189 catalog_manager.cc:5697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 2, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:45.642262 17284 rpcz_store.cc:276] 0709 12:10:44.265782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.633100 (+367318us) service_pool.cc:224] Handling call
0709 12:10:44.633366 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.667570 (+ 34204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.639587 (+972017us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54001c0f54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:45.640028 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71608192}
I20260709 12:10:45.688285 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:45.688925 20352 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:45.421861 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.689821 20352 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.690071 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:45.641785 17287 rpcz_store.cc:269] 0709 12:10:40.428820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.647118 (+218298us) service_pool.cc:224] Handling call
0709 12:10:45.640584 (+4993466us) spinlock_profiling.cc:243] Waited 3.54 s on lock 0x7b54002008d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:45.640852 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8132615040}
W20260709 12:10:45.691027 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 251116us
I20260709 12:10:45.696573 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:45.697722 17981 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:45.698009 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:45.699316 20376 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.693001 20352 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:45.701557 20387 consensus_queue.cc:1059] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:45.695417 17189 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 6, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 6 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:45.703636 20387 raft_consensus.cc:3055] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:45.703998 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.704073 20387 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:45.705772 20387 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:45.706293 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.707439 18006 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:45.707703 20387 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:45.710724 18011 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:45.714664 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:45.693828 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 56676us
I20260709 12:10:45.735998 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:45.737273 17286 raft_consensus.cc:2376] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6. Re-sending same reply.
I20260709 12:10:45.738523 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:45.766269 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 134489us
I20260709 12:10:45.767484 17255 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:45.769552 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.683713 20351 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:45.772287 20351 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:45.350464 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:45.774163 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.774768 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.740252 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:45.792260 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:45.805794 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.810695 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:45.816933 17291 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:45.818560 17432 raft_consensus.cc:2393] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:45.824250 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 56964us
I20260709 12:10:45.825439 17255 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:45.831312 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.831714 20356 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.739s	user 0.013s	sys 0.009s
W20260709 12:10:45.832105 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.832690 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.834430 17364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.004s	sys 0.009s
I20260709 12:10:45.834630 20097 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.835322 20097 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:45.834884 17364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.004s	sys 0.009s
I20260709 12:10:45.843393 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:45.843394 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2414) took 4892 ms. Trace:
I20260709 12:10:45.845630 20097 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:45.849035 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:45.850067 17405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.007s	sys 0.005s
I20260709 12:10:45.846346 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 518) took 1791 ms. Trace:
W20260709 12:10:45.856858 17405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.007s	sys 0.006s
I20260709 12:10:45.851053 17288 rpcz_store.cc:276] 0709 12:10:44.054763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.399932 (+345169us) service_pool.cc:224] Handling call
0709 12:10:44.405577 (+  5645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.059048 (+653471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.845907 (+786859us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54000b7a54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:45.846191 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498929920}
I20260709 12:10:45.849985 17284 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:45.862289 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:45.862469 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 507) took 1005 ms. Trace:
I20260709 12:10:45.863234 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:45.865974 17333 leader_election.cc:336] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 1.559s (SENT)
I20260709 12:10:45.873345 20379 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:45.863643 17434 rpcz_store.cc:276] 0709 12:10:44.785330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.816306 (+ 30976us) service_pool.cc:224] Handling call
0709 12:10:44.816692 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.817108 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.817149 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.838189 (+ 21040us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.235829 (+397640us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.235872 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.235944 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.741928 (+505984us) raft_consensus.cc:1685] finished
0709 12:10:45.741978 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.791063 (+ 49085us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6294,"raft.queue_time_us":7688,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":72859,"thread_start_us":284866,"threads_started":1,"wal-append.queue_time_us":494248}
I20260709 12:10:45.796241 20313 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:45.889599 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.892524 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.898820 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:45.899923 17332 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.102s (SENT)
I20260709 12:10:45.900820 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:45.901672 17286 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.902567 20343 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:45.902887 20409 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:45.903810 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:45.904556 18006 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:45.850015 18009 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:45.902745 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:45.910091 17288 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:45.906064 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 80859.1us
I20260709 12:10:45.907097 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:45.935201 17366 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
W20260709 12:10:45.906973 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2427) took 1591 ms (client timeout 1507 ms). Trace:
I20260709 12:10:45.898887 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:45.930562 17406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.015s
I20260709 12:10:45.892964 20351 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.939661 17285 rpcz_store.cc:269] 0709 12:10:44.267527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.276852 (+  9325us) service_pool.cc:224] Handling call
0709 12:10:45.792008 (+1515156us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b540020eed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:45.858649 (+ 66641us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218396928}
W20260709 12:10:45.948714 17406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.004s	sys 0.015s
I20260709 12:10:45.850082 17289 rpcz_store.cc:276] 0709 12:10:40.950029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.748514 (+2798485us) service_pool.cc:224] Handling call
0709 12:10:43.748872 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.768349 (+ 19477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.768380 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.776810 (+  8430us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.031447 (+254637us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:44.738496 (+707049us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b48003000d8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:10:45.737025 (+998529us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b1800173b00. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12256c34bc 00007f1222a1148b 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2b455 00007f12295133c7 00007f1225b259a7 00007f1225b350bf
0709 12:10:45.737346 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.839395 (+102049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.840465 (+  1070us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.841185 (+   720us) raft_consensus.cc:1685] finished
0709 12:10:45.841322 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.842388 (+  1066us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103736,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":118729,"raft.run_cpu_time_us":9756,"raft.run_wall_time_us":897086,"spinlock_wait_cycles":44606592,"thread_start_us":347371,"threads_started":3,"wal-append.queue_time_us":309923,"wal-append.run_cpu_time_us":2182,"wal-append.run_wall_time_us":1060886}
W20260709 12:10:45.964998 20353 consensus_meta.cc:287] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.635s	user 0.021s	sys 0.016s
I20260709 12:10:45.965253 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 731) took 1046 ms. Trace:
I20260709 12:10:45.965709 18010 rpcz_store.cc:276] 0709 12:10:44.864376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.864501 (+   125us) service_pool.cc:224] Handling call
0709 12:10:44.864851 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:44.900264 (+ 35413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.900294 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:44.901135 (+   841us) log.cc:844] Serialized 52 byte log entry
0709 12:10:45.434815 (+533680us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b1800017140. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:10:45.736177 (+301362us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.785795 (+ 49618us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.806872 (+ 21077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.861274 (+ 54402us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.861321 (+    47us) raft_consensus.cc:1685] finished
0709 12:10:45.887593 (+ 26272us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.910746 (+ 23153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64579,"prepare.queue_time_us":165386,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":82882,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":47256,"spinlock_wait_cycles":2786176,"thread_start_us":288170,"threads_started":2,"wal-append.queue_time_us":855526}
I20260709 12:10:45.950934 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 732) took 1080 ms. Trace:
I20260709 12:10:45.982268 18009 rpcz_store.cc:276] 0709 12:10:44.864668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.876351 (+ 11683us) service_pool.cc:224] Handling call
0709 12:10:45.424133 (+547782us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:45.933344 (+509211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7529344}
W20260709 12:10:45.986264 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 889526us
I20260709 12:10:45.989406 20378 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:45.995172 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 502) took 1211 ms. Trace:
I20260709 12:10:45.989773 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:45.974849 17255 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:45.995676 17438 rpcz_store.cc:276] 0709 12:10:44.784007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.790240 (+  6233us) service_pool.cc:224] Handling call
0709 12:10:45.994642 (+1204402us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54001a18d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:45.994945 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532080000}
W20260709 12:10:46.000201 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 51758.4us
I20260709 12:10:46.006788 17284 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:45.997748 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:46.010941 20312 consensus_meta.cc:287] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.667s	user 0.017s	sys 0.026s
I20260709 12:10:46.011445 20312 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:46.014150 20360 consensus_meta.cc:287] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.701s	user 0.003s	sys 0.032s
I20260709 12:10:46.014725 20360 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:46.016065 17439 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:46.017199 20360 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:46.025501 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1600) took 1155 ms. Trace:
I20260709 12:10:46.028545 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:46.026599 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:46.014720 20388 consensus_meta.cc:287] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.787s	user 0.019s	sys 0.033s
I20260709 12:10:46.051169 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2428) took 1783 ms. Trace:
I20260709 12:10:46.051680 17290 rpcz_store.cc:276] 0709 12:10:44.267828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.182413 (+914585us) service_pool.cc:224] Handling call
0709 12:10:45.238883 (+ 56470us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:45.240707 (+  1824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.240735 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:45.271554 (+ 30819us) log.cc:844] Serialized 616 byte log entry
0709 12:10:45.918192 (+646638us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.928704 (+ 10512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.951682 (+ 22978us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.050697 (+ 99015us) raft_consensus.cc:1685] finished
0709 12:10:46.050723 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.050941 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":482,"raft.queue_time_us":641,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":21765,"thread_start_us":140820,"threads_started":1,"wal-append.queue_time_us":721504}
W20260709 12:10:46.054410 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 53432us
I20260709 12:10:46.056085 20352 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:46.056615 20352 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.057013 20352 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.051880 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 517) took 1997 ms. Trace:
I20260709 12:10:46.026021 17441 rpcz_store.cc:276] 0709 12:10:44.867214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.353931 (+486717us) service_pool.cc:224] Handling call
0709 12:10:45.742643 (+388712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.743473 (+   830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.743502 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.744283 (+   781us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.784528 (+ 40245us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:45.784585 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.787341 (+  2756us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.022183 (+234842us) raft_consensus.cc:1685] finished
0709 12:10:46.022205 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.022373 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34213,"raft.run_cpu_time_us":481,"raft.run_wall_time_us":81902,"thread_start_us":39746,"threads_started":1,"wal-append.queue_time_us":263918}
I20260709 12:10:46.067083 17285 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.060726 17291 rpcz_store.cc:276] 0709 12:10:44.054493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.399188 (+344695us) service_pool.cc:224] Handling call
0709 12:10:45.816553 (+1417365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.817461 (+   908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.051644 (+234183us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540020eed0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:46.051813 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3213147520}
I20260709 12:10:46.081576 17286 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:46.052229 17189 catalog_manager.cc:5697] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 3, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 3 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.039038 20343 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.117221 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:46.117683 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:46.064766 20388 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:46.121317 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 81040.5us
I20260709 12:10:46.123162 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:46.129921 17189 catalog_manager.cc:5697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:46.136356 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 194726us
I20260709 12:10:46.142213 17292 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:46.139058 17283 consensus_meta.cc:287] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.010s
I20260709 12:10:46.150214 17441 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:46.152374 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.148372 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:46.154933 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:46.156242 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 166603us
W20260709 12:10:46.157647 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 186529us
I20260709 12:10:46.149387 17189 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 7, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 7 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:46.168731 20307 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.844s	user 0.026s	sys 0.021s
I20260709 12:10:46.169445 20380 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.169664 17407 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:46.170326 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 139806us
W20260709 12:10:46.173563 20124 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.745s	user 0.012s	sys 0.013s
I20260709 12:10:46.177829 17438 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:46.178231 20254 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:46.181746 20318 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.183992 17435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1590) took 1590 ms (client timeout 1575 ms). Trace:
W20260709 12:10:46.188748 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.197407 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:46.221439 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.193994 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.208717 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47642.9us
W20260709 12:10:46.224476 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.198302 17434 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:46.203783 17186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55944 (request call id 310) took 21058 ms (client timeout 15000 ms). Trace:
W20260709 12:10:46.203107 17433 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 493) took 3113 ms (client timeout 1928 ms). Trace:
W20260709 12:10:46.220850 17435 rpcz_store.cc:269] 0709 12:10:44.526240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.526369 (+   129us) service_pool.cc:224] Handling call
0709 12:10:46.064452 (+1538083us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54000ff354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:46.116831 (+ 52379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546296192}
W20260709 12:10:46.244725 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 71814.1us
I20260709 12:10:46.245646 17285 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
W20260709 12:10:46.247687 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 50407.7us
W20260709 12:10:46.248253 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.230032 17433 rpcz_store.cc:269] 0709 12:10:43.089378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.655121 (+565743us) service_pool.cc:224] Handling call
0709 12:10:46.202716 (+2547595us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b54000ca154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:46.202908 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5272480000}
I20260709 12:10:46.242575 17255 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.253857 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:46.201653 20325 consensus_meta.cc:287] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.714s	user 0.018s	sys 0.004s
I20260709 12:10:46.223284 20351 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.266750 17441 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
W20260709 12:10:46.269018 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.198938 20360 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.262475 17189 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 7, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 7 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.266775 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:46.287187 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.274963 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:46.288640 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:46.289503 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:46.296238 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:46.199185 20388 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.093s
W20260709 12:10:46.304733 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.305305 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.306993 17358 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:46.307550 17407 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:46.260514 20332 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:46.277235 20343 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.302891 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:46.314311 18006 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:46.317605 17438 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:46.347584 17438 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.348960 17438 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.319397 17364 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.322309 17441 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:46.303539 20254 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:46.322628 20410 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.452s	user 0.005s	sys 0.000s
I20260709 12:10:46.352555 20254 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:46.353178 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 120678us
I20260709 12:10:46.353423 20265 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:46.328531 20317 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.354019 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 729) took 1490 ms. Trace:
I20260709 12:10:46.352398 17441 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.354285 20317 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:46.355753 17441 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.356514 20317 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:46.356997 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:46.357438 20360 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:46.300601 20318 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:46.362221 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.317740 17366 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:46.329084 20421 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.058s	user 0.003s	sys 0.000s
I20260709 12:10:46.364326 17435 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:46.366037 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.366873 17435 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:46.367476 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:46.357189 18013 rpcz_store.cc:276] 0709 12:10:44.863787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.863934 (+   147us) service_pool.cc:224] Handling call
0709 12:10:45.443396 (+579462us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:45.443638 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.454763 (+ 11125us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:45.454797 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.455305 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.768492 (+313187us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.768587 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.768735 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.321810 (+553075us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:46.353680 (+ 31870us) raft_consensus.cc:1685] finished
0709 12:10:46.353704 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.353839 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10662,"raft.queue_time_us":11904,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":21872768,"thread_start_us":271822,"threads_started":1,"wal-append.queue_time_us":414933}
I20260709 12:10:46.372308 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:46.334960 20419 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:10:46.335729 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 177101us
I20260709 12:10:46.368563 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.338979 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1605) took 1463 ms. Trace:
I20260709 12:10:46.356925 17441 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:46.344791 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1606) took 1465 ms. Trace:
W20260709 12:10:46.323482 20316 consensus_meta.cc:287] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.879s	user 0.018s	sys 0.002s
I20260709 12:10:46.374066 17255 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.376151 20265 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:46.376610 20418 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.209s	user 0.000s	sys 0.002s
I20260709 12:10:46.387717 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:46.388518 20351 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:46.389261 20351 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.390214 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1603) took 1518 ms. Trace:
I20260709 12:10:46.390604 17436 rpcz_store.cc:276] 0709 12:10:44.872165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.817082 (+944917us) service_pool.cc:224] Handling call
0709 12:10:45.817597 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.846688 (+ 29091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.846720 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.847325 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.942139 (+ 94814us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:45.942186 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.942264 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.341982 (+399718us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4800160158. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:10:46.376182 (+ 34200us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b240021de68. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12228b49c4 00007f12228b2acb 00007f1222a6ddc9 00007f1222a6da55 00007f1222a6d09d 00007f122569f10e 00007f12256b688c 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221
0709 12:10:46.389886 (+ 13704us) raft_consensus.cc:1685] finished
0709 12:10:46.389908 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.390046 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28425,"raft.queue_time_us":31511,"raft.run_cpu_time_us":4363,"raft.run_wall_time_us":492481,"spinlock_wait_cycles":80234112,"thread_start_us":94348,"threads_started":1,"wal-append.queue_time_us":271660}
I20260709 12:10:46.380065 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:46.377458 17432 rpcz_store.cc:276] 0709 12:10:44.875762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.821582 (+945820us) service_pool.cc:224] Handling call
0709 12:10:45.822254 (+   672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.822820 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.822846 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.823556 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.912242 (+ 88686us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.912272 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.912322 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.338698 (+426376us) raft_consensus.cc:1685] finished
0709 12:10:46.338716 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.338882 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":87717,"threads_started":1,"wal-append.queue_time_us":324511}
I20260709 12:10:46.357134 20317 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.379761 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:46.384104 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:46.395788 20343 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:46.352447 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 186310us
W20260709 12:10:46.354698 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 77746.1us
I20260709 12:10:46.384426 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:46.376770 20380 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:46.397328 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.397723 20380 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:46.398732 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:46.398854 20380 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.399750 20378 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:46.400545 20378 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.400899 20378 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:46.401268 20378 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.377558 20353 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.403468 17332 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:46.381042 17439 rpcz_store.cc:276] 0709 12:10:44.879147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.836371 (+957224us) service_pool.cc:224] Handling call
0709 12:10:45.836906 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.016468 (+179562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.344556 (+328088us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400116054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:46.344726 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411312512}
I20260709 12:10:46.381095 17287 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:46.381949 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:46.406294 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 110127us
I20260709 12:10:46.407819 20319 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.407989 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.409526 20319 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:46.332875 20352 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:46.386354 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:46.424324 17285 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:46.410810 20371 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:46.380273 17437 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:46.378465 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:10:46.229583 17186 rpcz_store.cc:269] 0709 12:10:25.145606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.171676 (+ 26070us) service_pool.cc:224] Handling call
0709 12:10:25.486919 (+315243us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b5400002210. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f7640 00007f122b8ce846 00007f122b9d890e 00007f1229e992a4 00007f1229e99232 00007f1229e99161 00007f1229e990dc 00007f1229e98392 00007f1223e5648c 00007f1223e558c6
0709 12:10:46.203487 (+20716568us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:35.611362 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:35.882566 (+271204us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:35.882661 (+    95us) write_op.cc:435] Acquired schema lock
0709 12:10:35.882698 (+    37us) tablet.cc:662] Decoding operations
0709 12:10:35.888211 (+  5513us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:35.888296 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:35.888326 (+    30us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:10:35.889185 (+   859us) tablet.cc:701] Row locks acquired
0709 12:10:35.889239 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:10:35.889422 (+   183us) write_op.cc:270] Start()
0709 12:10:35.889591 (+   169us) write_op.cc:276] Timestamp: P: 1783599035889348 usec, L: 0
0709 12:10:35.889614 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:36.098042 (+208428us) log.cc:844] Serialized 4239 byte log entry
0709 12:10:37.172024 (+1073982us) op_driver.cc:464] REPLICATION: finished
0709 12:10:37.470864 (+298840us) write_op.cc:301] APPLY: starting
0709 12:10:37.473871 (+  3007us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:37.490570 (+ 16699us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:37.490766 (+   196us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:37.763785 (+273019us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b54000762d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1832a 00007f1225a9df14 00007f1225a9dec3 00007f1225a9de38 00007f1225a9ddf3 00007f1225a9d0dc 00007f1225ac6e16 00007f1225aaecbb 00007f1225a9939d 00007f1225a9cd75
0709 12:10:37.814821 (+ 51036us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:37.815179 (+   358us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:10:37.815220 (+    41us) write_op.cc:312] APPLY: finished
0709 12:10:37.906634 (+ 91414us) log.cc:844] Serialized 71 byte log entry
0709 12:10:37.931604 (+ 24970us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:37.950466 (+ 18862us) write_op.cc:454] Released schema lock
0709 12:10:37.950560 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:37.951070 (+   510us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:37.951101 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13273,"reported_tablets":37,"spinlock_wait_cycles":18164608,"child_traces":[["op",{"apply.queue_time_us":221909,"apply.run_cpu_time_us":8394,"apply.run_wall_time_us":499098,"num_ops":9,"prepare.queue_time_us":522608,"prepare.run_cpu_time_us":61760,"prepare.run_wall_time_us":986317,"raft.queue_time_us":297472,"raft.run_cpu_time_us":22997,"raft.run_wall_time_us":687659,"replication_time_us":1240221,"spinlock_wait_cycles":11681024,"thread_start_us":1059952,"threads_started":4,"wal-append.queue_time_us":577686,"wal-append.run_cpu_time_us":21202,"wal-append.run_wall_time_us":2280482}]]}
I20260709 12:10:46.345044 17189 catalog_manager.cc:5697] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 3, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 3 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:46.361778 20318 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:46.349231 20381 consensus_meta.cc:287] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.901s	user 0.016s	sys 0.009s
I20260709 12:10:46.410457 20325 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.412177 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:46.432377 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 101065us
W20260709 12:10:46.434993 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 78097.5us
I20260709 12:10:46.344869 20312 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:46.443673 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2426) took 2176 ms. Trace:
I20260709 12:10:46.437937 17189 catalog_manager.cc:5697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.448499 17434 raft_consensus.cc:2410] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:46.446017 17283 rpcz_store.cc:276] 0709 12:10:44.267287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.800916 (+533629us) service_pool.cc:224] Handling call
0709 12:10:44.802710 (+  1794us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:44.803240 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.803267 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:44.826360 (+ 23093us) log.cc:844] Serialized 616 byte log entry
0709 12:10:45.192380 (+366020us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:46.154768 (+962388us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.286727 (+131959us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.413440 (+126713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.435965 (+ 22525us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.436009 (+    44us) raft_consensus.cc:1685] finished
0709 12:10:46.436019 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.443601 (+  7582us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":204193,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":3837,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":20052,"thread_start_us":379908,"threads_started":2,"wal-append.queue_time_us":399484}
I20260709 12:10:46.439659 20265 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.448395 20353 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.454677 20188 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:46.456722 20313 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.466372 17255 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:46.466120 17361 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
W20260709 12:10:46.476639 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 79766.9us
I20260709 12:10:46.481560 17407 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:46.478560 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1515) took 1156 ms. Trace:
I20260709 12:10:46.482524 17437 rpcz_store.cc:276] 0709 12:10:45.322408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.344082 (+ 21674us) service_pool.cc:224] Handling call
0709 12:10:46.478201 (+1134119us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540006d454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:46.478421 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799042944}
I20260709 12:10:46.485576 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:46.487376 17980 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:46.488299 20381 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.452052 20351 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.489668 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 111354us
I20260709 12:10:46.468016 20376 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:46.505278 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 93182.9us
I20260709 12:10:46.469491 20352 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:46.506773 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 67264.4us
I20260709 12:10:46.494163 20387 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.503602 20317 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.516470 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.498261 20188 raft_consensus.cc:697] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:46.495669 20097 consensus_queue.cc:1059] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:46.537320 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:46.494424 20265 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.550043 17407 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:46.534763 20254 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:46.551384 20388 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:46.551661 17407 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:46.551908 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 44796.3us
I20260709 12:10:46.522027 20317 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:46.507588 20351 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:46.520901 20387 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:46.551446 20265 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:46.554064 17980 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:46.566222 20319 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:46.566988 20319 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:46.567345 17980 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.554390 20317 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.568181 20319 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:46.554580 17189 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.576582 17189 catalog_manager.cc:5697] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.494071 20313 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.587661 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:46.554234 20343 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:46.609370 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 92991.5us
I20260709 12:10:46.565475 20387 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.559582 20356 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.565191 20371 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:46.611465 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 51121.7us
I20260709 12:10:46.613067 17361 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:46.564723 20351 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:46.557327 20407 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.617678 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:46.564913 20097 raft_consensus.cc:3055] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:46.616154 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 172762us
I20260709 12:10:46.604071 17189 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 6, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 6 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.560986 20124 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:10:46.561296 20307 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:10:46.557135 20374 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:10:46.613788 20356 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.617928 20376 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.561651 20325 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:10:46.633311 20097 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:46.559221 20360 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 12:10:46.652901 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 146308us
I20260709 12:10:46.642987 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:46.646245 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 79001.2us
W20260709 12:10:46.654887 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.655965 17980 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.622905 20371 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:46.618867 20313 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:46.708711 17189 catalog_manager.cc:5697] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 4, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:46.713694 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 67406.5us
I20260709 12:10:46.652918 20356 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.564416 20316 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 12:10:46.651434 17258 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 1.922s (SENT)
W20260709 12:10:46.714178 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.721937 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:46.735857 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 89273.4us
W20260709 12:10:46.735157 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 157614us
W20260709 12:10:46.740011 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 89252.4us
I20260709 12:10:46.712648 17364 raft_consensus.cc:2955] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:46.743366 17189 catalog_manager.cc:5697] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:46.751771 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1608) took 1553 ms. Trace:
I20260709 12:10:46.752178 17332 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:46.744024 20313 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.750123 17189 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 3, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 3 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:46.759846 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.762621 20124 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:46.760385 20376 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.768348 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:46.752202 17440 rpcz_store.cc:276] 0709 12:10:45.091078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.840447 (+749369us) service_pool.cc:224] Handling call
0709 12:10:46.069716 (+229269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.165564 (+ 95848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.165599 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.248882 (+ 83283us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.497917 (+249035us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:46.497957 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.498026 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.622169 (+124143us) raft_consensus.cc:1685] finished
0709 12:10:46.622189 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.632339 (+ 10150us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54000ff350. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:46.644525 (+ 12186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2650,"raft.queue_time_us":14371,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5905,"spinlock_wait_cycles":526024576,"thread_start_us":177958,"threads_started":1,"wal-append.queue_time_us":270242}
I20260709 12:10:46.770605 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:46.778134 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.770533 20376 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.769147 20380 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:46.823029 17189 catalog_manager.cc:5697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 4, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.769937 20447 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:46.772401 20124 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:46.749166 20097 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.771029 20445 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.745826 20188 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.766640 20313 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:46.852154 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.869139 17189 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:46.902776 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 246859us
I20260709 12:10:46.857944 20353 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:46.908245 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 138480us
I20260709 12:10:46.863155 20456 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:46.907678 17189 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 6, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 6 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:46.868913 20443 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:46.904081 20378 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.013s
I20260709 12:10:46.918164 17980 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:46.916698 20452 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.921743 20452 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.923964 20452 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:46.924765 17189 catalog_manager.cc:5697] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:46.822626 20371 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.879026 20445 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:46.907835 20353 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:46.931746 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 168011us
I20260709 12:10:46.911202 19964 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.872537 20317 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:46.938892 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 181441us
I20260709 12:10:46.931300 20445 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.944895 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:46.935984 20383 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:46.949447 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:46.938206 20307 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.937345 20461 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.939731 20452 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:46.938428 20380 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:46.928444 20378 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:46.961241 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 51804us
I20260709 12:10:46.932794 20456 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.954749 20446 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:46.950491 20445 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.964730 17255 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:46.947363 20444 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.942082 19964 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.964727 20097 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.965188 20343 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:46.987355 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 248914us
W20260709 12:10:46.988533 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 45524.2us
I20260709 12:10:46.961621 20451 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:46.943276 20124 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.977715 20448 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.992055 17255 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:46.993019 20453 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:46.993541 20317 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:47.004868 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 389218us
I20260709 12:10:46.981051 20457 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:10:46.985656 20446 raft_consensus.cc:697] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:10:47.019246 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.019935 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.990115 20351 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.023581 20351 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:47.024044 20464 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.023777 20352 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:47.024631 20464 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:47.025990 20464 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:47.007205 20441 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:10:46.984750 20452 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.002866 20453 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:46.954537 20443 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:46.967996 20461 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.048588 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:47.014402 20313 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:47.031313 20351 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.016708 20325 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:47.009182 20378 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:47.007404 20431 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:47.069128 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:47.078819 18006 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:47.070176 20444 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.091183 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.063601 20469 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:47.099231 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 67408.6us
I20260709 12:10:47.105629 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.079846 20343 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:47.114651 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:47.115741 20377 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:10:47.116451 20374 raft_consensus.cc:3055] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:47.116887 20374 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:47.117336 20462 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.049921 20451 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:47.117962 20462 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.118688 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.119971 20451 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:47.120226 20462 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:47.120749 20460 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.121346 20460 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.106511 20378 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.122740 20378 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:47.123915 20446 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:47.104535 20454 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:10:47.130790 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 138883us
I20260709 12:10:47.114558 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:47.118222 20459 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.136085 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.141410 17439 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.141149 17432 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:47.089591 20352 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:47.059310 20448 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.111173 20456 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.108489 20466 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.146545 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:47.157286 17440 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:47.147308 17362 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.148630 20378 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.125376 20457 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.110569 20360 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.111104 20469 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.191053 20457 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.191256 20360 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.193176 20469 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.193347 20457 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:47.164958 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 236053us
I20260709 12:10:47.145884 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:47.156534 19964 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:47.194204 20360 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:47.196210 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:47.196357 20360 consensus_queue.cc:1059] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:47.161922 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:47.197497 20316 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.162662 20466 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.199939 20466 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:47.144977 20459 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.200681 20459 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.145545 20453 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.163095 20356 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.197497 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:47.164095 20448 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:47.110877 20431 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.188604 20353 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.104547 20380 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:47.194015 17367 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
W20260709 12:10:47.204037 17333 leader_election.cc:336] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 1.575s (SENT)
I20260709 12:10:47.201804 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:47.210202 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.211987 18006 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:47.222419 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:47.222838 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:47.211834 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:47.221554 18015 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:10:47.212306 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 76283.7us
I20260709 12:10:47.223208 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:47.239250 18011 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
W20260709 12:10:47.240751 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 86127.2us
I20260709 12:10:47.206231 20453 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.251828 17439 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:10:47.249692 20461 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.223001 20371 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:47.209589 20381 consensus_meta.cc:287] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.721s	user 0.007s	sys 0.006s
W20260709 12:10:47.211889 20387 consensus_meta.cc:287] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.003s
I20260709 12:10:47.250672 20313 raft_consensus.cc:3055] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:47.221993 20473 log.cc:927] Time spent T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:47.287675 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:47.207875 20457 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.224360 20356 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.289516 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:47.297938 20387 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.308503 20387 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:47.262455 20360 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.309517 20475 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.310935 17288 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:47.312458 17291 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:47.294260 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 96849us
I20260709 12:10:47.314553 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:47.222865 20407 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.300294 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:47.304124 20449 raft_consensus.cc:3055] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:47.304821 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 100817us
I20260709 12:10:47.300186 20461 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:47.305820 20478 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:47.321578 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.323189 17283 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:47.323786 17285 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:47.293995 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:47.323350 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:47.296023 20313 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:47.295881 20452 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:47.332765 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:47.334198 17287 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:47.318606 20381 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.335667 18011 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:47.323820 20387 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.340119 17288 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:47.320617 20449 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:47.343276 17333 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:47.254245 20343 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.298420 20445 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.320868 20457 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.327361 20377 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:47.333099 20461 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.322845 20407 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:47.776926 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.394572 20451 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:47.410331 20463 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.343233 20265 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:47.566087 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.784752 20265 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:47.604743 20351 consensus_meta.cc:287] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.003s
I20260709 12:10:47.744603 20459 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:47.336766 20444 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:47.622370 20443 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:47.408783 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:47.355110 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:47.409119 20318 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:47.474128 20449 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.593674 20462 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:47.791620 20449 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.792214 20462 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:47.355239 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:47.346428 20387 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.784354 20463 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:47.410516 20471 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:47.788166 20444 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:47.779307 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:47.798194 20444 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.794461 17289 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.801097 20457 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:47.783447 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:47.802279 18008 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:47.798776 20318 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:47.803309 20374 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.803663 20318 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:47.804831 20374 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.789357 17287 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:47.787216 20351 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:47.807610 20461 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.806154 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:47.808652 20351 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.796772 20471 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:47.810616 20376 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:47.810338 20313 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:47.623024 20480 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:10:47.813158 20316 raft_consensus.cc:3055] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:47.813675 20316 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:47.787374 20265 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.814764 20316 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:47.820477 17291 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.002s
W20260709 12:10:47.822746 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 475202us
W20260709 12:10:47.781600 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 442911us
I20260709 12:10:47.831094 18009 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
W20260709 12:10:47.839959 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 552344us
I20260709 12:10:47.840302 20463 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.841311 17255 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:47.842439 20353 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:47.842377 20351 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:47.842900 20124 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.843520 20351 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:47.843747 20307 consensus_meta.cc:287] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.001s
I20260709 12:10:47.844133 20307 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.844249 20351 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:47.844674 20351 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:47.845479 20351 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:47.846899 20351 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.847136 20387 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.818552 20460 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:47.854415 20475 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:47.828078 20451 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:47.855650 20471 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:47.857319 18010 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:47.859419 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.860046 17291 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:47.811838 20313 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.860507 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.878348 17439 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:47.862150 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:47.864362 20319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.012s
W20260709 12:10:47.847275 20488 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:47.870965 17289 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:47.875240 17433 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.863346 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:47.889236 17441 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.889472 17437 raft_consensus.cc:3055] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.889896 17437 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:47.874156 17404 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:47.883620 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.880616 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:47.784991 20431 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:47.882268 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.892577 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:47.893357 18009 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
W20260709 12:10:47.876171 20472 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.580s	user 0.002s	sys 0.000s
I20260709 12:10:47.879420 17436 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:47.885385 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:47.885823 17438 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.863996 20316 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.888051 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.882447 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:47.876235 20479 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:47.945640 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.873631 20360 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.900246 17287 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.957896 17291 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:47.887481 20319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.009s	sys 0.013s
I20260709 12:10:48.067883 17255 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:48.067850 17441 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
W20260709 12:10:48.085011 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 210930us
I20260709 12:10:48.119473 17432 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:47.894892 17283 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.942797 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:48.039592 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:48.121025 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:48.120465 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 246509us
W20260709 12:10:48.022197 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.944448 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:47.981850 18008 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.942530 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:47.309870 20470 consensus_queue.cc:1175] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaafaad0810b4e95983d2d73ec814346" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:10:47.947291 20467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.008s	sys 0.043s
I20260709 12:10:47.901228 17289 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.111707 17440 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:48.109318 17286 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:48.121459 18014 raft_consensus.cc:2393] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:47.998379 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:48.142974 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:48.143252 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 129053us
I20260709 12:10:48.144065 17255 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:48.145418 17255 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:48.146263 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:48.147130 20459 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:48.147780 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:48.148391 17432 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.149796 20474 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:48.150674 17436 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:48.152036 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.943425 18015 raft_consensus.cc:2955] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:48.155046 20343 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.122958 18013 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.157065 20474 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:48.158676 20462 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:48.124071 20431 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:48.159695 20431 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:48.160941 17255 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:48.158624 20474 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:48.162724 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:47.951174 17437 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:48.049703 20407 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:48.175201 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:48.173103 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:47.997809 20317 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:48.140318 17292 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:48.152196 20453 consensus_meta.cc:287] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.897s	user 0.005s	sys 0.003s
I20260709 12:10:47.952157 17288 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:48.169842 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:48.181422 17437 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.195043 18009 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:48.197378 17435 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:48.191612 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:48.176633 20467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.018s	sys 0.052s
I20260709 12:10:48.201165 17364 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:48.183203 17436 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:48.124459 20352 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:48.183785 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 45065.8us
I20260709 12:10:48.182636 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:48.202975 18014 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:48.180131 17433 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:48.197019 18013 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:48.205909 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:48.207849 17291 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:48.180231 17289 raft_consensus.cc:2955] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:48.161916 20431 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:48.210047 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.162914 20343 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.139446 20265 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:48.210552 18010 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:48.211516 17436 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:48.233563 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:47.946364 20475 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:48.181867 17434 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.235347 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:48.235407 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:48.186388 20468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.004s	sys 0.010s
I20260709 12:10:48.185014 20459 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.179196 20464 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:48.237592 18013 raft_consensus.cc:2410] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:48.235347 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:48.198674 20445 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:48.123075 20360 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:48.252449 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:48.197069 20443 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.262534 20443 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:48.263767 20443 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:48.240607 20468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.005s	sys 0.011s
I20260709 12:10:48.192706 20407 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:48.241233 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:48.242090 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:48.185151 20487 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.193089 20483 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 12:10:48.249564 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 86974.3us
I20260709 12:10:48.245734 17366 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:10:48.231844 20378 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.005s	sys 0.013s
I20260709 12:10:48.249554 17292 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:48.207255 20387 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.257179 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:48.258375 20360 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:48.254021 20376 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.262012 18009 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
W20260709 12:10:48.270856 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.265894 17437 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:10:48.299204 17437 pending_rounds.cc:85] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 7
I20260709 12:10:48.272269 17441 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:47.943977 20451 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:48.234768 20477 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:48.311612 17255 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:48.266224 20471 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:48.287232 20371 consensus_meta.cc:287] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.997s	user 0.006s	sys 0.005s
I20260709 12:10:48.271968 20124 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:48.244109 20463 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:10:48.318408 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.319235 20453 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.319787 20453 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:48.297009 20378 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.005s	sys 0.013s
I20260709 12:10:48.280733 18010 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:48.246512 17288 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.237425 20374 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:48.280819 17291 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:48.176074 19964 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:10:48.294221 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:48.299500 17437 pending_rounds.cc:107] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:10:48.274999 20307 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.279309 17432 raft_consensus.cc:2410] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:48.248381 20265 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:48.284531 20487 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:48.286386 20352 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:48.286118 20464 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:48.278349 20459 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:10:48.529672 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.155241 20500 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.462s	user 0.000s	sys 0.000s
W20260709 12:10:49.058909 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 348038us
I20260709 12:10:48.340762 20471 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:48.310962 20387 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:48.388991 20124 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.193178 20444 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:49.194149 20444 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:48.431304 18011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 713) took 1229 ms. Trace:
I20260709 12:10:48.653358 20475 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:48.406215 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:48.295831 20407 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.195721 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1615) took 1047 ms. Trace:
I20260709 12:10:49.192871 20343 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:49.196215 17438 rpcz_store.cc:276] 0709 12:10:48.147976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.173949 (+ 25973us) service_pool.cc:224] Handling call
0709 12:10:48.199272 (+ 25323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.237520 (+ 38248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.237547 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.252659 (+ 15112us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.539278 (+286619us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.539339 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.539417 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.195515 (+656098us) raft_consensus.cc:1685] finished
0709 12:10:49.195538 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.195665 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":157372,"threads_started":1,"wal-append.queue_time_us":909975}
I20260709 12:10:49.197037 20343 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.197517 20407 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.195612 18011 rpcz_store.cc:276] 0709 12:10:47.201558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.292121 (+ 90563us) service_pool.cc:224] Handling call
0709 12:10:48.430992 (+1138871us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5400610154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:48.431219 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39334144}
I20260709 12:10:49.199231 20343 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.199437 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:48.368629 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 72039.1us
I20260709 12:10:48.313566 20445 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:48.777089 20313 consensus_meta.cc:287] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.886s	user 0.006s	sys 0.005s
I20260709 12:10:48.403643 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1582) took 1076 ms. Trace:
I20260709 12:10:48.407021 20317 raft_consensus.cc:2955] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:49.204068 20475 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.204536 20475 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:48.311493 20376 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.205184 20459 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:48.403882 20494 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:10:48.724370 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.205538 17285 rpcz_store.cc:276] 0709 12:10:47.327071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.327586 (+   515us) service_pool.cc:224] Handling call
0709 12:10:47.327963 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:47.343008 (+ 15045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.343041 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:47.346999 (+  3958us) log.cc:844] Serialized 52 byte log entry
0709 12:10:47.835790 (+488791us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:47.858178 (+ 22388us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b48003000d8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:10:47.885218 (+ 27040us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.885455 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.885528 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.252524 (+366996us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b1800434aa0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e3f3 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
0709 12:10:48.403421 (+150897us) raft_consensus.cc:1685] finished
0709 12:10:48.403445 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.403582 (+   137us) inbound_call.cc:177] Queueing success response
0709 12:10:48.652846 (+249264us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b1800434aa0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229fc2a6 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e522 00007f1222a307c1
0709 12:10:48.767486 (+114640us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b1800434aa0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e522 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
Metrics: {"prepare.queue_time_us":51731,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":10672,"raft.run_cpu_time_us":11783,"raft.run_wall_time_us":522843,"spinlock_wait_cycles":99794304,"thread_start_us":469203,"threads_started":1,"wal-append.queue_time_us":616637}
I20260709 12:10:49.208287 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:48.371922 20371 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:49.170641 20377 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.754158 20502 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:49.209304 20377 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.209455 20502 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:49.161564 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 865725us
W20260709 12:10:48.393414 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.183672 20378 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:48.962774 20451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.008s	sys 0.019s
I20260709 12:10:49.186544 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2440) took 1300 ms. Trace:
I20260709 12:10:49.222160 17290 rpcz_store.cc:276] 0709 12:10:47.886159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.886319 (+   160us) service_pool.cc:224] Handling call
0709 12:10:47.922849 (+ 36530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.986196 (+ 63347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.986237 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.075631 (+ 89394us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.339930 (+264299us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:48.339971 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.340038 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.186285 (+846247us) raft_consensus.cc:1685] finished
0709 12:10:49.186316 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.186472 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12232,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11732,"thread_start_us":263848,"threads_started":1,"wal-append.queue_time_us":1096734}
I20260709 12:10:48.596858 17287 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:49.225374 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.187857 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1612) took 1041 ms. Trace:
W20260709 12:10:49.225975 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.386489 20478 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.988447 20312 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.405609 20503 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.028206 20462 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:49.190505 20352 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.191798 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2444) took 1080 ms. Trace:
I20260709 12:10:49.179209 20265 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:48.454685 20499 consensus_queue.cc:1059] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.759s
I20260709 12:10:48.715546 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.194644 20124 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:48.769487 20254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.004s	sys 0.012s
I20260709 12:10:48.331374 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:49.260139 18014 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:49.199849 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:48.563382 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:48.315812 20460 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:49.196424 20444 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.265573 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:49.179965 20374 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.174276 20487 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.270089 20462 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.273877 20462 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.178697 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:49.178937 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.274574 17433 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:10:49.274755 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.275707 20460 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.266336 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:48.622821 20497 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
I20260709 12:10:49.282541 20460 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:49.270206 19964 raft_consensus.cc:3055] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.283484 19964 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:49.283548 20470 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:49.283964 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:49.284365 20387 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.285800 20502 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:48.709771 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 128573us
I20260709 12:10:48.297673 20468 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.370570 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:48.432478 18006 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:49.182732 17437 raft_consensus.cc:2889] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.289718 20468 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.265540 20124 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.214215 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.214877 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:49.216581 17360 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:49.175289 20455 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.176743 20471 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:49.179334 18008 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:49.181504 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:49.288995 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.290055 17292 raft_consensus.cc:2393] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:49.290226 18014 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:49.291800 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 724) took 1400 ms. Trace:
I20260709 12:10:49.292140 20532 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:10:49.296085 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2450) took 1061 ms. Trace:
I20260709 12:10:49.297259 18012 rpcz_store.cc:276] 0709 12:10:47.891409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.891558 (+   149us) service_pool.cc:224] Handling call
0709 12:10:48.114749 (+223191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.124716 (+  9967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.124766 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.201845 (+ 77079us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.600615 (+398770us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:48.600662 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.600741 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.291605 (+690864us) raft_consensus.cc:1685] finished
0709 12:10:49.291625 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.291737 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17638,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":29738,"thread_start_us":314790,"threads_started":1,"wal-append.queue_time_us":969884}
I20260709 12:10:49.290925 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 530) took 1418 ms. Trace:
I20260709 12:10:49.299741 20374 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.292224 20468 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.292335 20387 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:10:49.228245 20378 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.301563 20532 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.302037 20532 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.294613 17291 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.305140 20532 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:49.294167 20455 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.219676 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.220353 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:49.170784 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.716341 20504 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:10:49.208001 20376 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.226253 17432 rpcz_store.cc:276] 0709 12:10:48.146523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.147508 (+   985us) service_pool.cc:224] Handling call
0709 12:10:49.187789 (+1040281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.406338 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:48.432751 20453 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:49.224814 20451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.010s	sys 0.026s
I20260709 12:10:49.180316 20360 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.408110 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1581) took 2085 ms. Trace:
I20260709 12:10:49.407997 20360 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.408337 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.203142 20445 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.408594 17284 rpcz_store.cc:276] 0709 12:10:47.322795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.327403 (+  4608us) service_pool.cc:224] Handling call
0709 12:10:47.339075 (+ 11672us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:47.347267 (+  8192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.347300 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:47.859059 (+511759us) log.cc:844] Serialized 52 byte log entry
0709 12:10:48.288382 (+429323us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.288429 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.288508 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.407905 (+1119397us) raft_consensus.cc:1685] finished
0709 12:10:49.407927 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.408054 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2035,"raft.queue_time_us":3667,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":45394,"thread_start_us":385126,"threads_started":1,"wal-append.queue_time_us":585539}
I20260709 12:10:49.233630 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.410514 17365 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:10:49.410715 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2453) took 1101 ms. Trace:
I20260709 12:10:49.406663 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 537) took 1485 ms. Trace:
I20260709 12:10:49.411526 17434 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:49.411221 17290 rpcz_store.cc:276] 0709 12:10:48.312005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.224061 (+912056us) service_pool.cc:224] Handling call
0709 12:10:49.410640 (+186579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.413020 20445 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.413471 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:48.406032 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.238034 17288 rpcz_store.cc:276] 0709 12:10:48.111327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.201707 (+ 90380us) service_pool.cc:224] Handling call
0709 12:10:48.239377 (+ 37670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.191498 (+952121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.191727 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.414585 17366 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:10:49.415014 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.410476 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.416342 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.416548 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.416390 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:49.417035 17288 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 3.
I20260709 12:10:49.244516 20475 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.224509 20371 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.416901 17435 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:49.417851 17290 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:49.249529 20313 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.419107 20313 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.419580 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.420173 17290 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:49.237262 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.236851 20312 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:49.180727 20307 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.235110 20478 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.411604 17286 rpcz_store.cc:276] 0709 12:10:47.921702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.142064 (+220362us) service_pool.cc:224] Handling call
0709 12:10:48.144158 (+  2094us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.172402 (+1028244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.172448 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.173044 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.202482 (+ 29438us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:49.203010 (+   528us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.212666 (+  9656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.257808 (+ 45142us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400368654. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:49.257873 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.406371 (+148498us) raft_consensus.cc:1685] finished
0709 12:10:49.406472 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.406604 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17205,"prepare.queue_time_us":432,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":24549,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6440,"spinlock_wait_cycles":2364097920,"thread_start_us":29033,"threads_started":1,"wal-append.queue_time_us":198329}
I20260709 12:10:49.426471 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.427054 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.427934 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.428205 17286 raft_consensus.cc:2393] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:49.230533 20461 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:49.430395 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2442) took 1536 ms. Trace:
I20260709 12:10:49.431030 17289 rpcz_store.cc:276] 0709 12:10:47.894340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.179533 (+285193us) service_pool.cc:224] Handling call
0709 12:10:48.179888 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.180114 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:48.319489 (+139375us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.200158 (+880669us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.203588 (+  3430us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.430018 (+226430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.430072 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:49.430147 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.430217 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.430334 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":569328,"prepare.queue_time_us":3578,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":589865,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":4623,"thread_start_us":524015,"threads_started":2,"wal-append.queue_time_us":888906}
I20260709 12:10:49.399976 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.200785 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 727) took 1304 ms. Trace:
I20260709 12:10:49.268045 20523 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:49.236102 20526 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.278816 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 536) took 1388 ms. Trace:
I20260709 12:10:49.287108 20377 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:49.253659 20449 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.263235 20254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.012s	sys 0.033s
I20260709 12:10:49.292577 20124 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.288029 17358 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.203282 18011 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:49.302894 17437 rpcz_store.cc:276] 0709 12:10:47.872919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.873232 (+   313us) service_pool.cc:224] Handling call
0709 12:10:47.889360 (+ 16128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.290668 (+1401308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.290848 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.427106 20313 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.302757 20378 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.221109 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.305711 20532 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.371578 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1614) took 1223 ms. Trace:
I20260709 12:10:49.368181 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:49.269694 20431 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.395607 20477 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.396412 20502 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:49.374078 20474 consensus_queue.cc:1059] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:10:49.297981 17292 rpcz_store.cc:276] 0709 12:10:48.234876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.306922 (+ 72046us) service_pool.cc:224] Handling call
0709 12:10:49.296026 (+989104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.373401 20455 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.253710 20503 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.294821 20471 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:49.311378 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 746) took 1327 ms. Trace:
I20260709 12:10:49.369534 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.379457 17291 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
W20260709 12:10:49.399772 20508 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:10:49.415096 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2478) took 1091 ms. Trace:
I20260709 12:10:49.254360 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.475790 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.472965 18006 rpcz_store.cc:276] 0709 12:10:47.983849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.191991 (+208142us) service_pool.cc:224] Handling call
0709 12:10:48.432022 (+240031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.289781 (+857759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.311125 (+ 21344us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400610150. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:49.311310 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551159680}
W20260709 12:10:49.476689 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 222413us
W20260709 12:10:49.310246 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 43999.3us
I20260709 12:10:49.427129 17290 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:49.429756 17285 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:49.432955 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:49.434492 17407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.006s	sys 0.016s
W20260709 12:10:49.478686 17407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.006s	sys 0.016s
I20260709 12:10:49.478849 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.426401 20478 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.433404 18015 rpcz_store.cc:276] 0709 12:10:47.896687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.896809 (+   122us) service_pool.cc:224] Handling call
0709 12:10:47.942970 (+ 46161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.943271 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:48.248306 (+305035us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.197429 (+949123us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.197785 (+   356us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.197945 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.197985 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:49.198031 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.200575 (+  2544us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.200710 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100402,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":426573,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":237,"thread_start_us":900933,"threads_started":3,"wal-append.queue_time_us":980664}
I20260709 12:10:49.435294 17287 rpcz_store.cc:276] 0709 12:10:47.890426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.134298 (+243872us) service_pool.cc:224] Handling call
0709 12:10:48.145471 (+ 11173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.225888 (+1080417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.278581 (+ 52693us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540007ba54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:49.278746 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036596992}
I20260709 12:10:49.440593 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:49.448179 17258 connection.cc:256] RPC call timeout handler was delayed by -1.5750403049999022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 12:10:49.437197 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:49.453821 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 161877us
W20260709 12:10:49.307222 20316 consensus_meta.cc:287] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.192s	user 0.002s	sys 0.009s
I20260709 12:10:49.434018 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:49.458982 20532 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:49.477986 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.455017 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.488090 17286 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 3.
I20260709 12:10:49.456219 17362 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:49.462369 17439 rpcz_store.cc:276] 0709 12:10:48.147653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.196736 (+ 49083us) service_pool.cc:224] Handling call
0709 12:10:48.230123 (+ 33387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.238538 (+  8415us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:48.364095 (+125557us) log.cc:844] Serialized 14 byte log entry
0709 12:10:48.417653 (+ 53558us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.418483 (+   830us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.418632 (+   149us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.418665 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.418739 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.371274 (+952535us) raft_consensus.cc:1685] finished
0709 12:10:49.371300 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.371463 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32190,"prepare.queue_time_us":1026194,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":35,"raft.queue_time_us":32464,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":28730,"thread_start_us":127940,"threads_started":2,"wal-append.queue_time_us":1004597}
I20260709 12:10:49.397914 20464 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.455638 20376 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:49.490880 20376 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.493744 20376 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.437605 20307 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.494418 20451 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.439318 20371 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.438171 20449 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.439376 20461 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.496937 20449 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.497366 20461 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.474454 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2455) took 1019 ms. Trace:
I20260709 12:10:49.498418 17291 rpcz_store.cc:276] 0709 12:10:48.455338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.181223 (+725885us) service_pool.cc:224] Handling call
0709 12:10:49.474377 (+293154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.473937 17364 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:49.440065 20124 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.417243 17284 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
W20260709 12:10:49.483527 17258 connection.cc:256] RPC call timeout handler was delayed by -1.5219403050000437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 12:10:49.483527 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.499606 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.502027 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.476378 17366 rpcz_store.cc:276] 0709 12:10:48.323907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.354606 (+ 30699us) service_pool.cc:224] Handling call
0709 12:10:49.415013 (+1060407us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:49.486017 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.487509 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 53537.5us
I20260709 12:10:49.489681 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.503933 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.504696 17285 raft_consensus.cc:2410] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:49.494947 20451 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.504834 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.504853 17290 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:49.506729 17291 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:49.506553 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.507510 17362 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 1.
I20260709 12:10:49.505281 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.482700 20313 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.475788 20471 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.511823 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.511965 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 538) took 1570 ms. Trace:
I20260709 12:10:49.512396 17981 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.512465 17404 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.513314 17333 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:49.515714 17361 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:49.516639 20471 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.437950 20526 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.509624 20307 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.530716 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.515682 17283 rpcz_store.cc:276] 0709 12:10:47.941999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.144893 (+202894us) service_pool.cc:224] Handling call
0709 12:10:48.145207 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.159235 (+ 14028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.159269 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.160392 (+  1123us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.578819 (+418427us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:48.753403 (+174584us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.192087 (+438684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.192160 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.509980 (+317820us) raft_consensus.cc:1685] finished
0709 12:10:49.510003 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.511898 (+  1895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":439069,"prepare.queue_time_us":188696,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":446356,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":162,"thread_start_us":554705,"threads_started":2,"wal-append.queue_time_us":1040553}
I20260709 12:10:49.532205 20526 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.469455 20377 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:49.516736 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.499387 20538 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.522398 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:49.469720 20431 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.533680 20538 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:49.534058 20526 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.506973 20523 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:10:49.534500 20526 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.534940 20526 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.522676 20407 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.515400 20313 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:49.535902 20407 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.523746 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.438334 20312 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.541963 20538 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.542603 20313 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.543973 20313 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.543335 17366 raft_consensus.cc:2410] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:49.545682 17366 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:49.506760 20445 consensus_queue.cc:1059] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:49.534440 17359 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:49.539901 17981 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.546835 17292 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.436535 20487 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.471302 20477 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.559764 20487 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.523352 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.560456 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2446) took 1435 ms. Trace:
I20260709 12:10:49.560654 17437 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:49.560781 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 56530.6us
I20260709 12:10:49.472523 20502 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.561021 20312 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.527395 20449 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:49.527664 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.528012 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.527709 20532 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.528440 20316 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.526669 20460 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.494364 20376 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:10:49.531008 20307 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.514117 20124 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:49.540946 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 107918us
I20260709 12:10:49.545989 17366 pending_rounds.cc:85] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 2
I20260709 12:10:49.503996 20378 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:10:49.503206 20462 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.509213 20451 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.517710 20461 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:49.535508 20431 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.556721 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.557022 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.563753 20407 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:49.562813 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:49.563129 17292 rpcz_store.cc:276] 0709 12:10:48.125088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.516022 (+1390934us) service_pool.cc:224] Handling call
0709 12:10:49.546627 (+ 30605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.547254 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.560360 (+ 13106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:49.611181 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 64211.3us
I20260709 12:10:49.651376 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1535) took 1245 ms. Trace:
I20260709 12:10:49.650775 18015 raft_consensus.cc:2955] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:49.653638 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2452) took 1376 ms. Trace:
I20260709 12:10:49.563563 17407 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.565307 17362 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:49.655177 17291 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:10:49.584679 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.584962 20460 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:49.589156 17364 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.588888 20478 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.590407 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:49.591406 17437 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.651770 17434 rpcz_store.cc:276] 0709 12:10:48.406426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.780122 (+373696us) service_pool.cc:224] Handling call
0709 12:10:49.187549 (+407427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.411976 (+224427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.650620 (+238644us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001482d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:49.651188 (+   568us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54001482d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:49.651315 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450750592}
I20260709 12:10:49.660260 17435 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:49.586496 20487 raft_consensus.cc:3055] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.592818 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.663815 17441 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:10:49.596309 17440 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:49.598649 17366 pending_rounds.cc:107] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:49.664706 17366 raft_consensus.cc:2889] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.599344 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:49.603036 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 118950us
I20260709 12:10:49.665385 17438 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:49.665277 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:49.666245 18012 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:10:49.605214 17333 connection.cc:256] RPC call timeout handler was delayed by -2.1215629309999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
I20260709 12:10:49.570264 20316 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.600123 20307 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.571583 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:49.655809 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 92328.4us
I20260709 12:10:49.654012 17289 rpcz_store.cc:276] 0709 12:10:48.285312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.652828 (+1367516us) service_pool.cc:224] Handling call
0709 12:10:49.653163 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.653341 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.653369 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.653408 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:49.653444 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.653493 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.653585 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.668387 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:49.676759 17407 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:49.592223 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 91692.6us
W20260709 12:10:49.626117 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.574923 20449 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.594053 20254 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.612540 17432 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.674139 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.606360 20462 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.684392 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.662427 20523 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.603984 20532 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.676993 18006 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:49.664664 20459 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.678385 17258 connection.cc:256] RPC call timeout handler was delayed by -1.3786194609999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:10:49.712432 17258 connection.cc:256] RPC call timeout handler was delayed by -1.2805675089998658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 12:10:49.713006 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.683254 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.684506 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.715070 17433 raft_consensus.cc:2393] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:49.715866 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.685086 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:49.684981 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.686470 17287 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.645906 20360 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:49.687438 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.716643 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.691656 17437 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:49.663565 20487 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:49.692552 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.722498 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.693112 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.691690 18010 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:49.691649 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:49.668792 20455 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.721721 20536 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:10:49.734441 20542 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:49.736243 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:49.737437 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.738867 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.740181 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.740747 17361 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:49.741577 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.734498 20455 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:49.742648 20455 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:49.745781 20524 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 12:10:49.718591 20501 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:49.714143 17258 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:49.640926 20477 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.690949 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:49.719937 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 157665us
I20260709 12:10:49.748944 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.674039 20316 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.661623 20461 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.642599 20371 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:49.724427 17366 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:49.724740 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.725593 20502 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:49.726286 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.785580 17358 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:49.726856 20317 raft_consensus.cc:3055] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.727201 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.680286 20474 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:49.727463 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.731192 20503 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:49.687968 20449 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:49.774631 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.775269 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.830890 17439 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:49.742655 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.713874 20462 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:49.749395 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 82871.6us
I20260709 12:10:49.710587 20453 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:49.775025 17434 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:49.774194 18008 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:49.714411 20124 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:49.826789 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.828974 17290 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.833217 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.834009 17980 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:10:49.834581 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 120537us
I20260709 12:10:49.785061 20461 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.843415 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:49.843825 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:49.748271 20546 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.873505 17333 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:49.873787 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.844321 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.835621 20477 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.845539 20124 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.842748 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:49.846974 17290 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:49.848459 20518 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:49.884382 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.884799 20518 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:49.854605 20376 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.873337 20453 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:49.887887 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2447) took 1750 ms. Trace:
I20260709 12:10:49.888357 17285 rpcz_store.cc:276] 0709 12:10:48.137065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.514343 (+1377278us) service_pool.cc:224] Handling call
0709 12:10:49.514644 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.530274 (+ 15630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.530303 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.564678 (+ 34375us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.682635 (+117957us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:49.682676 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.682747 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.887652 (+204905us) raft_consensus.cc:1685] finished
0709 12:10:49.887673 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.887821 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15397,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":50489,"threads_started":1,"wal-append.queue_time_us":279519}
I20260709 12:10:49.889909 20451 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.892198 20451 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:49.892758 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:49.893486 17290 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:49.850819 20545 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:10:49.851482 17440 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1611) took 1705 ms (client timeout 1747 ms). Trace:
W20260709 12:10:49.894757 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 52095.4us
I20260709 12:10:49.836194 20474 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:49.786614 20540 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:49.854041 20478 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:49.749301 20459 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.875252 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.909657 17361 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:10:49.911095 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.826309 20317 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:49.882982 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:49.913069 20317 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.914594 20317 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.915771 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:49.883811 20477 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.876952 20546 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.923516 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.882771 20265 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:49.845856 17439 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:49.750869 20523 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.885764 20376 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:49.898533 17359 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:49.745904 20538 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.726806 19964 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:49.872416 20536 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:10:49.867769 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.918443 20546 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.833003 20445 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:49.916473 20467 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:49.916953 20431 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:49.893447 17432 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:49.924868 17361 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:49.965029 18012 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:10:49.895093 17440 rpcz_store.cc:269] 0709 12:10:48.145998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.169541 (+ 23543us) service_pool.cc:224] Handling call
0709 12:10:49.851301 (+1681760us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001b03d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:49.851417 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3023038720}
I20260709 12:10:49.966909 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:49.908066 17978 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:49.898686 20254 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.970302 18010 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:49.777940 20460 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.999125 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.965602 20451 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.902573 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.963198 20265 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.979816 18014 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.980898 18011 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.984408 17441 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.004653 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.986116 17436 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:10:49.988876 17435 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:49.882499 20464 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:10:49.995100 20467 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.888767 20453 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:49.885730 20518 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:50.022892 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:50.023097 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:50.029196 17361 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:50.028592 17432 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: [3.3-8.6]
I20260709 12:10:50.007370 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:50.009567 17364 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:49.973691 20376 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.013645 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.972663 20371 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:49.936148 20549 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.008273 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 747) took 1890 ms. Trace:
I20260709 12:10:50.030232 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:50.033910 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:50.004520 20254 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.035064 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:49.981787 20487 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:50.007682 20360 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.005944 20502 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.038198 18013 rpcz_store.cc:276] 0709 12:10:48.118251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.295247 (+176996us) service_pool.cc:224] Handling call
0709 12:10:48.323226 (+ 27979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.282472 (+959246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.282500 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.282560 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:49.282593 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.008038 (+725445us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b5400623ed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:50.008087 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.008210 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195148032}
I20260709 12:10:50.038836 18010 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:10:50.039959 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2451) took 1794 ms. Trace:
I20260709 12:10:50.025840 20467 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:50.052826 20526 consensus_meta.cc:287] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.002s
I20260709 12:10:50.063079 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:50.063323 17287 rpcz_store.cc:276] 0709 12:10:48.250657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.587137 (+1336480us) service_pool.cc:224] Handling call
0709 12:10:49.587480 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.717322 (+129842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.039696 (+322374us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b54001b6554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:50.039891 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227238784}
I20260709 12:10:50.064200 17407 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:50.071372 18014 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:50.037200 20371 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.049278 20501 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.008132 20265 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.038163 20549 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.072942 17407 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:50.057206 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:50.054323 20254 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.055159 20460 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:50.061659 20471 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 12:10:50.010567 20451 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.060041 20518 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.000277 20445 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:50.108306 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.078346 20371 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:50.112385 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 196667us
I20260709 12:10:50.106666 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:50.120841 18012 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:50.120971 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 212995us
I20260709 12:10:50.121759 17333 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:50.075724 20501 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.118824 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:50.079107 20407 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.080994 20487 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:50.122504 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.123023 20464 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.125633 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:50.063226 20360 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:50.108527 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 595367us
I20260709 12:10:50.121821 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:50.067411 20502 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.080753 20470 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:10:50.090529 20549 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:50.163233 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.135326 20501 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.112708 20503 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.135499 17440 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:50.077544 20526 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:50.154228 18009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.037s	sys 0.051s
I20260709 12:10:50.165998 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:50.147497 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 303728us
I20260709 12:10:50.185232 17258 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:50.170928 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 49187us
I20260709 12:10:50.187218 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:10:50.173216 20552 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:50.174512 20377 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.176563 20307 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.176913 20254 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.178547 20474 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.178978 20360 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.179075 17362 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.145395 20551 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:50.180322 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 141114us
I20260709 12:10:50.144714 20407 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.207721 17364 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.210520 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:50.183857 20503 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.156709 20464 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.195194 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:50.114920 20471 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:50.209611 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.190637 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:50.151576 20463 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:10:50.179512 20542 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.256313 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:50.179913 20461 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.214493 20407 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.269665 17360 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:50.213686 20445 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.235409 20503 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.235371 20464 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.236011 20538 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:50.206698 20377 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:50.291528 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:50.305788 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:50.213232 20556 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.282418 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:50.279048 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.308840 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.279656 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 729) took 2382 ms. Trace:
I20260709 12:10:50.278947 17366 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:50.311807 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:50.295941 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:50.259039 20474 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:50.301774 20455 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 12:10:50.306952 17360 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:50.310660 18007 rpcz_store.cc:276] 0709 12:10:47.897289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.170789 (+273500us) service_pool.cc:224] Handling call
0709 12:10:48.504891 (+334102us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:49.186154 (+681263us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6e9c 00007f12229f6a5b 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:49.186349 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.443248 (+256899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.443290 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.468716 (+ 25426us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:49.468762 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.279360 (+810598us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400573fd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:50.279414 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.279559 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371258240}
W20260709 12:10:50.327139 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 136597us
I20260709 12:10:50.276917 20554 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.235962 20560 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:10:50.338888 17258 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:50.337422 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:50.288247 20536 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.318419 20478 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:50.356664 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:10:50.357369 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 102361us
I20260709 12:10:50.359684 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:50.337977 20551 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.339982 20477 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:50.341682 20374 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.348344 20313 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.370536 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:50.389251 20566 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:50.360737 20553 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:10:50.363032 20478 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.344383 20555 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.368943 20556 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.323045 20455 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.375861 20474 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:50.374912 20451 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.319679 20445 consensus_queue.cc:1059] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:10:50.400300 20555 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.363560 20463 consensus_queue.cc:1059] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:10:50.422569 20463 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.422953 20463 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:50.423864 20463 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:50.424706 20317 consensus_meta.cc:287] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 12:10:50.398785 20313 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.425457 20313 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.425840 20313 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.391949 20551 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:50.432245 20462 consensus_meta.cc:287] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.578s	user 0.000s	sys 0.010s
I20260709 12:10:50.432722 20462 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:50.433706 20551 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:50.418143 20557 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:10:50.418845 20461 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:50.420564 20449 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.003s
I20260709 12:10:50.425060 20463 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:50.417120 20562 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:10:50.414961 20556 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:50.436656 20407 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.429214 20549 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.438524 20462 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:50.439947 17360 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:50.396970 20374 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.401993 20478 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.370846 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:50.440892 18015 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:50.439668 20555 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:50.466565 20553 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:10:50.480531 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 109762us
W20260709 12:10:50.469369 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 81416.7us
I20260709 12:10:50.401379 20536 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:10:50.454519 20502 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.466967 20526 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:50.469599 20307 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:50.497885 17285 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.469328 20254 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.500648 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:50.493299 18006 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:50.501405 18012 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:50.500095 17287 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.501259 17283 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.501343 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:50.504812 17439 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:50.482265 20474 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:50.508193 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:50.508827 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:50.518373 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.511307 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:50.523895 18012 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:50.517311 17438 raft_consensus.cc:2376] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5. Re-sending same reply.
I20260709 12:10:50.521689 17364 raft_consensus.cc:2376] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7. Re-sending same reply.
I20260709 12:10:50.517619 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:50.527467 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 87408.8us
I20260709 12:10:50.530004 17288 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:50.531791 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.532539 17291 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:50.488184 20571 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.474576 20449 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.536135 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.536139 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.538546 17285 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:50.500308 20471 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.541261 17289 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:50.486219 20461 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:10:50.558712 18012 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEARNER]: Advancing to term 8
I20260709 12:10:50.564096 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.571272 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:50.574484 17283 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:50.562795 20431 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:50.577078 20549 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:50.577556 20474 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.508590 20538 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:10:50.525619 20566 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:10:50.578084 20576 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:10:50.583006 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.578594 20573 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:50.585096 20573 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:50.581557 20538 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.586711 20538 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:50.587589 20538 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.589111 20538 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:50.589705 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.580262 20407 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.581809 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:50.595806 20461 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.598027 20573 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:50.599558 20449 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:50.602982 20449 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:50.603606 20449 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.604471 17289 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:50.605708 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:50.606904 20449 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:50.608475 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:50.538022 20571 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.614825 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2482) took 1333 ms. Trace:
I20260709 12:10:50.616386 17434 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:50.556346 20532 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.835s	user 0.006s	sys 0.006s
I20260709 12:10:50.628476 17367 rpcz_store.cc:276] 0709 12:10:49.280884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.281023 (+   139us) service_pool.cc:224] Handling call
0709 12:10:49.976388 (+695365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.976602 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.976640 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.976685 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:49.976718 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.976777 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.614553 (+637776us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b540040c4d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:50.614715 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598429440}
I20260709 12:10:50.584414 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:50.631573 18012 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:50.631800 17286 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.510078 20546 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.638855 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.641577 17290 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:10:50.639644 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.642696 18012 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:50.642989 17288 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:50.646327 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:50.532656 20254 consensus_queue.cc:1059] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:10:50.648689 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:50.649487 17366 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:50.549508 20376 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.658543 17286 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:10:50.659554 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.660925 20376 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:50.664861 20313 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.666483 20254 raft_consensus.cc:3055] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:50.666925 20254 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:50.667796 20254 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:50.669037 20254 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.670512 17287 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:10:50.654318 20522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.020s	sys 0.051s
I20260709 12:10:50.654803 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.655012 17367 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:10:50.655455 17406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.120s (SENT) [suppressed 39 similar messages]
I20260709 12:10:50.656126 20455 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.661628 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.650919 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:50.684142 17292 raft_consensus.cc:2410] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:10:50.684489 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 130053us
I20260709 12:10:50.630923 20571 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.631027 20477 raft_consensus.cc:697] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:50.672081 20487 consensus_meta.cc:287] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 12:10:50.646061 20377 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:50.674552 20522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.020s	sys 0.051s
I20260709 12:10:50.658317 20560 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.671351 20556 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:50.696051 17406 leader_election.cc:336] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.505s (SENT)
I20260709 12:10:50.694998 17359 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:50.697389 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:50.699345 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.700177 17289 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:50.703214 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:50.824437 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:50.829075 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:50.829797 17367 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.840612 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.841485 17292 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:50.835304 20449 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.844880 20313 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.845745 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:50.846381 17366 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.846544 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:50.695662 20560 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:50.848282 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:50.829254 20518 consensus_meta.cc:287] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.003s
I20260709 12:10:50.697165 20555 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.846257 20124 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:10:50.861330 20459 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:50.865127 17289 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:50.694860 20464 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:50.855605 20503 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.000s
W20260709 12:10:50.856881 20460 consensus_meta.cc:287] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.004s
I20260709 12:10:50.873656 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:50.849403 20467 consensus_meta.cc:287] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.760s	user 0.009s	sys 0.001s
I20260709 12:10:50.875277 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.876735 17289 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:50.876003 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:50.877930 18011 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:50.875029 17292 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:10:50.880383 17367 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:10:50.881945 17366 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:10:50.886330 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:50.886740 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:50.892211 20371 consensus_meta.cc:287] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.000s
W20260709 12:10:50.877008 20316 consensus_meta.cc:287] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.050s	user 0.007s	sys 0.005s
W20260709 12:10:50.893925 20265 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.782s	user 0.010s	sys 0.000s
I20260709 12:10:50.906229 18012 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: [7.9-8.10]
I20260709 12:10:50.907490 20464 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:50.880049 20374 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:50.912788 20449 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.872231 20477 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.923833 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 755) took 1698 ms. Trace:
I20260709 12:10:50.947189 18009 rpcz_store.cc:276] 0709 12:10:49.225273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.228137 (+  2864us) service_pool.cc:224] Handling call
0709 12:10:49.246817 (+ 18680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.498047 (+251230us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:49.498381 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.183953 (+685572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.184010 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:50.184062 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.923568 (+739506us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400630e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:50.923617 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.923771 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":525,"prepare.run_cpu_time_us":545,"prepare.run_wall_time_us":5021,"raft.queue_time_us":134089,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":577214720,"thread_start_us":684665,"threads_started":2,"wal-append.queue_time_us":278780,"wal-append.run_cpu_time_us":1846,"wal-append.run_wall_time_us":1136013}
W20260709 12:10:50.924197 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.926429 20474 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:50.926929 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:50.949083 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.949441 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.949641 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:50.950588 17255 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:50.951422 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:50.952126 20536 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.952549 20536 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:50.952723 20573 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:50.952562 20574 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.953665 20574 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.954276 20574 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.927189 20556 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:50.928380 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:50.927932 20560 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.877846 20503 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.930366 20575 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.931866 20555 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:50.879865 20467 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:50.934967 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:50.887382 17289 raft_consensus.cc:2376] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6. Re-sending same reply.
I20260709 12:10:50.946322 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.024487 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.960130 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.036239 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.037019 17285 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:51.035959 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.038225 17366 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:50.953182 20573 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:50.953217 20536 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.042722 20501 consensus_meta.cc:287] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.000s
I20260709 12:10:50.944875 20316 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.044755 17284 raft_consensus.cc:2393] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:51.045531 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.059722 17364 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:51.061466 20588 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.062503 20588 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:51.048691 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:50.945422 20371 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.080955 20371 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.036612 17291 raft_consensus.cc:2376] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6. Re-sending same reply.
I20260709 12:10:50.952251 17255 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:50.962975 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:51.084131 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 131940us
I20260709 12:10:50.945007 20478 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.048225 20573 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:51.043663 20556 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.057597 20467 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:50.953555 20576 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.066692 17432 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:50.944746 20265 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.066381 20588 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.069470 20316 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:51.085712 17358 raft_consensus.cc:2393] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:51.088826 17292 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:51.098407 17365 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:51.087826 20576 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:51.099259 20576 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.101078 17283 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:50.958585 20474 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.042482 20575 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.104571 20265 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.105487 17292 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:51.108220 17362 raft_consensus.cc:2410] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:51.063781 20501 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.116341 20593 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.117229 20593 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:51.119616 20593 consensus_queue.cc:1059] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:51.120975 20592 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:51.121549 20592 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:51.122444 20592 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.123814 20592 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.109689 20478 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:51.136164 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 201271us
I20260709 12:10:51.138530 20593 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:51.139241 20501 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:51.140933 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:51.141793 20593 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:51.142385 20593 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:51.143354 20593 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:51.147693 20559 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.981s	user 0.007s	sys 0.005s
I20260709 12:10:51.149715 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.151037 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.151430 17364 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:51.152199 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.153460 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.147971 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.148957 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2495) took 1292 ms. Trace:
I20260709 12:10:51.171454 20474 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.172384 20474 consensus_queue.cc:1059] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:51.173362 20474 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:51.175851 20575 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:51.177686 20581 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:10:51.181646 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:51.181799 20312 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.186743 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.182320 20316 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.183502 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.187497 17367 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:51.187400 20316 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.184599 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.185453 20503 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.185994 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.189659 20316 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.187125 20312 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.192220 20571 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.192919 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1635) took 1556 ms. Trace:
I20260709 12:10:51.193316 17434 rpcz_store.cc:276] 0709 12:10:49.636700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.858617 (+221917us) service_pool.cc:224] Handling call
0709 12:10:50.616132 (+757515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.630552 (+ 14420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.192735 (+562183us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54000ff350. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:51.192862 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680983424}
I20260709 12:10:51.189280 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.195888 17366 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:51.185469 20499 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:51.197358 20499 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:51.198205 20499 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.199360 20499 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.161295 17358 rpcz_store.cc:276] 0709 12:10:49.856922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.034827 (+177905us) service_pool.cc:224] Handling call
0709 12:10:51.148760 (+1113933us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002dfd54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:51.148896 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376332032}
I20260709 12:10:51.202811 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.203491 17362 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:51.214120 17255 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:51.225746 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.229220 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.174052 20474 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:51.192282 20312 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.193984 20556 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.220407 20560 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.206296 20313 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.250490 20313 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.253448 20313 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.228832 20478 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.166550 20573 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.236972 19964 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.234965 20474 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:51.224109 20575 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:51.259979 20478 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:51.257033 20576 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.256484 20574 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.278995 20571 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.269537 20546 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.288333 20574 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.276338 20478 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.275197 20556 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:51.298570 20556 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:51.299448 20556 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.300660 20556 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:51.321974 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 174064us
I20260709 12:10:49.735136 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:51.328596 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.339879 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.341987 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.348438 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.349653 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.350873 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.352694 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.317921 20542 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:51.356431 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.356496 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:51.358584 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.338649 20591 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:10:51.319509 20523 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.365270 17434 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:51.360618 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.361294 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.315616 20532 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.362203 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:51.363323 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:51.366020 17439 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.335075 20477 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.389561 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:51.392884 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:51.397197 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:51.398139 18010 raft_consensus.cc:2410] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:51.399487 18013 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:51.308918 20474 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.402325 20555 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:51.402832 20474 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.406464 20573 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.302938 20536 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.407150 20478 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.408610 20536 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.393729 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:51.413244 18006 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:10:51.414402 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.415066 17286 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:10:51.415092 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.415702 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.419584 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.420599 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.422221 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.422814 17437 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:51.426884 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.427759 17433 raft_consensus.cc:2410] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:51.429536 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.427405 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.431815 17438 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:51.432672 17432 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:51.409721 17363 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
W20260709 12:10:51.440507 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.447163 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.447587 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:51.448365 18009 raft_consensus.cc:2393] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:51.433636 17284 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.448549 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.449463 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.453208 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.435460 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.451040 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:51.410476 20546 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.459882 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.349320 20574 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:10:51.402869 20555 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:51.410691 20576 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.461617 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:51.429657 20449 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:51.469244 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.435529 17258 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.465027 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.465586 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.465862 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.470425 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.470922 17358 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.466332 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.463496 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.471764 17366 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:51.467073 17359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2497) took 1609 ms (client timeout 2086 ms). Trace:
I20260709 12:10:51.453986 18008 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:51.469096 18010 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:51.472659 17283 raft_consensus.cc:2410] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:51.473171 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:51.469861 17438 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.475006 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.466594 17432 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.479270 17437 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:51.481014 17289 raft_consensus.cc:2410] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:51.450615 20431 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.482707 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.428133 20536 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.485852 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.494515 17364 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.412189 20532 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.409585 20542 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:51.472198 17359 rpcz_store.cc:269] 0709 12:10:49.857456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.982692 (+125236us) service_pool.cc:224] Handling call
0709 12:10:51.466888 (+1484196us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54003c4e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:51.467009 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586019712}
I20260709 12:10:51.489468 17367 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.446879 19964 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:10:51.493889 20431 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.484661 20592 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:51.484228 20449 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:51.510252 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 761) took 1543 ms. Trace:
I20260709 12:10:51.525830 17364 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:51.525729 18015 rpcz_store.cc:276] 0709 12:10:49.966416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.351703 (+385287us) service_pool.cc:224] Handling call
0709 12:10:50.366639 (+ 14936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.478191 (+111552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.509967 (+1031776us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x7b5400595e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:51.510191 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169972096}
W20260709 12:10:51.535720 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.537434 20542 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:51.528080 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 53147.2us
I20260709 12:10:51.539460 20592 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:51.540473 20556 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.540840 20556 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:51.518283 20555 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.541720 20556 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.543675 17258 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.502899 20536 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.548584 20536 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.549180 20536 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.545949 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:51.509128 20570 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.931s	user 0.017s	sys 0.031s
I20260709 12:10:51.555559 18010 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:10:51.556069 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.509971 17366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3673757d03f243668794c10285c7d1ff"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:51.559471 17366 raft_consensus.cc:606] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:51.489424 20588 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.517709 20532 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:51.558358 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 107792us
I20260709 12:10:51.563309 17360 raft_consensus.cc:2410] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:51.531138 20474 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:51.559108 17332 connection.cc:256] RPC call timeout handler was delayed by -1.3295898970000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 12:10:51.555152 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 129029us
I20260709 12:10:51.571317 17367 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
W20260709 12:10:51.572551 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.572268 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:51.575867 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.572800 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 74327.8us
I20260709 12:10:51.571659 17981 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:51.578562 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.579672 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:51.580161 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.577665 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:51.580930 17255 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.587607 17255 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.587477 17981 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.588277 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.560362 20579 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.590358 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:51.590930 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.588105 20574 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.591636 20574 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.591769 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.591929 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.592535 17285 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:51.592715 17291 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:51.592556 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.592051 20574 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.593667 17283 raft_consensus.cc:2368] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8.
I20260709 12:10:51.594367 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.594983 17286 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.597193 17358 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:51.591075 20576 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.599380 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.599763 17367 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:51.601222 17255 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.603291 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.602370 17287 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:51.593200 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.605979 17284 raft_consensus.cc:2410] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:51.606787 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.573190 20542 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.572572 20546 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.611537 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.612893 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:51.618422 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:51.616079 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.617303 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.614820 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.619829 17287 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.587208 20560 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.588812 20548 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:51.624253 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.625017 17291 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:51.625113 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:51.625912 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 63541.7us
I20260709 12:10:51.627264 17364 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:51.619583 17286 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:51.605288 20474 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:51.608729 20477 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:51.629499 17363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1660) took 2326 ms (client timeout 2195 ms). Trace:
I20260709 12:10:51.631955 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.632442 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.629149 17255 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:51.633241 17980 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:51.616786 20573 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:51.632325 17363 rpcz_store.cc:269] 0709 12:10:49.299128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.467679 (+168551us) service_pool.cc:224] Handling call
0709 12:10:51.625546 (+2157867us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54002c7754. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:51.625654 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4444591488}
I20260709 12:10:51.635030 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.623963 20593 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.635115 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.636317 17980 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:51.622798 20499 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.622525 20594 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.636940 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.600203 20536 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:51.638820 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 51470.8us
I20260709 12:10:51.640832 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.609331 20597 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:10:51.588349 20449 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.639549 20462 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:51.642303 17290 raft_consensus.cc:2410] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:51.631428 20532 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.644480 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.630302 20555 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.633953 20579 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.624408 20523 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:51.639400 20313 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.636369 20575 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.647529 19964 raft_consensus.cc:2764] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:51.679481 20588 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.680500 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.681128 17434 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:51.636530 20463 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.629114 20487 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:51.624495 20546 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.651219 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:51.699908 17363 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:51.622219 20542 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.702442 20542 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:51.643016 20571 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.628042 20560 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:51.653901 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 957793us
W20260709 12:10:51.654752 17365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 516) took 1917 ms (client timeout 2230 ms). Trace:
I20260709 12:10:51.655264 20360 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.658316 20431 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.658964 17361 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:51.659389 20471 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:51.730468 20471 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.732712 20471 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:51.660243 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 478650us
I20260709 12:10:51.733661 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:51.735854 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:51.660732 20455 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.736606 20455 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:51.737017 20455 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:51.662257 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 91909.3us
I20260709 12:10:51.738575 17407 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:51.663532 18011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 760) took 1697 ms (client timeout 1991 ms). Trace:
W20260709 12:10:51.739240 18011 rpcz_store.cc:269] 0709 12:10:49.966077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.008426 (+ 42349us) service_pool.cc:224] Handling call
0709 12:10:51.663327 (+1654901us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54005d34d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:51.663459 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1928571648}
I20260709 12:10:51.664430 17440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:10:51.740437 17440 raft_consensus.cc:606] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:51.741685 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.742789 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.743328 17440 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:51.744405 17440 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:51.665190 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.665900 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:51.666618 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.748199 17433 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.667300 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.755489 17436 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:51.647998 20462 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:51.756295 17363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:51.757030 17363 raft_consensus.cc:606] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:51.757383 17363 raft_consensus.cc:614] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:51.667984 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.758222 17441 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 10: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:51.670224 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.758893 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.759122 17437 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:51.643905 20548 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.644719 20593 raft_consensus.cc:697] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:51.641137 20603 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.677362 20574 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.643626 20573 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:51.683714 17255 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.684705 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:51.685247 17438 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:51.688159 17287 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:10:51.703227 18010 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:10:51.686884 20313 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:51.706410 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.706840 20546 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.710522 20576 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.650174 20594 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:10:51.720039 17365 rpcz_store.cc:269] 0709 12:10:49.737225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.976099 (+238874us) service_pool.cc:224] Handling call
0709 12:10:51.654502 (+1678403us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003c4454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:51.654669 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2526088064}
W20260709 12:10:51.723932 17406 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.606s (SENT)
I20260709 12:10:51.772205 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:51.756421 20462 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:51.774303 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 129911us
I20260709 12:10:51.667662 20474 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:51.763424 17433 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
W20260709 12:10:51.764219 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 127328us
I20260709 12:10:51.691556 20555 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:51.768036 17434 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:10:51.769454 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 82487.8us
I20260709 12:10:51.776160 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.803177 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:51.765483 20459 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.795150 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.805475 17255 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.767673 20575 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.806638 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:51.771488 20317 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.806555 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.810552 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:51.813462 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:51.793598 20312 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.768724 20519 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:10:51.815311 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:51.805712 20459 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.808210 20548 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:51.822836 17363 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:10:51.823415 17363 pending_rounds.cc:85] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 5
I20260709 12:10:51.823673 17363 pending_rounds.cc:107] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:10:51.823884 17363 raft_consensus.cc:2889] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:51.812480 20431 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:51.809381 20546 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.830356 20523 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.835644 20574 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.837988 20560 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:51.838781 20573 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.825379 20593 consensus_queue.cc:237] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.843918 20478 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.811908 19964 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.812718 20317 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.842581 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:51.845916 20317 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.845642 20313 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.850744 20594 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:51.852586 20519 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:51.852756 20360 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.853164 20519 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.816362 20588 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.854301 20588 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:51.854681 20588 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.855362 20519 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.827205 20555 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.818250 20487 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:51.857067 20487 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:51.857957 20487 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.818043 20463 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.860410 20463 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:51.860816 20463 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.830025 20546 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:51.863116 20546 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.866622 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.829499 20431 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:51.867794 20431 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.870223 20501 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:51.826498 20459 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.871563 20501 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:51.871928 20501 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:51.872717 20501 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.874832 20462 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:51.877151 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 61902.7us
I20260709 12:10:51.826081 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:51.879267 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 53282.5us
I20260709 12:10:51.880007 17360 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:51.880225 17981 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:51.884275 17981 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:51.885499 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 247016us
I20260709 12:10:51.886615 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:51.888808 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 253809us
I20260709 12:10:51.899397 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:51.909765 20317 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:51.912174 20317 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:51.913352 20607 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:51.994769 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:51.995642 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 271730us
W20260709 12:10:51.996328 17406 leader_election.cc:336] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.668s (SENT)
I20260709 12:10:51.996765 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:51.915933 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:51.922660 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 276300us
I20260709 12:10:51.927696 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1666) took 2479 ms. Trace:
I20260709 12:10:51.927198 17187 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 3 to 4, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 4 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.942680 20575 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:51.999179 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 83320.5us
I20260709 12:10:51.944064 20477 raft_consensus.cc:3055] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.000988 20477 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:51.874032 20501 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.004606 17980 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:52.005836 20542 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:51.887398 20603 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.890542 20548 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.891076 20555 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.007274 20555 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.007691 20555 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.009178 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:51.960623 17255 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:51.959283 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 183432us
W20260709 12:10:52.010478 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 49940.7us
I20260709 12:10:52.011273 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:52.012485 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:51.962226 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:51.920271 20574 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.919734 20597 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.970615 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.971881 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.972126 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.974017 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:51.975526 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:52.015193 17287 raft_consensus.cc:2376] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6. Re-sending same reply.
I20260709 12:10:51.998932 17361 rpcz_store.cc:276] 0709 12:10:49.447879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.164316 (+716437us) service_pool.cc:224] Handling call
0709 12:10:51.658762 (+1494446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.721496 (+ 62734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.927457 (+205961us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003c4450. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:51.927614 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3373249792}
I20260709 12:10:52.015974 20574 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:52.016571 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:52.017812 20597 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:52.018317 17291 raft_consensus.cc:2410] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:52.018393 20597 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.019119 17360 raft_consensus.cc:606] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:52.015422 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:52.020287 17438 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:52.020670 20597 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:52.021216 20597 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.022334 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:52.022701 17286 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:52.024063 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:52.016515 20574 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:52.025437 20597 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:52.024958 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:52.026463 17432 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:52.027011 20574 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:52.027539 20574 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:52.027760 20597 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:52.029021 20574 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:52.029381 20574 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:52.031448 17432 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:52.034053 17365 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.035020 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:52.035665 17363 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:52.032822 20574 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.037776 17363 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.009802 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:52.038223 20574 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.040110 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:52.041003 20548 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.010748 17406 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:52.042248 17363 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:52.042826 17980 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:52.029817 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:52.045703 18013 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.047905 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.048545 18006 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.046447 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.048949 17980 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:52.049352 18009 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.052369 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:52.053118 17286 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:52.053124 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:52.053967 20374 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.054564 20374 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:52.054726 17258 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:52.055083 20374 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.059968 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.060843 18007 raft_consensus.cc:2393] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:52.067322 17284 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:51.986785 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 216171us
I20260709 12:10:52.087756 18009 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:52.089435 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.092767 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:52.093883 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:52.096127 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:51.919080 20478 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:52.097586 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:52.098181 18007 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:10:52.099781 18008 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.100461 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.101178 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.113256 18015 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.965134 20536 raft_consensus.cc:697] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:52.103595 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:51.954528 20560 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:10:51.966274 20474 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 12:10:52.115797 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:52.116509 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 226332us
I20260709 12:10:52.085980 20532 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.115635 18011 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:52.123175 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:52.120445 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 233732us
I20260709 12:10:52.128921 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.129739 18008 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:52.137344 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:52.139765 17258 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:52.143195 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.107121 20317 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.161643 18015 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:10:52.164903 18015 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:52.128501 20532 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.163072 20487 raft_consensus.cc:993] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:10:52.252969 20611 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.293s
I20260709 12:10:52.253908 20616 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.254732 20610 raft_consensus.cc:2764] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:10:52.255378 20609 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 12:10:52.256275 20618 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.257071 20620 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:52.257658 20620 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.260032 20620 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:52.261508 20487 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:52.262564 20611 consensus_queue.cc:1059] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:52.263762 20487 raft_consensus.cc:1081] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:10:52.266342 20487 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:52.266752 20487 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:52.267923 20487 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.269296 20487 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.285403 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.188320 20532 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.300132 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:52.341632 18008 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:52.207253 20317 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.183091 20455 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.201473 20573 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.300648 20620 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:52.375116 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 252085us
W20260709 12:10:52.365823 20463 consensus_meta.cc:287] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.007s
I20260709 12:10:52.391280 17437 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.388378 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:52.395828 18008 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:52.402861 17432 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:52.404508 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:52.407188 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:52.408161 17367 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:52.408815 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.409298 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.415478 17437 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:10:52.416932 17363 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:52.375978 20542 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:52.417899 17404 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:52.450888 17440 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:52.379118 20620 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.444495 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:52.453490 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:52.459683 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:52.460292 17432 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:52.461390 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:52.461970 17432 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:52.387251 20556 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.465698 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:52.466460 17438 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:52.335157 20536 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:52.482237 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 61756.4us
I20260709 12:10:52.452508 20622 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.475803 20620 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.539757 18006 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:10:52.417557 20463 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.382663 20573 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.484630 20360 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.550132 20593 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:52.551151 20628 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:52.591504 17440 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:52.593421 18009 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:52.596189 20607 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.596771 20607 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.598436 20576 raft_consensus.cc:3055] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.598857 20576 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:52.599509 20463 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:52.599762 20630 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.600457 20626 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:52.600314 20630 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:52.601819 20631 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:10:52.545491 20638 consensus_queue.cc:1059] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:10:52.603502 20638 raft_consensus.cc:3055] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:52.603850 20638 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:52.604671 20638 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:52.606920 20431 consensus_meta.cc:287] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.003s
W20260709 12:10:52.540611 20612 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
W20260709 12:10:52.537674 20571 consensus_meta.cc:287] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.001s
I20260709 12:10:52.608194 20571 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.608877 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 544) took 1433 ms. Trace:
W20260709 12:10:52.553845 20459 consensus_meta.cc:287] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.683s	user 0.002s	sys 0.005s
I20260709 12:10:52.564545 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:52.468811 20542 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:52.581987 20613 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 12:10:52.486218 20623 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:10:52.582482 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:52.584635 17432 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:52.658917 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:52.467646 20555 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.586118 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:52.606787 20455 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:52.607658 20614 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:10:52.438468 20499 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 12:10:52.622478 17367 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:52.571544 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:52.688683 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:52.605927 20638 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.579742 20487 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.578809 20622 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:52.664017 20555 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:52.666415 18012 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.609287 17435 rpcz_store.cc:276] 0709 12:10:51.175961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.185101 (+  9140us) service_pool.cc:224] Handling call
0709 12:10:51.185456 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.655933 (+470477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.655963 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.656459 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:10:51.824119 (+167660us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:51.824157 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.824219 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.608654 (+784435us) raft_consensus.cc:1685] finished
0709 12:10:52.608677 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.608818 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":470112,"raft.queue_time_us":472521,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":167364,"threads_started":1,"wal-append.queue_time_us":428490}
I20260709 12:10:52.587049 20360 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.669540 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:52.670454 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:52.688675 18011 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:52.707213 17440 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:52.699007 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:52.668628 20615 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.691298 20630 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:52.636744 20572 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:10:52.639074 20459 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:52.635393 20593 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:52.715212 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 44866us
W20260709 12:10:52.763933 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 188614us
W20260709 12:10:52.766652 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 56547.9us
W20260709 12:10:52.767154 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 68266.9us
I20260709 12:10:52.639928 20431 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.796458 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1555) took 1410 ms. Trace:
W20260709 12:10:52.701180 20637 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.079s	user 0.001s	sys 0.001s
I20260709 12:10:52.599699 20576 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.798882 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:52.800359 17981 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:52.801882 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:52.804335 20501 consensus_meta.cc:287] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.802s	user 0.010s	sys 0.000s
I20260709 12:10:52.820230 17435 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:52.820816 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:52.804534 20619 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 12:10:52.801887 20374 consensus_meta.cc:287] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.001s
I20260709 12:10:52.800339 17439 rpcz_store.cc:276] 0709 12:10:51.386187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.386373 (+   186us) service_pool.cc:224] Handling call
0709 12:10:51.386698 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.662006 (+275308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.662043 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.665353 (+  3310us) log.cc:844] Serialized 26 byte log entry
0709 12:10:51.957917 (+292564us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:51.957959 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.958026 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.796204 (+838178us) raft_consensus.cc:1685] finished
0709 12:10:52.796226 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.796385 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":243518,"raft.queue_time_us":245583,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"thread_start_us":292145,"threads_started":1,"wal-append.queue_time_us":444260}
W20260709 12:10:52.717376 20594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.000s	sys 0.016s
I20260709 12:10:52.714274 20360 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.818128 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:52.707649 20471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.005s	sys 0.006s
I20260709 12:10:52.821801 17333 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:52.824725 20459 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:52.824879 20576 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.827957 20655 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.772964 20555 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:52.834674 20655 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.704089 20487 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.835109 20655 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.835862 20317 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.836941 17432 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:52.828167 20471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.005s	sys 0.024s
I20260709 12:10:52.828603 20449 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.837577 20555 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:52.828855 20503 raft_consensus.cc:993] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:10:52.837875 20477 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.838912 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:52.838652 20555 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.829775 17435 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:52.831847 20645 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 12:10:52.832154 20374 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.773149 20313 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:10:52.834162 20431 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:52.838474 20503 raft_consensus.cc:1081] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:10:52.840510 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:52.828644 20124 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:52.829310 20649 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.843047 17407 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:52.703619 20622 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.765990 20648 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:52.714825 20610 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.768955 20621 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:52.848937 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:52.849227 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:52.826784 20594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.001s	sys 0.032s
I20260709 12:10:52.834435 20629 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:52.855525 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:52.857899 17406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.008s	sys 0.012s
W20260709 12:10:52.879243 17406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.008s	sys 0.012s
W20260709 12:10:52.825289 20575 consensus_queue.cc:1175] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e860f7e876b74ec589f447737822a4f6" responder_term: 7 status { last_received { term: 5 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:52.837008 20487 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:52.860878 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:52.862023 17333 leader_election.cc:336] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.684s (SENT)
I20260709 12:10:52.847971 20449 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:10:52.891832 17362 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:52.865944 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:52.892901 18014 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:52.872606 18008 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.874292 18011 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:52.898254 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:52.899191 17361 raft_consensus.cc:2368] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
I20260709 12:10:52.803547 20615 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.853639 20477 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.875093 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.864519 20431 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:52.879357 18006 raft_consensus.cc:2368] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
W20260709 12:10:52.879809 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 869049us
W20260709 12:10:52.855471 17332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.007s	sys 0.013s
I20260709 12:10:52.854458 20616 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:52.886926 18015 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:52.953456 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:52.887401 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:52.954285 17332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.014s	sys 0.020s
I20260709 12:10:52.887933 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:52.874519 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 56501.4us
W20260709 12:10:52.954972 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 816305us
I20260709 12:10:52.882789 20657 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.878207 20462 consensus_queue.cc:1059] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:10:52.956332 20616 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.855283 20607 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:52.957317 20658 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:52.958633 20616 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:52.961391 20594 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:52.962926 20594 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:52.965193 20374 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:52.878033 20603 raft_consensus.cc:3055] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:52.968336 20603 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:52.969310 20603 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.970549 20603 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.953364 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:52.904879 17364 raft_consensus.cc:1240] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:52.907080 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:52.973929 18009 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:52.909456 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:52.878425 20560 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:52.883975 20629 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:52.864473 18013 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.008s	sys 0.014s
W20260709 12:10:52.978725 18013 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.008s	sys 0.014s
I20260709 12:10:52.976070 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:52.978875 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 91559us
I20260709 12:10:52.974854 17366 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.979868 17359 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:52.867018 19964 consensus_queue.cc:1059] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 12:10:52.994865 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 82796.7us
I20260709 12:10:52.887156 20463 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:52.980175 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:52.891279 20649 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.982832 17359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48992
W20260709 12:10:52.924065 20523 consensus_meta.cc:287] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.093s	user 0.011s	sys 0.000s
I20260709 12:10:52.999989 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:53.002864 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:53.016223 17361 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
W20260709 12:10:52.981961 20532 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.000s
I20260709 12:10:53.004133 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.021298 20523 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.020443 20618 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:53.021174 20615 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:52.956513 20639 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.023030 17362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:53.080292 17362 raft_consensus.cc:606] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:53.080679 17362 raft_consensus.cc:614] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:53.017338 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 140647us
I20260709 12:10:53.071076 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:53.082365 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:53.016299 17435 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:52.994585 20629 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.043346 17404 leader_election.cc:400] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
I20260709 12:10:53.076228 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:52.997164 20503 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.997272 20463 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.083961 17360 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.118626 17435 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:10:53.084219 17406 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.085731 20317 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:53.086861 18014 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:53.087226 20535 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:53.003212 20499 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:53.086993 20501 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.093585 17404 leader_election.cc:403] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.884477 20610 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.099208 17366 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:53.075416 20471 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
W20260709 12:10:53.174134 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 178277us
I20260709 12:10:53.098831 20431 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.091773 17407 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:53.079809 20588 consensus_meta.cc:287] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.225s	user 0.002s	sys 0.009s
I20260709 12:10:53.100284 20503 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:53.116943 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:10:53.093868 20546 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.221s	user 0.011s	sys 0.001s
W20260709 12:10:53.043495 20574 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.002s	user 0.012s	sys 0.000s
I20260709 12:10:53.119005 17435 pending_rounds.cc:85] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 9
I20260709 12:10:53.080109 20639 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.123222 17359 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:52.878242 20648 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.193774 17359 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.017267 20542 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:53.143294 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.195989 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.081596 18013 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:10:53.152385 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 196577us
W20260709 12:10:53.170512 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 86359.5us
I20260709 12:10:53.198522 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:53.091187 20523 raft_consensus.cc:3055] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.070621 20532 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:52.997254 20619 consensus_queue.cc:1059] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 12:10:53.185168 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 93510.2us
I20260709 12:10:53.185760 17333 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:53.118402 20573 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:53.108347 20487 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.190589 17435 pending_rounds.cc:107] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:10:53.204376 17435 raft_consensus.cc:2889] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.177096 20499 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.203155 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.197266 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:53.181996 20317 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.186899 20503 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.182291 20593 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:53.194969 20459 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:53.191186 20535 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.209342 17332 leader_election.cc:400] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8.
I20260709 12:10:53.215188 17332 leader_election.cc:403] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:53.196214 20639 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.219574 17332 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:53.193017 20560 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.206763 20523 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.227986 18010 raft_consensus.cc:2368] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7.
I20260709 12:10:53.224476 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.207267 20501 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.187386 20588 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:53.230036 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 44345.6us
I20260709 12:10:53.191032 20546 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.209594 20487 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:53.214597 20459 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:53.235436 17332 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:53.239969 20671 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:53.240456 20636 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.242906 20499 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.243644 20571 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.244263 20672 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8.
I20260709 12:10:53.247392 20532 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:53.281551 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:53.282503 18015 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:53.226089 20317 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:53.234072 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.202455 20471 consensus_queue.cc:1059] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 12:10:53.268362 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.229257 20650 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
W20260709 12:10:53.294212 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 60216.5us
I20260709 12:10:53.295056 17406 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.296305 17406 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.280473 20459 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.252017 20487 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.280283 20560 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.290709 18009 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:10:53.292359 18015 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:53.234853 20619 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.299401 20546 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.301079 18014 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:53.302464 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.209447 20463 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.229622 20535 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:53.303946 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1662) took 1281 ms. Trace:
I20260709 12:10:53.267455 20571 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.324111 17437 rpcz_store.cc:276] 0709 12:10:52.022489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.023828 (+  1339us) service_pool.cc:224] Handling call
0709 12:10:53.303734 (+1279906us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400115154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:53.303875 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843062656}
I20260709 12:10:53.321586 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:53.327320 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 91954.3us
I20260709 12:10:53.329197 17332 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:53.330979 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:53.331790 17364 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:53.333518 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 101761us
I20260709 12:10:53.318357 20316 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.320273 20636 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.318400 20501 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:53.348356 17332 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:53.331955 20459 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.320730 20317 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:53.235004 20431 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.327796 20648 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:53.339780 17359 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.332942 20462 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.326850 20571 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.338637 20463 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:53.344329 20655 consensus_meta.cc:287] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.005s
I20260709 12:10:53.338335 20471 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.344512 20650 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.363899 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:53.300207 20523 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.368156 20471 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:53.376570 20656 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:10:53.357749 20501 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:53.381258 20589 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:53.388522 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 86145.3us
I20260709 12:10:53.389863 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.391472 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.396409 20317 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.397331 20650 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.399537 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:53.403786 20665 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:53.403916 20501 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.405930 20661 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:53.367700 20655 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.381767 20611 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.423295 17365 raft_consensus.cc:2368] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9.
W20260709 12:10:53.425601 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 228389us
I20260709 12:10:53.427022 20688 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.427551 20688 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:53.426719 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 78445.6us
I20260709 12:10:53.429737 20688 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.435402 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:53.440024 20608 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.283s	user 0.029s	sys 0.068s
W20260709 12:10:53.440502 20608 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.437s	user 0.029s	sys 0.068s
I20260709 12:10:53.408408 20316 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:53.392310 20610 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:53.411963 20556 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.937s	user 0.010s	sys 0.002s
I20260709 12:10:53.423013 20661 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.396462 20589 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:53.451745 20620 consensus_meta.cc:287] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.841s	user 0.011s	sys 0.000s
I20260709 12:10:53.447655 20477 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:53.446257 20588 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.472406 17285 raft_consensus.cc:2410] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:10:53.473049 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.473706 20474 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.482765 20474 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.486959 20655 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:53.488884 20576 consensus_meta.cc:287] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.647s	user 0.004s	sys 0.004s
I20260709 12:10:53.479403 20471 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:53.500381 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:53.501107 18014 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:53.480605 20312 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.502285 20312 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:53.475718 20661 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.503177 20312 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.504495 20312 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.493499 20487 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.468164 20620 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.472966 20477 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.522197 20471 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.532274 20471 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.533905 20487 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:53.535250 17364 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:53.531051 20589 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:53.537220 20622 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.001s
I20260709 12:10:53.538467 20477 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:53.539022 20681 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:10:53.539932 20629 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.543349 17363 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:53.553679 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.554349 17435 raft_consensus.cc:2376] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10. Re-sending same reply.
I20260709 12:10:53.556816 18006 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.563416 20619 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:53.342398 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:53.552704 20360 consensus_meta.cc:287] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.001s
I20260709 12:10:53.500161 20503 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:53.587285 17358 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.587978 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 553) took 1181 ms. Trace:
I20260709 12:10:53.588106 20503 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:53.588364 17358 rpcz_store.cc:276] 0709 12:10:52.406748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.406864 (+   116us) service_pool.cc:224] Handling call
0709 12:10:53.586934 (+1180070us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6eee 000000000036eb39 00007f122aa6a1e0 00007f122ab330c4 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:53.587110 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.587723 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.587915 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4832256}
I20260709 12:10:53.542060 20629 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.581624 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.590406 17435 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.590757 20471 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:53.591506 20474 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:53.592339 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:53.595278 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:53.595938 18013 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:53.581696 20620 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:53.592540 20644 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.782s	user 0.001s	sys 0.007s
I20260709 12:10:53.537719 20622 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.598507 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1655) took 1585 ms. Trace:
I20260709 12:10:53.598778 17441 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.599901 20622 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:53.600889 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:53.601291 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:53.601593 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2487) took 1628 ms (client timeout 1906 ms). Trace:
I20260709 12:10:53.599960 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 560) took 1193 ms. Trace:
I20260709 12:10:53.601934 20360 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.569499 20661 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:53.584522 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:53.604542 20546 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:53.604764 17367 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.605114 20546 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.603875 20621 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.602344 17441 rpcz_store.cc:276] 0709 12:10:52.406271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.430251 (+ 23980us) service_pool.cc:224] Handling call
0709 12:10:52.430607 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.599235 (+1168628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.599757 (+   522us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001a09d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:53.599904 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686097280}
I20260709 12:10:53.606433 20621 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:53.606814 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:53.607016 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.607421 17358 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:53.607339 20621 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.608345 17441 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.598872 17433 rpcz_store.cc:276] 0709 12:10:52.012599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.012709 (+   110us) service_pool.cc:224] Handling call
0709 12:10:52.013013 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:52.013413 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:52.194668 (+181255us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.638171 (+443503us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.657649 (+ 19478us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.657805 (+   156us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:52.657841 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.657909 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.665902 (+  7993us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4800160158. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:10:53.477679 (+811777us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b18000a4140. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e522 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
0709 12:10:53.552918 (+ 75239us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:53.598306 (+ 45388us) raft_consensus.cc:1685] finished
0709 12:10:53.598326 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.598448 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":372851,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":322302,"raft.run_cpu_time_us":6064,"raft.run_wall_time_us":346659,"spinlock_wait_cycles":123105664,"thread_start_us":518578,"threads_started":2,"wal-append.queue_time_us":524649}
I20260709 12:10:53.614351 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:53.614500 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:53.615154 18013 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:53.601962 17285 rpcz_store.cc:269] 0709 12:10:51.973076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.973768 (+   692us) service_pool.cc:224] Handling call
0709 12:10:53.601400 (+1627632us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54001c0a54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:53.601538 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3346761088}
I20260709 12:10:53.604198 20360 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:53.603392 20641 log.cc:927] Time spent T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.793s	user 0.002s	sys 0.000s
I20260709 12:10:53.626901 17435 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:53.632284 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 735) took 1573 ms. Trace:
I20260709 12:10:53.632697 18012 rpcz_store.cc:276] 0709 12:10:52.059335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.059454 (+   119us) service_pool.cc:224] Handling call
0709 12:10:52.059755 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.704006 (+644251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.632045 (+928039us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54002611d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:53.632223 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394692480}
I20260709 12:10:53.634260 17367 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:53.656993 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:53.649187 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:53.604348 20661 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.620520 20474 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.667214 17441 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:10:53.668941 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:53.629443 20546 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.656817 20594 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.621294 20560 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:10:53.692612 20660 raft_consensus.cc:3055] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.704304 20660 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.705327 20660 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.606388 20571 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.602118 20639 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.673657 20360 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.712695 18006 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:53.698638 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.701853 17367 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:53.712600 17439 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:53.658578 20548 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:53.662747 20621 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.703821 20623 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:53.699216 20657 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:53.695452 17981 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:53.696760 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1659) took 1683 ms. Trace:
I20260709 12:10:53.708739 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:53.672431 18013 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:53.710155 17333 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:53.715315 17978 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:53.716341 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:53.673120 20474 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.720249 17367 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:53.721340 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:53.722491 20639 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:53.723448 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.723248 20603 consensus_queue.cc:1059] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:53.725399 20571 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.726181 20532 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.707358 20594 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.706558 20660 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.726616 20532 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.727090 20532 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.725131 20548 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.726083 17362 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:53.721930 17367 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:53.731377 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:53.706563 20463 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:53.717686 20691 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:10:53.738245 20548 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.744169 20463 raft_consensus.cc:697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.745260 20463 consensus_queue.cc:237] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.718500 20360 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:53.749500 20360 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:53.750217 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.719590 17436 rpcz_store.cc:276] 0709 12:10:52.013721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.015113 (+  1392us) service_pool.cc:224] Handling call
0709 12:10:52.015382 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.015603 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:52.365654 (+350051us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.675538 (+1309884us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b18003ecfe0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12256c34bc 00007f1222a1148b 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb23a
0709 12:10:53.696376 (+ 20838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.696428 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:53.696475 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.696593 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.696704 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":926,"prepare.queue_time_us":429055,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":1079,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7588,"spinlock_wait_cycles":3567488,"thread_start_us":442400,"threads_started":2,"wal-append.queue_time_us":238980,"wal-append.run_cpu_time_us":968,"wal-append.run_wall_time_us":1001107}
W20260709 12:10:53.750630 20632 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.220s	user 0.001s	sys 0.006s
I20260709 12:10:53.717223 20546 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.754246 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:53.718798 20623 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:53.733752 20630 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:10:53.790367 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.733345 20636 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:53.808236 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.822999 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.823720 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:53.823927 17283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2488) took 1849 ms (client timeout 1726 ms). Trace:
W20260709 12:10:53.824362 17283 rpcz_store.cc:269] 0709 12:10:51.974778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.975280 (+   502us) service_pool.cc:224] Handling call
0709 12:10:53.788420 (+1813140us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003fa554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:53.823845 (+ 35425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760982912}
I20260709 12:10:53.825327 20474 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.826382 17437 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.830854 17366 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:10:53.831318 17366 pending_rounds.cc:85] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:10:53.831537 17366 pending_rounds.cc:107] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:10:53.831769 17366 raft_consensus.cc:2889] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.838629 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.839450 17436 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:53.842665 20623 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.848340 17367 raft_consensus.cc:1240] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
W20260709 12:10:53.851580 20692 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:10:53.851632 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.853236 20630 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.853600 17436 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.854172 20630 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.854941 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:53.859084 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:53.859615 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:53.860574 18006 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:53.861567 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:53.862178 17441 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:53.862188 17434 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: [3.3-9.6]
W20260709 12:10:53.864253 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.864952 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:53.866973 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.867704 17441 raft_consensus.cc:2368] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9.
W20260709 12:10:53.872771 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.861605 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:53.873970 17433 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:53.895247 18007 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.895546 17436 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:53.897495 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 787) took 1032 ms. Trace:
I20260709 12:10:53.897866 18007 rpcz_store.cc:276] 0709 12:10:52.865331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.974184 (+108853us) service_pool.cc:224] Handling call
0709 12:10:53.895049 (+920865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.896435 (+  1386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.897298 (+   863us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400101dd0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:53.897427 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082463488}
I20260709 12:10:53.900254 17359 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.902689 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:53.903434 18013 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
W20260709 12:10:53.904812 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 184506us
I20260709 12:10:53.735267 20661 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:53.756068 20548 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.916205 18010 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 773) took 1901 ms (client timeout 1684 ms). Trace:
W20260709 12:10:53.916698 18010 rpcz_store.cc:269] 0709 12:10:52.014450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.045677 (+ 31227us) service_pool.cc:224] Handling call
0709 12:10:53.874278 (+1828601us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400101dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:53.916110 (+ 41832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546111744}
W20260709 12:10:53.838647 20689 log.cc:927] Time spent T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:10:53.924924 20548 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.925753 20640 consensus_queue.cc:1059] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:53.926038 20589 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:53.925189 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:53.948738 18010 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:53.947014 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:53.908660 20474 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:53.853142 20535 consensus_queue.cc:1059] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:10:53.926833 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:53.955801 17435 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:53.907876 20477 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.911300 20610 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.794488 20542 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:53.931672 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.931896 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 216662us
I20260709 12:10:53.938771 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:53.940065 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:53.968058 17285 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:53.969187 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:53.969951 20536 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.970176 20487 raft_consensus.cc:3055] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:53.970661 20487 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:53.971617 20487 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:53.967991 17287 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.977257 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.944164 17407 leader_election.cc:400] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
I20260709 12:10:53.945809 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:53.946365 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:53.946692 20648 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.947077 20556 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.949659 17284 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.997200 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 53217us
I20260709 12:10:53.997443 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 765) took 1141 ms. Trace:
I20260709 12:10:53.998786 17407 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:54.002638 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1691) took 1113 ms. Trace:
I20260709 12:10:54.003110 17363 rpcz_store.cc:276] 0709 12:10:52.888752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.888870 (+   118us) service_pool.cc:224] Handling call
0709 12:10:52.889174 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.543796 (+654622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.002305 (+458509us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54000f55d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:54.002547 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503827328}
I20260709 12:10:53.954136 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:53.957144 18011 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:53.908141 20579 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:53.961238 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:53.948540 20575 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:53.962077 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:53.963346 17290 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:53.964037 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:53.978528 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.978638 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2524) took 1093 ms. Trace:
I20260709 12:10:53.947793 20589 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.979948 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:53.980748 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:53.985343 17287 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:54.029292 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:54.025020 17360 rpcz_store.cc:276] 0709 12:10:52.884819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.884935 (+   116us) service_pool.cc:224] Handling call
0709 12:10:52.905539 (+ 20604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.118873 (+213334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.978404 (+859531us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400081e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:53.978568 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409893760}
I20260709 12:10:53.986559 20313 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.947023 20588 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.987480 20610 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.987855 20536 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:53.931553 20576 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.008209 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:54.016168 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 55020.5us
I20260709 12:10:54.037824 17434 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:54.038065 17333 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:54.016335 17407 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:54.023258 20657 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.005442 17980 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:54.018957 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.023176 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 45216.6us
I20260709 12:10:54.022567 17286 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:54.026259 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:54.027314 17439 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:54.030503 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:53.965518 20542 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:54.031888 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1568) took 1371 ms. Trace:
I20260709 12:10:54.033074 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:54.035226 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:53.959316 20474 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:53.997870 18008 rpcz_store.cc:276] 0709 12:10:52.856408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.856535 (+   127us) service_pool.cc:224] Handling call
0709 12:10:52.856813 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.899923 (+ 43110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.997202 (+1097279us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5400649e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:53.997380 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35876224}
I20260709 12:10:54.040940 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:54.053683 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:54.051887 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46536.1us
I20260709 12:10:53.989187 20477 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.042229 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:54.054292 17435 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:54.052119 17432 rpcz_store.cc:276] 0709 12:10:52.660397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.699004 (+ 38607us) service_pool.cc:224] Handling call
0709 12:10:52.699414 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.837385 (+137971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.028188 (+1190803us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000ff5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:54.031820 (+  3632us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315494144}
I20260709 12:10:54.056315 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:54.054332 17437 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.040740 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:54.053254 20636 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.079682 17434 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:54.022370 20556 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.058871 17439 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:54.022542 20648 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.037986 20697 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.078665 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:10:54.088176 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 47517.1us
I20260709 12:10:54.049700 20651 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.092350 17407 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:54.088652 17333 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:54.024325 20579 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.089272 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:54.034548 20575 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.117244 17437 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:54.041620 20576 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.037006 20313 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:54.049765 20668 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.082592 20609 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.131251 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:54.036731 20588 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.080607 20546 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:10:54.133522 20459 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.088383 20702 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.094041 20560 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:54.092284 20640 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.139247 17285 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:54.141196 18012 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:54.154753 17359 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:54.092851 20603 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:10:54.053566 20671 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:10:54.087108 20463 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:10:54.091845 20697 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.142143 20459 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.144630 20636 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.091769 20608 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:10:54.165654 20672 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.161806 20548 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.156131 20609 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:54.170491 20702 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.190726 20617 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.172399 20459 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.136641 20542 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.196441 20576 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:54.211445 17292 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:54.194227 20672 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.193958 20660 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.183311 20636 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:54.251070 17255 leader_election.cc:400] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9.
W20260709 12:10:54.219691 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.161732 20560 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.251583 17255 leader_election.cc:403] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:10:54.197531 20702 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:54.191418 20669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.010s	sys 0.017s
I20260709 12:10:54.250187 20672 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:54.259684 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 204568us
I20260709 12:10:54.237542 20474 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.279899 17980 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:54.249702 20660 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:54.249142 20589 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:54.250938 20576 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.280544 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 191954us
I20260709 12:10:54.288579 17284 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:54.276113 20542 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:54.276356 20669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.010s	sys 0.018s
I20260709 12:10:54.213024 20617 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.275820 20702 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.281258 20477 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.309326 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:54.287395 20474 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:54.304945 17333 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:54.300414 20589 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.279556 20696 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:10:54.331944 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:54.332823 17284 raft_consensus.cc:2410] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:54.317534 20503 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:54.314838 20575 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.319703 20477 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.299517 20576 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:54.350677 20700 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:10:54.351234 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:54.352322 20714 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.328459 20474 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.375140 20474 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.367482 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1696) took 1345 ms. Trace:
I20260709 12:10:54.376382 17361 rpcz_store.cc:276] 0709 12:10:53.022010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.025553 (+  3543us) service_pool.cc:224] Handling call
0709 12:10:53.057563 (+ 32010us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.233517 (+175954us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:53.279393 (+ 45876us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.892112 (+612719us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b180037bf40. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb23a 00007f1225b25a2a
0709 12:10:54.314757 (+422645us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.317762 (+  3005us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.317947 (+   185us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:54.317981 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.318053 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.357037 (+ 38984us) raft_consensus.cc:1685] finished
0709 12:10:54.367189 (+ 10152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.367397 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16750,"prepare.queue_time_us":32203,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":128751,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":15207,"spinlock_wait_cycles":12245888,"thread_start_us":572355,"threads_started":3,"wal-append.queue_time_us":996438}
I20260709 12:10:54.331092 20705 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.330824 20313 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:54.338557 20463 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.289907 20609 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:54.369253 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 116799us
I20260709 12:10:54.337170 20588 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.305935 20706 consensus_queue.cc:1059] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:10:54.385848 17363 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:54.338930 20709 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.331357 20589 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:54.392589 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 83348.6us
I20260709 12:10:54.318786 20636 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.399438 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:54.408679 17439 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:54.372502 20477 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.405908 20474 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.411877 20474 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.405694 20313 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:54.335616 20660 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.396188 20707 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:10:54.417109 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.392908 20463 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:54.422037 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:54.408977 20706 raft_consensus.cc:3055] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.404316 20709 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:54.397836 20648 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.382040 20459 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:54.418978 20704 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:10:54.440263 20722 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:54.441058 20713 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:54.403863 20714 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:10:54.416373 20474 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:54.435488 20701 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:10:54.413102 20477 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:54.474213 20617 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.475044 20487 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.475607 20576 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:54.446409 20575 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:54.478443 20575 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:54.479290 20575 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.480528 20575 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.446998 20313 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.482471 20313 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.482856 20313 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.485534 20714 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:54.486081 20714 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.486410 20623 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.487457 20589 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:54.488153 20714 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:54.438901 20706 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:54.443465 20660 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.447340 20560 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.446516 20722 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:54.510818 20709 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.510347 20657 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.515872 20705 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9.
I20260709 12:10:54.516950 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:54.517619 18006 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
W20260709 12:10:54.521795 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.522473 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.439348 20715 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 12:10:54.526736 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 104787us
I20260709 12:10:54.531464 20574 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:54.519212 20717 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:10:54.528154 20535 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.431968 20707 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.535408 20535 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.538899 20535 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.539875 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:54.540544 17287 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
W20260709 12:10:54.541913 20532 consensus_meta.cc:287] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.814s	user 0.012s	sys 0.006s
I20260709 12:10:54.537919 20707 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:54.508071 20722 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.547679 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:54.532781 17258 leader_election.cc:400] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9.
I20260709 12:10:54.550997 17258 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:54.557736 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:54.559147 20719 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:54.544548 20572 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.562741 20572 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.564477 20668 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:54.565008 20572 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:54.565183 20560 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.558386 17366 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:54.515892 20697 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:54.498006 20463 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.543097 20707 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.570035 20721 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 12:10:54.595901 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.595894 17366 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:54.598445 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:54.603103 17287 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:54.600257 17286 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:54.543983 20706 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.542378 20532 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.565048 20668 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.567523 20657 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:54.572634 20719 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:54.730648 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:54.625826 17364 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.571473 20560 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:54.632016 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.741072 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:54.684245 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.573469 20714 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:54.607770 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:54.606249 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:54.858870 17290 raft_consensus.cc:2410] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:10:54.734681 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:54.744781 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:54.861183 17291 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:54.861301 17287 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:54.862522 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:54.863660 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:54.798610 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.728945 20734 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 12:10:54.863807 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 464444us
I20260709 12:10:54.659711 17286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3673757d03f243668794c10285c7d1ff"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:10:54.875440 17286 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:54.864981 17287 raft_consensus.cc:2393] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:54.867244 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:54.875653 17288 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.876412 17286 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:54.877483 20724 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.880128 18014 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.883229 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:54.720077 20535 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:10:54.886456 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 98419.7us
I20260709 12:10:54.601563 20705 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.267s
I20260709 12:10:54.885701 17290 raft_consensus.cc:2410] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:54.743885 20719 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:54.859517 20709 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.574404 20313 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.887418 17362 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:54.733103 20697 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:54.853760 20728 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:54.885215 20519 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.729699 20718 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:54.855182 20661 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:54.865407 20623 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.681473 20572 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.206s
I20260709 12:10:54.744055 20715 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:54.895190 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:54.892195 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:54.878038 20724 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.625361 20730 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.292s
I20260709 12:10:54.926072 17291 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:54.894791 20719 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.607141 20707 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.966075 17290 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.879550 20714 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.966553 17288 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.975129 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:54.964847 17286 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.900820 20709 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.893362 20535 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.929996 20738 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:10:54.964668 20661 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:54.978793 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 90947.9us
W20260709 12:10:55.054443 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.119773 17287 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:54.912210 20697 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.978922 17291 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.053606 17255 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:55.127607 17286 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:55.060138 20731 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 12:10:54.989684 20733 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:10:55.117023 20622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.004s	sys 0.008s
I20260709 12:10:54.998829 20532 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:54.931982 20519 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.996426 20560 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:55.083845 20737 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:10:55.129316 20572 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.083544 20487 consensus_meta.cc:287] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.002s
W20260709 12:10:55.057582 20702 consensus_meta.cc:287] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.743s	user 0.007s	sys 0.004s
W20260709 12:10:55.129993 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 76477.8us
I20260709 12:10:55.135424 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:54.998823 20477 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.994797 20459 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:54.997923 20668 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.137543 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.139411 20532 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.139521 20714 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.141028 20535 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.142710 20697 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.144341 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.153836 17291 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:10:55.133273 20542 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.000s
I20260709 12:10:54.971797 20623 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:54.990373 20576 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.968247 20728 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.979163 20715 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:54.933275 20718 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.311892 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:55.319397 20735 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:10:55.195942 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:55.280058 20560 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.181588 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:55.320257 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 190519us
I20260709 12:10:55.261078 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.161180 20724 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:55.133204 20622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.005s	sys 0.009s
I20260709 12:10:55.327414 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.327735 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:55.328856 20519 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.329074 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:55.329521 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 364802us
I20260709 12:10:55.329900 17434 raft_consensus.cc:2410] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:55.330349 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:55.331074 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.331260 17291 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:55.131026 20705 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:55.341077 20707 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.325738 20477 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.323740 17441 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:10:55.211767 18013 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:10:55.327044 17255 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:55.325135 20718 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.344133 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:55.351058 18006 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:10:55.174445 20660 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.675s	user 0.000s	sys 0.011s
I20260709 12:10:55.367301 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:55.380861 17406 leader_election.cc:336] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.726s (SENT)
I20260709 12:10:55.381418 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:55.385586 17361 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:10:55.386061 17361 pending_rounds.cc:85] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 7
I20260709 12:10:55.386439 17361 pending_rounds.cc:107] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:10:55.386675 17361 raft_consensus.cc:2889] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:55.403859 17189 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55932 (request call id 327) took 22773 ms (client timeout 15000 ms). Trace:
I20260709 12:10:55.319797 20709 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.161511 20313 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.342551 20738 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:55.328893 20623 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.323251 20702 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.365326 20724 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:10:55.323400 20560 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.346395 20576 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:55.473027 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 317776us
I20260709 12:10:55.473235 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:55.431684 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 50862.6us
W20260709 12:10:55.473424 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 146673us
I20260709 12:10:55.460083 17288 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:10:55.483033 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:55.483829 17288 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:55.483112 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:55.485208 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.486073 17441 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:55.487728 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:55.487762 17981 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:55.364862 20705 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:55.366736 20742 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.491209 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:55.491914 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:55.326267 20715 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:55.495456 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 108988us
I20260709 12:10:55.378623 20459 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:55.469127 20745 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:10:55.512089 17187 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.512715 20749 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:10:55.514088 20459 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.515125 20728 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:55.516407 20459 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:55.511654 20730 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.505365 20742 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.517632 20730 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.518118 20730 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:55.521344 20736 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.667s	user 0.001s	sys 0.000s
I20260709 12:10:55.522089 20477 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.522773 20477 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.524132 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:55.525094 20719 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.348876 20572 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.526697 20651 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:55.527201 20651 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.528149 20572 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.530014 20702 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:55.532078 20576 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.469429 20622 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:55.502995 20542 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.533193 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 569) took 1614 ms. Trace:
I20260709 12:10:55.534691 20661 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.494627 20738 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.465463 20594 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.537114 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:55.540482 17289 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.537526 17438 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:55.511184 17290 consensus_meta.cc:287] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 12:10:55.533648 17432 rpcz_store.cc:276] 0709 12:10:53.918595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.059666 (+141071us) service_pool.cc:224] Handling call
0709 12:10:54.059973 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.060181 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:54.280421 (+220240us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.532742 (+1252321us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18002f5300. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12256c34bc 00007f1222a1148b 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287
0709 12:10:55.532838 (+    96us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.532886 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:55.532936 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.533002 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.533123 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":353821,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1593,"raft.queue_time_us":53838,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"spinlock_wait_cycles":4191616,"thread_start_us":328169,"threads_started":3,"wal-append.queue_time_us":136789}
I20260709 12:10:55.514411 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:55.456753 20519 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.533340 20542 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:55.534834 20672 consensus_meta.cc:287] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.248s	user 0.011s	sys 0.000s
I20260709 12:10:55.542526 17288 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:55.538950 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:55.541481 17290 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:55.366803 20532 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:55.404390 17189 rpcz_store.cc:269] 0709 12:10:32.630737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.662964 (+ 32227us) service_pool.cc:224] Handling call
0709 12:10:55.403740 (+22740776us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:47.903971 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:48.154819 (+250848us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:48.154869 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:10:48.154891 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:48.157707 (+  2816us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:48.157832 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:48.157883 (+    51us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:10:48.994156 (+836273us) tablet.cc:701] Row locks acquired
0709 12:10:48.994231 (+    75us) write_op.cc:260] PREPARE: finished
0709 12:10:48.994490 (+   259us) write_op.cc:270] Start()
0709 12:10:48.994667 (+   177us) write_op.cc:276] Timestamp: P: 1783599048994403 usec, L: 0
0709 12:10:48.994686 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:48.995514 (+   828us) log.cc:844] Serialized 7146 byte log entry
0709 12:10:49.567606 (+572092us) op_driver.cc:464] REPLICATION: finished
0709 12:10:49.690876 (+123270us) write_op.cc:301] APPLY: starting
0709 12:10:49.690976 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:49.691324 (+   348us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:49.691447 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:49.726400 (+ 34953us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:49.726824 (+   424us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:10:49.726871 (+    47us) write_op.cc:312] APPLY: finished
0709 12:10:49.727250 (+   379us) log.cc:844] Serialized 125 byte log entry
0709 12:10:49.727440 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:49.727603 (+   163us) write_op.cc:454] Released schema lock
0709 12:10:49.727672 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:49.728090 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:49.728117 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1050057,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":116475,"apply.run_cpu_time_us":4882,"apply.run_wall_time_us":37217,"num_ops":18,"prepare.queue_time_us":734292,"prepare.run_cpu_time_us":25225,"prepare.run_wall_time_us":1597164,"raft.queue_time_us":34414,"raft.run_cpu_time_us":5062,"raft.run_wall_time_us":103247,"replication_time_us":572722,"thread_start_us":931363,"threads_started":4,"wal-append.queue_time_us":474828,"wal-append.run_cpu_time_us":12489,"wal-append.run_wall_time_us":1350260}]]}
I20260709 12:10:55.533001 20730 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:55.547698 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 182730us
I20260709 12:10:55.549382 17187 catalog_manager.cc:5697] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 4, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 4 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.534008 20603 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.558238 17289 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:55.558785 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:55.562685 17290 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:10:55.563046 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:55.550768 20722 consensus_meta.cc:287] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.985s	user 0.011s	sys 0.000s
I20260709 12:10:55.494462 20718 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:10:55.565261 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:55.567629 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:55.568282 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:55.570914 17438 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:55.548245 20542 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.574038 18013 raft_consensus.cc:2393] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:55.576689 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:55.573187 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:55.587069 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:55.587559 18007 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:10:55.587786 17290 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:55.589145 17290 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:10:55.576885 20722 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.506484 20313 consensus_queue.cc:1059] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:10:55.591279 20560 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.594652 20753 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.547876 20519 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.563971 20622 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.590960 20313 raft_consensus.cc:3055] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:55.574543 17289 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.609047 17359 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:55.596627 17286 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:10:55.610267 17286 pending_rounds.cc:85] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 6
I20260709 12:10:55.610533 17286 pending_rounds.cc:107] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:10:55.610759 17286 raft_consensus.cc:2889] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:55.611258 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 119440us
I20260709 12:10:55.612367 17286 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:55.582845 17288 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.614429 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.615134 17363 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:55.564183 20603 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:55.603353 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.579244 17187 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 5 to 6, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 6 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.609555 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.612324 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:55.572856 20758 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:55.606487 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 102429us
I20260709 12:10:55.616678 17407 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:55.552124 20672 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.621587 17289 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:55.618441 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:55.620162 17286 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:55.616184 20560 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.614392 20751 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.623356 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.624913 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.629181 17289 raft_consensus.cc:1240] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:55.595248 20753 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.620574 17290 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:10:55.601977 20622 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:55.631476 17286 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:55.641446 17364 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:55.631842 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 69036.1us
I20260709 12:10:55.609019 20313 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:55.633150 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.618432 17358 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:10:55.640375 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.633051 20724 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:55.645308 17365 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:10:55.645481 20623 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.646334 17363 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:55.633666 20594 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.639619 20751 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.651393 20623 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.652288 20724 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.664888 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.620957 20576 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:55.630477 20760 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:55.665357 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.681667 18007 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:55.665402 17290 raft_consensus.cc:1240] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:55.665421 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.634400 20729 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:55.666846 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.629655 20758 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.651952 20603 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.670425 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.670822 17288 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:10:55.644795 20622 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.692824 20722 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.694379 17286 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:10:55.672917 17406 leader_election.cc:336] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.906s (SENT)
I20260709 12:10:55.695051 17406 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:55.695784 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:55.696475 17432 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.675455 20730 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.663362 20738 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:55.684993 20759 log.cc:927] Time spent T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:10:55.667095 20761 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:10:55.685853 17358 raft_consensus.cc:2410] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:55.687279 17290 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:55.635844 20560 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.666947 20765 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.670526 20594 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.717698 20622 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.681332 20724 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:55.696126 17406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.016s (SENT) [suppressed 15 similar messages]
I20260709 12:10:55.698403 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:55.722630 17363 raft_consensus.cc:3055] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:55.699645 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 81440.7us
I20260709 12:10:55.679565 20477 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.681623 20719 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.697746 20741 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.710613 20523 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.709003 20765 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:55.711846 20672 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.714469 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:55.738391 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.690615 20572 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:55.711206 20722 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.716284 20623 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:55.716848 20699 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.505s	user 0.003s	sys 0.003s
I20260709 12:10:55.698119 20744 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.718310 20594 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.690868 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:55.718833 20603 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.725235 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.769306 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.769927 17441 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:55.770749 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.726024 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.726914 17436 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:55.723018 17363 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:55.727252 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.726912 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.774067 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:55.774789 17290 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:10:55.775763 17437 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:55.772347 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.735560 17432 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:55.739015 17440 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:55.704982 20702 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.780589 20702 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.773891 17255 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:55.782783 20702 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:55.745576 17406 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:55.783685 17255 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:55.784565 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:55.785125 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:55.746459 17359 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:55.757107 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:55.694221 20313 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.758265 20757 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.788643 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.788916 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:55.768083 17365 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.778666 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:55.791589 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.792387 17433 raft_consensus.cc:2410] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:55.792740 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.691085 20729 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.779853 20719 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.780066 20672 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:55.754824 20741 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.737843 20765 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:55.786662 18011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 742) took 1928 ms (client timeout 2341 ms). Trace:
I20260709 12:10:55.787634 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:55.787598 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:55.996074 18011 rpcz_store.cc:269] 0709 12:10:53.858422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.859404 (+   982us) service_pool.cc:224] Handling call
0709 12:10:55.786511 (+1927107us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b54007157d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:55.786608 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222829312}
I20260709 12:10:55.757216 20622 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.790786 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:55.762748 17287 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:10:55.794387 20711 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.794694 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:56.004724 17358 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:55.793398 17434 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:10:55.779894 17363 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:56.005492 17363 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:55.816174 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:55.991019 20770 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.688329 20760 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:55.758397 20722 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.787740 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:55.996400 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 208832us
I20260709 12:10:55.789495 20477 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.991662 20741 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:56.034914 17437 raft_consensus.cc:2393] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:55.786039 20579 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:56.114352 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 84273.3us
I20260709 12:10:56.115830 17441 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
W20260709 12:10:56.119321 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 53611.9us
I20260709 12:10:55.797874 20702 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.794592 20774 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.995471 20576 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.801401 20753 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:55.992853 20623 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:56.006518 20571 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.116166 20621 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:56.253067 17439 raft_consensus.cc:2393] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:56.254180 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:56.248916 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.115935 20519 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:56.124872 20477 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:56.256808 20773 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:10:56.128193 20764 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.994988 20719 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:56.122277 20711 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.004741 20672 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.771615 20744 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:55.794889 20757 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.310092 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:56.318827 17434 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:56.252350 20702 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:56.251816 20621 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.132318 20770 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.315846 20766 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:56.306367 20711 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.273478 20477 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.328473 17288 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:56.251394 20622 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:10:56.252250 20571 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:56.363624 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:56.364275 17434 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:56.317582 20758 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:56.290580 20519 consensus_queue.cc:1059] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:10:56.252056 20576 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:56.331976 20621 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:56.362918 20651 consensus_meta.cc:287] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.001s
I20260709 12:10:56.455098 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 577) took 2518 ms. Trace:
I20260709 12:10:56.331121 20770 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.322404 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:56.461578 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 589) took 2501 ms (client timeout 1559 ms). Trace:
I20260709 12:10:56.464432 17283 rpcz_store.cc:276] 0709 12:10:53.936906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.940183 (+  3277us) service_pool.cc:224] Handling call
0709 12:10:53.940488 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.085184 (+144696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.085213 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.085252 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:54.085290 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.454845 (+2369555us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540043e4d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:56.454892 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.455029 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332222720}
W20260709 12:10:56.465407 17285 rpcz_store.cc:269] 0709 12:10:53.960054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.968919 (+  8865us) service_pool.cc:224] Handling call
0709 12:10:56.461344 (+2492425us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54002017d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:56.461496 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389602176}
I20260709 12:10:56.466137 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.466629 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.467310 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:56.373405 20693 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 2.473s	user 0.006s	sys 0.021s
I20260709 12:10:56.468076 17283 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:56.467355 17285 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:56.470007 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:56.471228 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:56.472853 17285 raft_consensus.cc:2376] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9. Re-sending same reply.
I20260709 12:10:56.473724 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.474828 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.475339 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:56.456892 20773 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:10:56.483249 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.476107 20478 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.456172 20560 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.370033 20639 consensus_queue.cc:1059] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 12:10:56.327659 20764 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:56.490482 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:56.492074 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 241408us
I20260709 12:10:56.360881 20766 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.472163 20651 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.523577 20757 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.529343 20770 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.532265 20766 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:56.495010 20478 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.516552 20729 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:56.562947 20571 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.564105 20760 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:56.492201 20702 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.541704 20722 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.583624 20672 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:56.603346 20610 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.608501 20719 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.607563 20744 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:56.611984 20724 consensus_meta.cc:287] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.875s	user 0.008s	sys 0.001s
I20260709 12:10:56.612702 20724 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.614442 20764 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.615682 20724 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:56.647699 17258 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.051s	sys 0.104s
W20260709 12:10:56.670818 17258 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.052s	sys 0.105s
W20260709 12:10:56.671579 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 712975us
W20260709 12:10:56.649827 17406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.016s
I20260709 12:10:56.675565 20719 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:56.678227 20719 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:56.675916 17406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.008s	sys 0.016s
I20260709 12:10:56.618782 20770 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:56.682853 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 551542us
W20260709 12:10:56.620164 20765 consensus_meta.cc:287] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.002s
I20260709 12:10:56.687455 20724 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:56.650226 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:56.691004 20651 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:56.659710 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 411185us
I20260709 12:10:56.693490 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:56.654666 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 154140us
I20260709 12:10:56.667290 20576 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:56.668620 20594 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.889s	user 0.005s	sys 0.005s
I20260709 12:10:56.675324 20478 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:56.697022 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:56.695878 20744 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:56.710676 20744 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.711127 20744 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.685425 20765 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.713910 20760 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.699378 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1708) took 1096 ms. Trace:
I20260709 12:10:56.702232 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:56.702426 20719 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:56.705137 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 571) took 1560 ms. Trace:
I20260709 12:10:56.708324 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:56.691066 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1720) took 1045 ms. Trace:
W20260709 12:10:56.663317 20523 consensus_meta.cc:287] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.001s
W20260709 12:10:56.695713 17287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2498) took 1543 ms (client timeout 2016 ms). Trace:
I20260709 12:10:56.714776 20760 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.716797 20765 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:56.720072 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:56.714847 17437 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:56.715123 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:56.717900 17406 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:10:56.727721 20542 consensus_meta.cc:287] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.126s	user 0.007s	sys 0.007s
I20260709 12:10:56.728092 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2540) took 2194 ms. Trace:
W20260709 12:10:56.750087 17438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 575) took 1603 ms (client timeout 2034 ms). Trace:
W20260709 12:10:56.750640 17438 rpcz_store.cc:269] 0709 12:10:55.146052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.146220 (+   168us) service_pool.cc:224] Handling call
0709 12:10:56.749632 (+1603412us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400037d54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:56.749854 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489839360}
I20260709 12:10:56.753358 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 748) took 2887 ms. Trace:
I20260709 12:10:56.753798 18014 rpcz_store.cc:276] 0709 12:10:53.865629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.865737 (+   108us) service_pool.cc:224] Handling call
0709 12:10:54.154978 (+289241us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:54.155161 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.887963 (+732802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.752776 (+1864813us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b540061add4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:56.753099 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671714560}
I20260709 12:10:56.755172 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:56.756208 17436 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:56.756490 20724 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:56.738363 17287 rpcz_store.cc:269] 0709 12:10:55.151822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.523879 (+372057us) service_pool.cc:224] Handling call
0709 12:10:56.695196 (+1171317us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54001b5b54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:56.695417 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488877440}
I20260709 12:10:56.743770 17360 rpcz_store.cc:276] 0709 12:10:54.533317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.533439 (+   122us) service_pool.cc:224] Handling call
0709 12:10:56.726717 (+2193278us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:10:56.727119 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.727551 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.727579 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.727636 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:56.727664 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.727719 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.727871 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2763648}
I20260709 12:10:56.702137 20594 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.737483 17358 rpcz_store.cc:276] 0709 12:10:55.645995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.504419 (+858424us) service_pool.cc:224] Handling call
0709 12:10:56.690908 (+186489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:56.734620 17361 rpcz_store.cc:276] 0709 12:10:55.144124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.321431 (+177307us) service_pool.cc:224] Handling call
0709 12:10:55.332295 (+ 10864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.387174 (+ 54879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.704559 (+1317385us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b54003c5854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:56.704941 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121588480}
I20260709 12:10:56.757479 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:56.715706 17364 rpcz_store.cc:276] 0709 12:10:55.602652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.602779 (+   127us) service_pool.cc:224] Handling call
0709 12:10:55.622362 (+ 19583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.645525 (+ 23163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.698694 (+1053169us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54003f0054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:56.699074 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43444480}
I20260709 12:10:56.762286 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:56.768208 17432 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:10:56.768904 17361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:56.769763 17361 raft_consensus.cc:606] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:10:56.770332 17361 raft_consensus.cc:614] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:56.770644 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49161.2us
I20260709 12:10:56.772220 17361 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:56.772513 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:56.773142 17441 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.757444 20542 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.786221 17441 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:56.798399 17366 raft_consensus.cc:2410] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:56.769654 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:56.810786 17367 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:56.795181 20548 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.823750 20608 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.791585 20532 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:56.794621 20536 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.797363 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1596) took 1009 ms. Trace:
W20260709 12:10:56.783670 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 1.86142e+06us
I20260709 12:10:56.783686 17434 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:56.790194 20696 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.795782 20556 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:56.774420 20594 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:56.798418 18015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 749) took 2923 ms (client timeout 2639 ms). Trace:
I20260709 12:10:56.797765 20621 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:56.830211 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:56.831182 17438 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:56.831569 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:56.829470 20707 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:56.833846 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 73854.6us
I20260709 12:10:56.832327 18006 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.836328 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1727) took 1120 ms. Trace:
I20260709 12:10:56.837062 17361 rpcz_store.cc:276] 0709 12:10:55.705686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.771274 (+1065588us) service_pool.cc:224] Handling call
0709 12:10:56.771752 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.813173 (+ 41421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.825591 (+ 12418us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:56.804392 20603 consensus_meta.cc:287] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.036s	user 0.012s	sys 0.005s
I20260709 12:10:56.826768 17439 rpcz_store.cc:276] 0709 12:10:55.788226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.788383 (+   157us) service_pool.cc:224] Handling call
0709 12:10:56.796943 (+1008560us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400270954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:56.797164 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039158528}
I20260709 12:10:56.832476 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:56.827183 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 69928.5us
I20260709 12:10:56.839847 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1715) took 1196 ms. Trace:
I20260709 12:10:56.833284 20532 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.842878 20532 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.846580 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:56.846764 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 90571.8us
I20260709 12:10:56.846972 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:56.840217 17367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 568) took 2296 ms (client timeout 1975 ms). Trace:
W20260709 12:10:56.805835 20732 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 2.072s	user 0.000s	sys 0.020s
I20260709 12:10:56.840567 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:10:56.845141 17980 connection.cc:256] RPC call timeout handler was delayed by -1.8786582570000974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 12:10:56.841246 17438 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:56.790084 20651 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:56.847888 17367 rpcz_store.cc:269] 0709 12:10:54.538244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.541593 (+  3349us) service_pool.cc:224] Handling call
0709 12:10:56.701671 (+2160078us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:56.834087 (+132416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5012864}
I20260709 12:10:56.841590 17366 rpcz_store.cc:276] 0709 12:10:55.637509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.719456 (+1081947us) service_pool.cc:224] Handling call
0709 12:10:56.834282 (+114826us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:56.829820 18015 rpcz_store.cc:269] 0709 12:10:53.874371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.894421 (+ 20050us) service_pool.cc:224] Handling call
0709 12:10:54.351037 (+456616us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b5800154b98. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:10:56.797916 (+2446879us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400101dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:56.798180 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383714304}
I20260709 12:10:56.854318 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:56.834575 20542 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.845029 20623 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.837983 20548 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.788126 20760 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:56.852471 17287 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:56.845664 20532 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:56.863915 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.865736 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:56.863965 17432 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
W20260709 12:10:56.862865 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 90488.6us
W20260709 12:10:56.872033 17440 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.000s	sys 0.008s
W20260709 12:10:56.872536 17440 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.000s	sys 0.008s
I20260709 12:10:56.876228 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:56.876510 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.877580 17287 raft_consensus.cc:2410] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:56.878710 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 580) took 1394 ms. Trace:
I20260709 12:10:56.879129 17435 rpcz_store.cc:276] 0709 12:10:55.484240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.487249 (+  3009us) service_pool.cc:224] Handling call
0709 12:10:55.489043 (+  1794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.502423 (+ 13380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.502454 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.505336 (+  2882us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.711881 (+1206545us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b180036d9c0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:10:56.790218 (+ 78337us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:56.791177 (+   959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.792993 (+  1816us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.878194 (+ 85201us) raft_consensus.cc:1685] finished
0709 12:10:56.878222 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.878503 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12923,"raft.queue_time_us":16201,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":61,"spinlock_wait_cycles":57416064,"thread_start_us":46894,"threads_started":1,"wal-append.queue_time_us":1366165}
I20260709 12:10:56.880244 20477 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:56.882668 17283 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:56.883805 20706 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.885197 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2515) took 1092 ms. Trace:
I20260709 12:10:56.850569 20696 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.824414 20711 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:56.878654 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.886492 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:56.885669 17283 rpcz_store.cc:276] 0709 12:10:55.793164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.475091 (+681927us) service_pool.cc:224] Handling call
0709 12:10:56.884927 (+409836us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54001b6054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:56.885111 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933851392}
I20260709 12:10:56.891403 17287 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:10:56.891635 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.892441 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.892658 17291 raft_consensus.cc:2410] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:56.893023 17287 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:56.893567 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:56.893913 20477 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.894950 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1730) took 1121 ms. Trace:
I20260709 12:10:56.888964 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.894093 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:56.895961 17287 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.824496 20608 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.895316 17360 rpcz_store.cc:276] 0709 12:10:55.773353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.838120 (+1064767us) service_pool.cc:224] Handling call
0709 12:10:56.855308 (+ 17188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.894568 (+ 39260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.894604 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.894644 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:56.894679 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.894733 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.894865 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:56.896800 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:56.868822 20651 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:10:56.898808 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.901244 17980 connection.cc:256] RPC call timeout handler was delayed by -1.6983486419999281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 12:10:56.905040 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.905965 17285 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:56.906810 20787 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:10:56.907893 18014 raft_consensus.cc:2410] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:56.908504 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:56.911127 20608 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:56.911459 17283 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:56.914307 17291 raft_consensus.cc:2376] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6. Re-sending same reply.
I20260709 12:10:56.914933 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:56.915416 20711 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.915614 20312 raft_consensus.cc:3055] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:56.916059 20312 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:56.916576 17438 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:56.904464 17437 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
W20260709 12:10:56.917491 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 65507.7us
I20260709 12:10:56.895900 20532 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.913259 20744 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:56.916158 17365 consensus_meta.cc:287] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.103s	user 0.001s	sys 0.017s
I20260709 12:10:56.933650 18012 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.930325 17441 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:56.933331 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:56.927140 17363 consensus_meta.cc:287] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.921s	user 0.015s	sys 0.004s
I20260709 12:10:56.956902 17287 raft_consensus.cc:2410] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:56.936437 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:56.934602 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:56.932950 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.934228 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.934221 17365 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:56.930255 20542 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:56.916909 20760 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:56.934970 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.966935 20431 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.932055 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:56.929683 20621 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:56.935571 20718 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.932660 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.966950 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.972389 18010 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:56.970249 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.971978 17363 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:10:56.958494 20608 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.978471 18014 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:56.976353 17332 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:56.980399 18013 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:10:56.984045 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1722) took 1311 ms. Trace:
I20260709 12:10:56.934872 20532 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.985214 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.967368 20312 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.972899 20603 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:56.984912 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1721) took 1332 ms. Trace:
I20260709 12:10:56.984462 17365 rpcz_store.cc:276] 0709 12:10:55.665858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.680692 (+ 14834us) service_pool.cc:224] Handling call
0709 12:10:56.972615 (+1291923us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:56.986129 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1729) took 1217 ms. Trace:
I20260709 12:10:56.974762 20718 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.935760 20536 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:10:56.926064 20696 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.989055 18011 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.979403 20542 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:56.990648 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1598) took 1061 ms. Trace:
I20260709 12:10:56.991719 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.989003 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1723) took 1319 ms. Trace:
I20260709 12:10:56.994031 18012 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:56.994663 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.995857 17441 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:10:56.996085 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 75880.1us
I20260709 12:10:56.997841 20688 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:56.998386 20688 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:56.998863 20688 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.998476 20760 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:56.999564 20487 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:57.001746 20571 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:57.002293 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.929373 20651 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.004226 18010 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.991612 20718 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.004719 20742 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:56.982070 20431 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.007068 20751 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:57.008337 20431 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:57.010649 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 76243.2us
I20260709 12:10:57.013278 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2492) took 1862 ms. Trace:
I20260709 12:10:57.014428 20555 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:57.016535 17435 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:57.017462 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 591) took 2663 ms. Trace:
I20260709 12:10:57.018263 17437 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
W20260709 12:10:57.018662 20767 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 1.282s	user 0.000s	sys 0.003s
W20260709 12:10:57.018788 20790 log.cc:927] Time spent T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:57.005827 18010 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:56.995193 17363 rpcz_store.cc:276] 0709 12:10:55.669582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.686307 (+ 16725us) service_pool.cc:224] Handling call
0709 12:10:56.986519 (+1300212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:56.993943 20711 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.017892 17284 rpcz_store.cc:276] 0709 12:10:54.354167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.354780 (+   613us) service_pool.cc:224] Handling call
0709 12:10:54.355210 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.375869 (+ 20659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.375902 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.375950 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:54.375984 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.017005 (+2641021us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b54001b0154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:10:57.017081 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.017257 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46986624}
I20260709 12:10:57.023459 18008 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:57.013329 20588 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:57.020319 20477 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:10:57.031234 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:56.989806 17364 rpcz_store.cc:276] 0709 12:10:55.767378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.802219 (+1034841us) service_pool.cc:224] Handling call
0709 12:10:56.802761 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.803272 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:56.862924 (+ 59652us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.965471 (+102547us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.971749 (+  6278us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.984484 (+ 12735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.984534 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:56.984581 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.984641 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.984758 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10015,"prepare.queue_time_us":127551,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":109,"thread_start_us":121219,"threads_started":2,"wal-append.queue_time_us":76157}
I20260709 12:10:56.990949 17358 rpcz_store.cc:276] 0709 12:10:55.648275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.768691 (+1120416us) service_pool.cc:224] Handling call
0709 12:10:56.769209 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.769644 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:56.855177 (+ 85533us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.976078 (+120901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.976131 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:56.980332 (+  4201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.980409 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.980536 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3629,"prepare.queue_time_us":139308,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":24182,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":27585,"thread_start_us":159311,"threads_started":2}
I20260709 12:10:57.035557 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:57.039130 18015 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.024513 20711 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:56.992237 20608 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.042189 20503 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:57.042265 20694 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.001798 20760 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.013787 17289 rpcz_store.cc:276] 0709 12:10:55.150411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.636026 (+485615us) service_pool.cc:224] Handling call
0709 12:10:56.461508 (+825482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.461727 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:56.476197 (+ 14470us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.864214 (+388017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.864326 (+   112us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:56.864476 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.864599 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.012920 (+148321us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54002017d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:57.013065 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17037,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":8972,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"spinlock_wait_cycles":1897687808,"thread_start_us":362153,"threads_started":1,"wal-append.queue_time_us":450922}
I20260709 12:10:56.994867 17433 rpcz_store.cc:276] 0709 12:10:55.835288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.835533 (+   245us) service_pool.cc:224] Handling call
0709 12:10:55.835904 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.836151 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.836177 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.836673 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.652651 (+815978us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:56.765505 (+112854us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.856169 (+ 90664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.863595 (+  7426us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.863638 (+    43us) raft_consensus.cc:1685] finished
0709 12:10:56.863650 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.897016 (+ 33366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7036,"prepare.queue_time_us":235440,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2072,"raft.queue_time_us":16753,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":12135,"thread_start_us":544461,"threads_started":2,"wal-append.queue_time_us":468928}
I20260709 12:10:57.048550 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.049333 18007 raft_consensus.cc:2410] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:57.047421 20503 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.053973 20694 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.057024 20313 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:57.061273 17288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2513) took 1268 ms (client timeout 1564 ms). Trace:
I20260709 12:10:57.062309 20431 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:57.062703 20778 raft_consensus.cc:3055] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:57.063449 17359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1716) took 1424 ms (client timeout 1822 ms). Trace:
W20260709 12:10:57.064013 17359 rpcz_store.cc:269] 0709 12:10:55.638579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.638862 (+   283us) service_pool.cc:224] Handling call
0709 12:10:57.062982 (+1424120us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b540040ced4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:57.063251 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125075840}
I20260709 12:10:57.054605 17437 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:10:57.061796 17288 rpcz_store.cc:269] 0709 12:10:55.792845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.128878 (+336033us) service_pool.cc:224] Handling call
0709 12:10:57.060872 (+931994us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b54002ce7d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:57.061064 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167877376}
I20260709 12:10:57.044828 20711 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.068288 18011 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:10:57.069310 20782 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.068905 20542 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.070631 18010 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:57.071089 20431 raft_consensus.cc:3055] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:57.054879 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2500) took 1902 ms. Trace:
I20260709 12:10:57.063346 20778 raft_consensus.cc:740] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:57.075794 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.072568 20764 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:10:57.073567 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.071471 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:57.078321 18008 raft_consensus.cc:2393] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:10:57.078080 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 141908us
I20260709 12:10:57.078800 20672 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.079478 20672 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.080586 20778 consensus_queue.cc:260] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.081267 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 798) took 1875 ms. Trace:
I20260709 12:10:57.081768 20778 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:57.079032 20782 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.081844 20672 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.083815 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.084393 20782 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.083269 20532 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.085094 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.085896 17433 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:57.084587 17435 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:57.081703 18009 rpcz_store.cc:276] 0709 12:10:55.206139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.206454 (+   315us) service_pool.cc:224] Handling call
0709 12:10:55.206799 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:55.411151 (+204352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.411185 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:55.478258 (+ 67073us) log.cc:844] Serialized 52 byte log entry
0709 12:10:55.627894 (+149636us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:55.704467 (+ 76573us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.721104 (+ 16637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.721221 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.017635 (+1296414us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:10:57.080808 (+ 63173us) raft_consensus.cc:1685] finished
0709 12:10:57.080908 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.081093 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16223,"prepare.queue_time_us":14932,"prepare.run_cpu_time_us":296,"prepare.run_wall_time_us":2624,"raft.queue_time_us":151757,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":33360,"spinlock_wait_cycles":3628416,"thread_start_us":375396,"threads_started":3,"wal-append.queue_time_us":179295}
I20260709 12:10:57.090831 17441 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.073813 17286 rpcz_store.cc:276] 0709 12:10:55.152308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.643775 (+491467us) service_pool.cc:224] Handling call
0709 12:10:55.694034 (+ 50259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.694715 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.054514 (+1359799us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b54001b6f50. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:57.054723 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114853760}
I20260709 12:10:57.092023 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.095471 20741 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:57.095396 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.097751 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:57.098316 18009 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:57.106882 20798 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:10:57.096236 18014 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:57.109512 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.075048 20431 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:57.111420 20431 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.111786 17980 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.113215 20431 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.114054 20672 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.114759 20672 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.116478 20766 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:57.116878 20766 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:57.117887 20766 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.118654 20523 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:57.119361 20766 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.119835 20694 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.119424 20523 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.122671 20523 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.124640 18006 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:10:57.125682 18007 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:57.128119 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.123512 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:57.132448 18008 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:57.136472 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:10:57.136720 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.101202 20744 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:57.143666 17358 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:57.143482 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.116899 20672 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.141263 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.138334 20782 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.151703 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.155227 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.158118 20503 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.158499 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.159117 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.162860 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.153976 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.159653 18012 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:10:57.132748 20536 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:57.164605 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.175956 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:10:57.176964 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 43799.2us
I20260709 12:10:57.177420 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.178212 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.179162 20579 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.179339 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.179769 20579 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.138913 20523 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.126008 20718 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.183760 17440 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:57.178174 17360 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.184854 17361 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:57.184528 20548 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.186158 18009 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:10:57.160246 20782 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.133294 20688 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.200556 17359 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:57.204509 18006 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.205158 17363 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:57.206774 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.205056 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.207894 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.208514 18008 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:57.182020 20579 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.210292 20536 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:57.210824 20805 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:57.215081 20608 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.216434 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.185456 20478 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.218580 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.224259 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.185465 20477 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.205942 20782 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.224409 17366 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:57.222695 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.226755 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.230788 20503 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.222204 20523 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:57.233256 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.235069 17436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:10:57.235709 17436 raft_consensus.cc:606] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:57.236076 17436 raft_consensus.cc:614] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:57.237129 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 125485us
I20260709 12:10:57.237524 17290 raft_consensus.cc:2410] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:57.238029 17980 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:10:57.238498 17362 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2544) took 2607 ms (client timeout 2179 ms). Trace:
I20260709 12:10:57.238783 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.239729 17363 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 4: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:57.240756 17980 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.233772 20523 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.225570 17359 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.245385 17365 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:57.246359 17362 rpcz_store.cc:269] 0709 12:10:54.631120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.632135 (+  1015us) service_pool.cc:224] Handling call
0709 12:10:57.238149 (+2606014us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54000be5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:57.238317 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68504832}
I20260709 12:10:57.247921 18015 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:10:57.186177 20711 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.211879 20548 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:57.229190 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.240770 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.254361 20546 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.255136 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.257345 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.258213 17433 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:57.258919 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.248755 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.263163 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.264645 17361 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:10:57.277529 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.286504 17439 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:10:57.253645 20809 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:57.228295 20696 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.258824 20718 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.290928 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:57.303428 17363 raft_consensus.cc:2393] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:57.303010 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.249114 20588 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.311400 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.320642 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:57.323398 17980 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.325824 20722 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:57.326411 20722 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:57.326855 20722 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:57.330286 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.331259 17358 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:57.291571 20546 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:57.338438 20711 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.339011 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.340867 20542 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.341336 20542 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:57.341740 20542 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.342260 17435 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:57.342718 20477 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.343688 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.344348 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.344514 17437 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:10:57.344934 17433 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:57.343992 17367 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:57.343634 20548 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.344026 20688 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.346298 20548 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.346742 20548 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.337625 20546 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.358637 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1632) took 2759 ms. Trace:
I20260709 12:10:57.358886 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:57.390467 17360 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:10:57.310446 20536 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.361937 20523 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.407627 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:57.409695 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 117303us
I20260709 12:10:57.361260 17292 rpcz_store.cc:276] 0709 12:10:54.599234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.599358 (+   124us) service_pool.cc:224] Handling call
0709 12:10:54.681054 (+ 81696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.681479 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:54.681506 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.728205 (+ 46699us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.108123 (+2379918us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b18003a58e0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:10:57.221500 (+113377us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:57.225734 (+  4234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.248554 (+ 22820us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.358192 (+109638us) raft_consensus.cc:1685] finished
0709 12:10:57.358216 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.358451 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126839,"raft.queue_time_us":38465,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":95,"spinlock_wait_cycles":16923520,"thread_start_us":59328,"threads_started":1,"wal-append.queue_time_us":2592884}
W20260709 12:10:57.414249 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 185166us
I20260709 12:10:57.415660 17981 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.421463 20312 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.426623 17255 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:57.428051 20477 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:57.428664 20477 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:57.428841 17255 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.429714 20477 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.431389 20478 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.439322 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.440339 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.442996 20782 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:57.450371 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 55975.5us
I20260709 12:10:57.451191 20782 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.451892 17980 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.452296 20588 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.452719 20588 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:57.413738 20608 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:57.456367 17359 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:10:57.459229 20718 raft_consensus.cc:2764] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:57.460044 20718 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:57.460944 20478 raft_consensus.cc:3055] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:57.461383 20478 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:57.460346 17258 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.462967 17255 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:57.410889 20523 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.464860 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.468057 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.468572 20743 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:57.469584 20718 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:57.458141 20608 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:57.470216 20657 consensus_queue.cc:1059] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:57.471946 17436 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:10:57.474732 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.476059 17978 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:57.476366 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.479177 17358 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:57.480839 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 65257.8us
I20260709 12:10:57.481647 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.480897 17360 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:57.458704 20588 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.482276 17366 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.483359 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:57.485867 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.488739 20728 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.489570 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.489439 20728 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.490895 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.491439 17362 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.491936 20728 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:57.492206 20523 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.492911 20743 consensus_queue.cc:1243] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer aaafaad0810b4e95983d2d73ec814346 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:57.493558 20636 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.493953 20636 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:57.494091 20702 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.494982 20636 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.487097 20696 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.496337 20636 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.465029 20536 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.505155 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.506858 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.480360 20608 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.510697 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.511034 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.512454 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.512924 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.513564 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.514394 17359 raft_consensus.cc:2410] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:57.515164 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.515318 17362 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:57.516033 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.516688 17360 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:10:57.517355 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 65568.7us
I20260709 12:10:57.520170 17359 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:57.520576 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.522264 17358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:57.523777 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.524359 17361 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:57.524682 20753 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.525079 20753 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:57.526036 20711 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.526512 20711 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:57.526847 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.500373 20579 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.527578 20579 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.527869 20750 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.527962 20579 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.528525 20730 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.511407 20546 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.529176 20702 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:57.529506 20546 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.497547 20718 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:57.531049 20718 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.532254 20757 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.532665 17407 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.502276 20536 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:57.533905 20536 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.529996 20546 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:57.530150 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 54196.2us
I20260709 12:10:57.539314 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:57.526747 17332 leader_election.cc:336] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.524s (SENT)
W20260709 12:10:57.527245 17290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2506) took 1736 ms (client timeout 1503 ms). Trace:
I20260709 12:10:57.540932 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.466363 20548 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.541549 17363 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:57.542361 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:57.540376 17290 rpcz_store.cc:269] 0709 12:10:55.790461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.790566 (+   105us) service_pool.cc:224] Handling call
0709 12:10:57.527031 (+1736465us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001b6a54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:57.527180 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2826909952}
I20260709 12:10:57.540624 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.538205 17358 raft_consensus.cc:606] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:57.546697 17358 raft_consensus.cc:614] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:57.543637 17407 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.526940 20711 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.552582 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:57.556183 17980 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.539587 20657 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.559980 17440 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.534569 20750 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.564559 17360 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:57.555179 20688 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 12:10:57.578604 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 65747.3us
I20260709 12:10:57.579911 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.565876 20657 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.568122 20750 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.569941 20688 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:57.584554 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.594430 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:57.586272 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.568109 20696 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.526062 20753 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.590243 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.591050 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.591733 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.600813 17438 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:57.592653 18006 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.593181 20706 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:57.586374 20657 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.508810 20478 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.587702 17404 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.616232 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:10:57.604357 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 77651.5us
I20260709 12:10:57.617054 18007 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:57.612167 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:57.612686 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.613332 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:57.614454 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:57.615360 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:57.619946 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.621737 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.572642 20523 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:57.626521 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.623544 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.628814 17365 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:57.595669 20688 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:57.633170 17981 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.594437 20503 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:57.599639 20696 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.632006 17255 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:57.638242 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.639918 18010 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:57.601438 20702 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.647483 20688 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.648860 20688 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.650596 20766 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:57.651218 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.651502 20532 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.651959 20532 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.652334 20532 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.654285 20743 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:57.654850 20548 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.654323 20753 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:57.651460 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 181376us
I20260709 12:10:57.663311 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.664564 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.666414 20778 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.632684 20623 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:10:57.667155 20778 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.634759 20542 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.672008 20542 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.673142 20750 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.674196 20722 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.672884 20743 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:57.666442 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 87004.7us
W20260709 12:10:57.662267 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 75398.9us
W20260709 12:10:57.675812 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 43917.5us
I20260709 12:10:57.651432 20478 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.720543 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.719544 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:57.724066 17440 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
W20260709 12:10:57.725337 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 49265.6us
I20260709 12:10:57.728993 17981 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.731420 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:57.726344 17980 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:57.731067 18015 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:10:57.732327 17360 raft_consensus.cc:606] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:57.733352 17360 raft_consensus.cc:614] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:57.689494 20766 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:57.717944 20672 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.721628 20571 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:10:57.737527 20766 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.739500 20722 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.740166 20722 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.740633 20722 raft_consensus.cc:697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:57.744896 17366 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:57.746501 17439 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:57.690310 20313 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:57.689942 20743 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:57.806918 20743 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.808347 20743 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.642860 20696 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.755515 17981 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.758822 17366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:10:57.811661 17366 raft_consensus.cc:606] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:10:57.812081 17366 raft_consensus.cc:614] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:57.759440 20571 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.741101 20746 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:57.764954 20532 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.766604 20711 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.722944 20503 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:57.774729 20722 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.776823 20750 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.777496 20313 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:57.781306 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.847021 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:57.847867 17290 raft_consensus.cc:2368] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9.
I20260709 12:10:57.848728 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:57.782965 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.783773 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:57.849848 17285 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:57.851606 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.852429 17285 raft_consensus.cc:2393] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 2: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:57.853243 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.850397 17286 raft_consensus.cc:2410] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:57.784060 17288 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:57.786566 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.856220 17292 raft_consensus.cc:2376] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7. Re-sending same reply.
I20260709 12:10:57.787083 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.857476 17289 raft_consensus.cc:2410] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:57.788242 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.788561 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.789180 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:57.858378 17284 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:57.858472 17287 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:10:57.789515 17291 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:57.790231 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 62811.6us
I20260709 12:10:57.858590 17283 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.860163 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.861218 20623 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.862457 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:10:57.795161 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 63601.8us
I20260709 12:10:57.860996 20313 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.863866 17978 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.864674 20757 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:57.791296 20608 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.751346 20519 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:57.865448 20519 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:57.866496 20519 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.867098 17283 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:10:57.867702 20312 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:57.815074 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 59658.4us
I20260709 12:10:57.874521 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:57.875435 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.877961 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.878866 17367 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:57.878923 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:57.881477 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:57.886570 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:57.887336 17432 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.893911 20728 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.894675 20728 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:57.844172 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 127182us
I20260709 12:10:57.897532 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.898399 20623 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.898952 20623 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:57.903136 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:57.903995 17433 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:57.906558 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:57.907276 17433 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:57.860062 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:57.849264 17290 raft_consensus.cc:2376] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9. Re-sending same reply.
I20260709 12:10:57.907596 20728 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:57.919171 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:57.908464 17285 raft_consensus.cc:2376] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11. Re-sending same reply.
I20260709 12:10:57.910652 17433 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:57.913858 17980 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.914435 20548 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:10:57.925495 20603 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:57.864435 20750 consensus_queue.cc:1059] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:57.806649 17186 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 5 to 7, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 7 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:57.786628 17255 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:57.909566 17286 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:57.915840 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:57.815057 20571 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:57.830967 20744 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.958170 20571 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.958839 20711 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.957954 17186 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 2 to 3, term changed from 3 to 6, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to <none>, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65), VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66), VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67), VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:57.959415 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:57.959642 20571 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.960201 17186 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:10:57.962025 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 238260us
I20260709 12:10:57.962896 20546 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.962868 17255 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:57.965934 20730 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.966543 20503 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.967715 20532 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:57.934473 20746 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.970531 20746 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:57.970734 17187 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60632 (request call id 219) took 28072 ms (client timeout 15000 ms). Trace:
I20260709 12:10:57.971364 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.971998 17287 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:10:57.972968 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.973547 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.974210 17292 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:57.973876 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.975179 17283 raft_consensus.cc:2410] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:10:57.952809 17434 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:10:57.731246 20536 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:57.988648 17362 raft_consensus.cc:2393] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:57.989715 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:57.990379 17291 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.990869 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:57.995193 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 74599.5us
I20260709 12:10:57.995303 17432 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:57.990483 17290 raft_consensus.cc:2376] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9. Re-sending same reply.
I20260709 12:10:57.996862 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.999084 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:57.832661 20542 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.999711 17433 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:58.000639 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.000867 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:58.005477 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:58.003703 17439 raft_consensus.cc:2410] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:57.966645 20730 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:57.956655 20744 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.009444 17287 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:10:58.012517 17285 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:10:58.013394 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:58.009109 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:58.006352 17290 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:58.008365 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:58.010425 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:58.015725 17292 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.010587 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:58.004093 20623 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:58.015887 17367 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:58.019055 17283 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:58.020668 17404 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:57.998684 20778 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.022653 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:58.019884 17286 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.958187 20579 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:58.027761 17291 pending_rounds.cc:85] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 5
I20260709 12:10:58.011389 20532 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:58.029071 17285 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.032169 17406 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.016624 20744 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.035229 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:58.028091 17291 pending_rounds.cc:107] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:10:58.038127 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:58.036020 17291 raft_consensus.cc:2889] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.038513 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:58.039948 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:58.026607 20746 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.043025 17290 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:58.044364 18013 raft_consensus.cc:2368] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7.
I20260709 12:10:58.020622 17186 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 6 to 7, term changed from 8 to 10, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65), VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66), VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67), VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 10 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:58.046609 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 410825us
I20260709 12:10:58.049865 18007 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:58.062351 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.014267 20588 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:58.077458 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.035396 20532 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:10:58.081575 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49502.2us
I20260709 12:10:58.071209 20753 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:57.971112 17187 rpcz_store.cc:269] 0709 12:10:29.897836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.906058 (+  8222us) service_pool.cc:224] Handling call
0709 12:10:57.970446 (+28064388us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:55.773089 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:56.392171 (+619082us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:56.418790 (+ 26619us) write_op.cc:435] Acquired schema lock
0709 12:10:56.455733 (+ 36943us) tablet.cc:662] Decoding operations
0709 12:10:56.540161 (+ 84428us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:56.541391 (+  1230us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:56.546566 (+  5175us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:56.609326 (+ 62760us) tablet.cc:701] Row locks acquired
0709 12:10:56.609342 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:10:56.609511 (+   169us) write_op.cc:270] Start()
0709 12:10:56.609636 (+   125us) write_op.cc:276] Timestamp: P: 1783599056609454 usec, L: 0
0709 12:10:56.609655 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:56.610361 (+   706us) log.cc:844] Serialized 1682 byte log entry
0709 12:10:57.093861 (+483500us) op_driver.cc:464] REPLICATION: finished
0709 12:10:57.181858 (+ 87997us) write_op.cc:301] APPLY: starting
0709 12:10:57.181978 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:57.182188 (+   210us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:57.182349 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:57.184969 (+  2620us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:57.185275 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:57.185319 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:57.214759 (+ 29440us) log.cc:844] Serialized 41 byte log entry
0709 12:10:57.215002 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:57.215168 (+   166us) write_op.cc:454] Released schema lock
0709 12:10:57.215237 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:57.215870 (+   633us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:57.215911 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7362245,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":87648,"apply.run_cpu_time_us":3887,"apply.run_wall_time_us":33989,"num_ops":4,"prepare.queue_time_us":97561,"prepare.run_cpu_time_us":18413,"prepare.run_wall_time_us":1108204,"raft.queue_time_us":168169,"raft.run_cpu_time_us":18074,"raft.run_wall_time_us":82993,"replication_time_us":483926,"thread_start_us":322897,"threads_started":4,"wal-append.queue_time_us":236486}]]}
I20260709 12:10:58.086019 20753 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:58.088467 20753 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:58.091845 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:58.044835 20746 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.098330 20746 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.103549 20588 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:58.063966 20778 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.111001 20536 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:58.121533 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.135272 17433 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:58.135943 17292 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:58.139724 17286 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:10:58.167034 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:58.167902 17433 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.169021 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:58.169661 17432 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.170380 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:58.170017 17186 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:58.194595 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:58.194808 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:58.195720 17362 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:58.202145 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:58.202907 18013 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.217396 17980 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.219905 17363 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:58.221046 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:58.221560 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:58.221717 17438 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:10:58.222139 17367 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.226374 17186 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 6 to 8, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 8 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:58.169521 20753 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:58.234282 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:58.232214 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:58.251178 17432 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:58.254998 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:58.256843 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:58.257563 17438 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:10:58.220093 20743 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.259644 17441 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.254458 17186 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 6 to 8, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 8 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:58.233511 20478 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.263624 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:58.263238 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:58.271739 17286 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:58.276605 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:58.270067 17186 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 5 to 6, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 6 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:58.277539 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:58.269218 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:58.282475 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:58.283206 17332 leader_election.cc:400] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9.
I20260709 12:10:58.283167 17288 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.287220 17283 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:58.259292 20688 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.285933 17981 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:58.292876 18008 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.294230 17433 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:58.298061 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:58.300393 20706 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:58.302177 17283 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:58.303009 17287 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:58.303256 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:10:58.303875 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.307518 17407 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.307706 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:58.308503 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.310083 17435 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:58.313562 17441 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:58.316076 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:58.317116 17283 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:58.304701 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:58.319339 20519 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:10:58.319751 20820 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:10:58.320734 20821 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:10:58.321112 20778 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.277232 20603 raft_consensus.cc:697] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:58.282635 20696 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:58.322476 20824 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:10:58.322896 20603 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:58.323989 20696 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:58.324721 20696 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:58.325117 20696 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:58.325489 20696 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.326483 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1741) took 1084 ms. Trace:
I20260709 12:10:58.326900 17361 rpcz_store.cc:276] 0709 12:10:57.242409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.526074 (+283665us) service_pool.cc:224] Handling call
0709 12:10:57.526423 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.534629 (+  8206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:57.534659 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.561694 (+ 27035us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.998983 (+437289us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:57.999025 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.999090 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.326200 (+327110us) raft_consensus.cc:1685] finished
0709 12:10:58.326225 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.326392 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10649,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":9728,"thread_start_us":423944,"threads_started":1,"wal-append.queue_time_us":581884}
I20260709 12:10:58.326762 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 586) took 1071 ms. Trace:
I20260709 12:10:58.331455 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:58.332821 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:58.333503 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:58.228670 20532 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:58.265681 20730 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:58.330531 17364 rpcz_store.cc:276] 0709 12:10:57.255808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.545037 (+289229us) service_pool.cc:224] Handling call
0709 12:10:57.566462 (+ 21425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.575442 (+  8980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.575473 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.613758 (+ 38285us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.984127 (+370369us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.984171 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.984250 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.326560 (+342310us) raft_consensus.cc:1685] finished
0709 12:10:58.326580 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.326707 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9083,"raft.queue_time_us":1760,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4317,"thread_start_us":333087,"threads_started":1,"wal-append.queue_time_us":533694}
W20260709 12:10:58.330725 20825 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:10:58.319331 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:58.342479 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 74868.4us
I20260709 12:10:58.344365 17433 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:58.344642 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:58.342810 17286 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.317867 20503 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.351114 17186 catalog_manager.cc:5697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 4, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 4 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:58.305554 20579 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:58.270936 20743 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:58.278554 20478 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:58.378876 17292 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:58.383711 17285 raft_consensus.cc:2410] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:58.345685 20778 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.380065 17186 catalog_manager.cc:5697] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:58.387516 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 71531.4us
I20260709 12:10:58.394898 17286 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:58.396948 17292 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.400568 17367 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
W20260709 12:10:58.408489 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.428085 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:58.644930 17439 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:10:58.645182 17286 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.645457 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 594) took 1014 ms. Trace:
W20260709 12:10:58.490881 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 146297us
I20260709 12:10:58.396497 20477 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.541210 17186 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 2 to 5, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 5 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:10:58.568779 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 262085us
I20260709 12:10:58.460407 20778 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:58.575220 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 270447us
I20260709 12:10:58.579221 20671 raft_consensus.cc:2764] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:58.358593 20555 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:58.641794 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:58.641989 17288 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:10:58.653429 18013 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:58.659060 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.664870 17186 catalog_manager.cc:5697] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 3 to 4, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 4 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:58.668433 20743 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:58.648566 20728 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.670426 20555 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:58.671453 20546 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:58.672801 20555 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:58.676106 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:58.653898 20746 consensus_meta.cc:287] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.555s	user 0.016s	sys 0.004s
I20260709 12:10:58.682469 20746 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:58.682380 17186 catalog_manager.cc:5697] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:58.684783 20746 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:58.685225 20778 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:58.690224 20839 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.298s	user 0.005s	sys 0.006s
I20260709 12:10:58.692546 17286 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:10:58.696717 20757 raft_consensus.cc:3055] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:58.697202 20757 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:58.698139 20757 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:58.699220 20757 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:58.697168 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.702737 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.684298 17186 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:58.645990 17436 rpcz_store.cc:276] 0709 12:10:57.630599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.630775 (+   176us) service_pool.cc:224] Handling call
0709 12:10:57.690487 (+ 59712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.718622 (+ 28135us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:58.147113 (+428491us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.644844 (+497731us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.644953 (+   109us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:58.645032 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.645215 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.645395 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58747,"prepare.queue_time_us":489653,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5035,"thread_start_us":653070,"threads_started":2}
W20260709 12:10:58.662747 20829 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.404s	user 0.006s	sys 0.002s
I20260709 12:10:58.648627 20706 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.725924 20855 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:58.725747 20623 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:10:58.747212 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 74647.5us
W20260709 12:10:58.726547 20838 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:10:58.727408 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 57782.5us
I20260709 12:10:58.728868 20688 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:58.729185 20852 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:58.730418 20843 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:58.730710 20478 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:58.745354 17186 catalog_manager.cc:5697] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 2 to 6, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 6 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:10:58.653079 20836 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:58.750645 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:58.743485 20706 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.779217 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:58.766559 17186 catalog_manager.cc:5697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 5, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 5 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:58.757154 20826 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.672s	user 0.004s	sys 0.000s
I20260709 12:10:58.783818 20836 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:10:58.813761 20744 consensus_meta.cc:287] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.008s
I20260709 12:10:58.814281 20744 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:58.778123 20844 log.cc:927] Time spent T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:10:58.815594 18015 raft_consensus.cc:2368] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8.
I20260709 12:10:58.757277 20841 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:58.816268 20841 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:10:58.816640 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 177700us
I20260709 12:10:58.816735 20841 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.817552 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:58.760215 20852 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:58.591347 20730 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:58.814340 20836 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:58.823208 20313 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.819613 20852 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:58.823798 20313 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:58.832304 17258 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.833070 20842 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:58.835343 17258 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.836297 20718 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:58.782986 20478 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.838641 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.839114 20478 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:58.841408 20478 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:58.825866 20313 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:58.783522 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:58.844233 20523 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:58.781111 20706 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.776342 20571 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:58.771917 20855 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:58.847930 20718 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.860253 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.856475 20523 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:58.853153 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 69703.4us
W20260709 12:10:58.872020 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 220312us
I20260709 12:10:58.875452 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:58.876130 17287 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.879217 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.857093 20856 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.887059 18013 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:58.862825 17186 catalog_manager.cc:5697] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 3 to 5, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67), pending config changed. New cstate: current_term: 5 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:10:58.892800 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:58.763200 20857 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:10:58.895942 17291 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.864275 20571 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:58.883574 20523 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.873245 20313 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.867146 20743 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.898471 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:58.918680 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:10:58.929114 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:58.914314 17186 catalog_manager.cc:5697] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:58.945842 18011 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:10:58.920056 20657 consensus_meta.cc:287] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.284s	user 0.018s	sys 0.006s
I20260709 12:10:58.947098 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:58.922555 20696 consensus_meta.cc:287] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.001s
I20260709 12:10:58.949433 17440 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:58.918018 17287 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:10:58.888945 20854 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:58.920866 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.949378 20857 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.949798 20750 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.950057 20862 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.894394 20856 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:58.918398 20837 raft_consensus.cc:2764] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:58.960736 17439 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.923400 20608 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:58.897753 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.963304 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:58.964452 18014 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:58.964857 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 72146.4us
W20260709 12:10:58.961570 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 184161us
I20260709 12:10:58.965096 17186 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 3 to 4, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 4 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:58.895983 20841 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:58.993245 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 73168.7us
I20260709 12:10:58.950171 20571 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:58.993578 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 95926.9us
I20260709 12:10:58.995503 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:58.981753 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 342189us
I20260709 12:10:58.952783 20827 consensus_queue.cc:1059] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:10:58.947091 20657 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.005029 17980 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:10:58.975200 20856 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.001008 17406 leader_election.cc:336] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.503s (SENT)
I20260709 12:10:59.009948 17186 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 4 to 5, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 5 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:58.967978 20718 raft_consensus.cc:2764] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:10:58.994086 20857 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:58.962502 20696 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.027530 17258 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:58.994808 20750 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.012719 17980 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:58.967586 20728 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:10:58.948452 20313 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:58.971918 20743 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:59.028261 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 48941.6us
I20260709 12:10:59.028744 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:59.028962 17433 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:58.979449 20532 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:10:59.035012 17980 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:59.007452 20608 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:10:58.967020 20854 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.015699 20852 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:58.976781 20862 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.046169 20842 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:59.051802 20571 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.058604 20608 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.059037 20608 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:59.059944 20608 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.060784 20746 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.061286 20608 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.063366 20555 consensus_queue.cc:1175] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33539b233c2044afa31017244f6cc0d1" responder_term: 8 status { last_received { term: 6 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:10:59.064376 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.069134 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 54447.7us
I20260709 12:10:59.059056 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:59.046622 20837 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.015444 20636 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:10:59.076486 17980 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:59.047185 20603 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.015576 20864 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:10:59.055657 20750 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.085762 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:10:59.087785 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 92339.4us
I20260709 12:10:59.089946 17333 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:10:59.090792 20827 raft_consensus.cc:3055] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:59.091224 20827 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:59.076139 20852 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:59.085106 20532 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.051476 20868 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:10:59.080107 20869 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.110078 17286 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:59.085707 20837 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:59.111106 17286 pending_rounds.cc:85] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 7
I20260709 12:10:59.113620 17286 pending_rounds.cc:107] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:59.081928 20548 consensus_queue.cc:1059] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:10:59.113991 17286 raft_consensus.cc:2889] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.114713 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:59.102136 20313 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.116564 17361 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:10:59.118757 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 117771us
I20260709 12:10:59.104308 20750 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:10:59.124101 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 64994us
I20260709 12:10:59.110939 20477 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.110797 20869 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:59.128261 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 63105.8us
W20260709 12:10:59.133445 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 51272.4us
I20260709 12:10:59.140245 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:59.141009 17364 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.142417 17363 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:10:59.142809 17363 pending_rounds.cc:85] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:10:59.143021 17363 pending_rounds.cc:107] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:10:59.143254 17363 raft_consensus.cc:2889] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:59.146831 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.148370 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 52804.3us
I20260709 12:10:59.148768 18012 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:59.119978 20532 raft_consensus.cc:697] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:10:59.155158 17432 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 10: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:59.157575 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 769) took 1139 ms. Trace:
W20260709 12:10:59.157971 17333 connection.cc:256] RPC call timeout handler was delayed by -1.280622841999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 12:10:59.158607 17333 connection.cc:256] RPC call timeout handler was delayed by -1.0626603680000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 12:10:59.161583 17404 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:59.158010 18009 rpcz_store.cc:276] 0709 12:10:58.021268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.022340 (+  1072us) service_pool.cc:224] Handling call
0709 12:10:59.157320 (+1134980us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400649e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:59.157474 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896668032}
I20260709 12:10:59.163794 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:59.139357 20869 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.189680 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:10:59.190685 18009 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:10:59.150527 20841 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.189769 17258 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:59.153102 20477 raft_consensus.cc:697] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:59.198858 20862 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:59.110849 20857 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:59.203511 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.205204 17364 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:10:59.206735 17404 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:10:59.202821 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 51849.7us
I20260709 12:10:59.211639 17258 leader_election.cc:400] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7.
I20260709 12:10:59.212069 17258 leader_election.cc:403] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:59.188812 20876 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.210736 17978 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:59.188525 20657 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.183313 20880 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.227041 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:59.126186 20827 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:59.216349 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:10:59.236183 17258 leader_election.cc:400] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8.
I20260709 12:10:59.214601 20887 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:59.242604 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.243469 17287 raft_consensus.cc:2393] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:59.243750 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.246405 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.247259 17286 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:59.251684 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:59.169693 20852 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.215516 20876 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.194955 20519 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:59.225347 20875 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.233467 20868 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:59.251013 17361 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:59.239311 20836 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.232353 20841 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7.
I20260709 12:10:59.262010 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:59.235052 20548 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:59.234288 20880 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:59.231932 20696 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:59.259419 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:59.261303 17360 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:10:59.246466 20657 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.287081 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:10:59.307668 20657 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:59.286090 20868 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:10:59.308741 20657 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:59.309056 20868 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.250931 20743 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:10:59.259232 20831 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.472s	user 0.003s	sys 0.000s
I20260709 12:10:59.283388 20313 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.302888 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:59.259305 20840 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:59.303889 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 97254.7us
I20260709 12:10:59.307747 17361 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:59.298050 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.311934 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:10:59.242324 20862 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:10:59.261365 20877 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.282011 20876 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.318231 17286 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:59.215098 20750 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.259147 20886 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:59.196465 20837 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.286821 20881 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.304695 20688 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:59.343236 17291 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:59.345376 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 91715.3us
I20260709 12:10:59.352514 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:10:59.311131 20872 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 12:10:59.342422 20871 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:10:59.310726 20880 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.255810 20890 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:10:59.349524 20886 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.251564 20887 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.343709 20313 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:59.368757 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:59.254524 20532 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.297178 20875 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:59.364245 20636 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.359885 20857 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:59.378713 17286 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:59.376750 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.377127 17333 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:59.367182 20688 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.342602 20877 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.411855 17290 raft_consensus.cc:1240] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:59.442998 17362 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:59.389935 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:59.377509 20671 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:59.341655 20477 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.441670 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.456888 17284 raft_consensus.cc:2376] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9. Re-sending same reply.
I20260709 12:10:59.429641 17366 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:59.413617 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 63588.7us
I20260709 12:10:59.356113 20881 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:59.400738 17358 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:10:59.462255 17332 leader_election.cc:336] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.884s (SENT)
I20260709 12:10:59.375759 20886 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:10:59.404003 20757 consensus_meta.cc:287] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.005s
W20260709 12:10:59.468068 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 96435.7us
I20260709 12:10:59.375129 20882 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.473402 20875 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:59.468896 17291 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:59.475735 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.478695 20503 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.489176 20503 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:10:59.490340 20503 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.489091 17288 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
W20260709 12:10:59.491778 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.390177 20890 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.389771 20893 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:59.461326 20571 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.475595 20887 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:59.481946 20894 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:10:59.477555 20856 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:59.448314 20313 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.506807 17433 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:59.396261 20636 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:59.486466 20746 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:59.498965 20706 consensus_meta.cc:287] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.003s
I20260709 12:10:59.514953 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.518576 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.519491 17288 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:59.459580 20857 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.526082 17367 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.496600 20743 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:59.524698 17291 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:10:59.513286 20523 consensus_meta.cc:287] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 12:10:59.516278 20887 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.531898 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.532102 20887 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.533210 20898 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:10:59.533788 20898 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.534528 20887 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.536002 20898 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:59.502916 20890 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.537524 20757 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:10:59.538381 20890 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.505828 20899 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.535669 20869 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.466986 20671 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.538174 20757 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.561177 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.559834 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:59.544276 20523 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:10:59.566159 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.571022 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:59.571395 17364 raft_consensus.cc:2368] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8.
I20260709 12:10:59.572356 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:59.573681 20900 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.573589 20897 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:10:59.573884 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:10:59.575274 20887 raft_consensus.cc:2764] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:59.579192 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.582541 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.582593 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:10:59.590370 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 245202us
I20260709 12:10:59.503521 20893 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.526306 20706 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.636164 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:59.629786 17291 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
W20260709 12:10:59.630638 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 611) took 1367 ms (client timeout 1691 ms). Trace:
W20260709 12:10:59.642544 17285 rpcz_store.cc:269] 0709 12:10:58.262825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.262947 (+   122us) service_pool.cc:224] Handling call
0709 12:10:59.582336 (+1319389us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001b6a54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:10:59.630574 (+ 48238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256978816}
I20260709 12:10:59.630848 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.643469 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:59.644207 17283 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:10:59.644318 17441 raft_consensus.cc:2410] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:59.644909 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:10:59.645454 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:59.646204 17437 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:10:59.583364 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:10:59.647115 17286 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:10:59.645569 17288 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.650260 17432 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:59.650875 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:59.651513 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:59.651976 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:59.652418 17437 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:59.555390 20875 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:59.651494 17439 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:10:59.582080 20890 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.554581 20743 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:59.662782 20730 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.663089 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:59.663412 20730 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.663856 20478 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.664273 20478 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.664613 20478 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.665581 20730 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.667950 17363 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:10:59.679564 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:10:59.681135 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:59.630865 20477 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:10:59.629199 20897 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:59.706815 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:10:59.761720 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 56979.5us
I20260709 12:10:59.708832 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:10:59.557832 20899 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:59.742964 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 110630us
I20260709 12:10:59.673708 20688 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.677255 20877 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.749383 20744 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:59.709776 20718 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.676693 20730 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:10:59.700521 20857 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.794896 17288 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:10:59.795704 20904 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:10:59.797422 20903 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:59.799037 20636 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:59.754475 20523 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:10:59.799688 20911 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:10:59.800077 20901 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:10:59.801157 20907 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:10:59.802258 20909 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.805564 20886 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:59.820649 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 237680us
I20260709 12:10:59.815645 20856 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:10:59.783352 20897 consensus_queue.cc:1243] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer e860f7e876b74ec589f447737822a4f6 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:59.755597 20757 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:59.790429 20746 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.839036 20917 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:10:59.847980 20915 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:10:59.847724 20746 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:10:59.835011 20718 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.849752 20718 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:10:59.850026 20746 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:59.851251 20886 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.850826 20718 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:10:59.853178 20914 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:10:59.857785 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 149022us
I20260709 12:10:59.859337 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:10:59.862310 20917 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.829108 20903 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:10:59.878134 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:59.878952 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:59.887562 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:59.892562 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:59.893368 17432 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:10:59.833630 20877 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:10:59.842954 20909 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.902730 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:10:59.903439 17441 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.902943 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:59.904155 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:59.904927 17435 raft_consensus.cc:2410] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:59.909237 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:10:59.910043 17436 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
W20260709 12:10:59.888993 20904 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:59.903548 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:10:59.905715 20916 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:10:59.839929 20901 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:10:59.906934 20911 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:59.907577 20909 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.912168 20877 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:10:59.931360 20671 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.952343 20877 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:10:59.950312 17432 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:59.896800 20903 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.948884 17441 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:10:59.925006 17439 raft_consensus.cc:1217] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-7.5]   Dedup: 3.3->[5.4-7.5]
I20260709 12:10:59.950402 20743 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:10:59.969476 17439 pending_rounds.cc:85] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 3
I20260709 12:10:59.978446 17439 pending_rounds.cc:107] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:59.978781 17439 raft_consensus.cc:2889] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.974905 20893 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:10:59.986666 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 127408us
I20260709 12:10:59.954275 20869 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:00.000842 17432 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:00.005280 17288 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:00.005172 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:00.004609 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 58407.1us
I20260709 12:11:00.008479 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.012221 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.013597 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.014273 17284 raft_consensus.cc:2393] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:00.013044 17285 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:00.014318 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:00.015184 17432 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:00.015352 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.016757 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:00.018308 20928 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.018354 17284 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.019533 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:00.014340 20899 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:00.019049 20928 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:00.021057 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.023288 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:00.023996 17288 raft_consensus.cc:2376] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6. Re-sending same reply.
I20260709 12:11:00.026466 20928 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:00.029930 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:00.030887 17288 raft_consensus.cc:2376] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6. Re-sending same reply.
I20260709 12:11:00.032105 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.033766 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:00.033758 17284 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:00.034862 17288 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:00.040112 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.039995 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.041855 17285 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:11:00.043116 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.047714 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.054898 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:00.055711 17432 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
I20260709 12:11:00.056866 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.057627 17284 raft_consensus.cc:2393] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:00.058765 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.059520 17285 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:00.060761 17432 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:11:00.077131 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.070123 20896 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:11:00.073756 20901 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:00.087067 20922 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:11:00.082898 20863 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.093894 20863 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.098717 20863 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:00.106024 20880 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.726s	user 0.006s	sys 0.005s
I20260709 12:11:00.118885 20854 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:00.120687 20880 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.122735 20603 raft_consensus.cc:3055] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.123344 20603 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:00.124168 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1681) took 2153 ms. Trace:
I20260709 12:11:00.124315 20603 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.124583 17289 rpcz_store.cc:276] 0709 12:10:57.971121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.974903 (+  3782us) service_pool.cc:224] Handling call
0709 12:10:58.013100 (+ 38197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.277793 (+264693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.277823 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.301851 (+ 24028us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.572798 (+270947us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:58.572839 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.572918 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.164674 (+591756us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b24001872f8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12228b49c4 00007f12228b2acb 00007f1222a6ddc9 00007f1222a6da55 00007f1222a6cfb0 00007f12256e3488 00007f12256e3be8 00007f12256bb398 00007f12256b676a 00007f12256b5bb6
0709 12:10:59.188287 (+ 23613us) raft_consensus.cc:1685] finished
0709 12:10:59.188313 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.123960 (+935647us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b54003fa050. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:00.124096 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90397,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9141,"spinlock_wait_cycles":82232832,"thread_start_us":498868,"threads_started":2,"wal-append.queue_time_us":343569}
I20260709 12:11:00.126016 20603 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:00.127166 20876 consensus_meta.cc:287] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.003s
I20260709 12:11:00.120738 20478 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:00.131301 20876 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.132426 20903 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:00.134449 20906 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.505s	user 0.003s	sys 0.000s
I20260709 12:11:00.135790 20478 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:00.135803 20880 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:00.137125 20876 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:00.138195 17290 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:00.138904 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2581) took 1019 ms. Trace:
I20260709 12:11:00.139348 17362 rpcz_store.cc:276] 0709 12:10:59.119520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.119623 (+   103us) service_pool.cc:224] Handling call
0709 12:10:59.119894 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.447003 (+327109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.138639 (+691636us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54002df354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:00.138836 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742202240}
I20260709 12:11:00.140606 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2577) took 1027 ms. Trace:
I20260709 12:11:00.140988 17367 rpcz_store.cc:276] 0709 12:10:59.113445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.113573 (+   128us) service_pool.cc:224] Handling call
0709 12:10:59.113866 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.526552 (+412686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.140384 (+613832us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54003c4e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:00.140545 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947554688}
I20260709 12:11:00.140627 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:00.142846 17362 raft_consensus.cc:2376] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7. Re-sending same reply.
I20260709 12:11:00.151396 20909 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:00.153012 17283 raft_consensus.cc:2368] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9.
I20260709 12:11:00.154068 20909 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:00.158030 20882 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:00.160251 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:00.161729 20875 raft_consensus.cc:2764] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:00.162366 20919 consensus_queue.cc:1059] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:00.163626 20919 raft_consensus.cc:3055] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.164006 20919 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:00.164897 20919 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:00.169186 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 283491us
I20260709 12:11:00.176275 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:00.177032 17440 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:00.182401 17434 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.186720 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:00.187783 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:00.196473 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:00.198882 17362 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:00.199753 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:00.201473 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.202023 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:00.204777 20918 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.205261 20918 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.194464 20671 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:11:00.207267 20918 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:00.207441 20875 consensus_queue.cc:1059] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:00.200718 20919 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.208453 20887 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:00.208796 20887 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:00.209561 20887 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.209983 20875 raft_consensus.cc:3055] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.210602 20875 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:00.211530 20875 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:00.213074 20882 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:00.214793 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:00.215579 17332 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:00.216012 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:00.216629 17362 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:11:00.210879 20887 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.217481 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:00.218438 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.216694 20671 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.222390 20671 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.222803 20671 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.228629 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.229704 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:00.230430 17332 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:00.237691 18014 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:00.238735 20903 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:00.264081 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.266407 17284 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:00.239327 20478 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.240151 20890 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:00.240322 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:00.241281 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:00.272292 18010 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:00.272810 17362 raft_consensus.cc:2410] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:11:00.273396 17284 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:11:00.273770 17284 pending_rounds.cc:85] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 6
I20260709 12:11:00.241540 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.273983 17284 pending_rounds.cc:107] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:11:00.274185 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:00.274457 20887 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.275008 20887 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:00.275667 18013 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:00.276072 20887 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:00.271574 20555 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:11:00.242431 20919 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:00.261320 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:00.259817 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.262012 20840 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.279856 20840 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:00.280563 20888 consensus_queue.cc:1059] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:00.280611 17284 raft_consensus.cc:2889] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.282261 20890 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:00.283234 20890 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:00.285195 20893 raft_consensus.cc:3055] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:00.272677 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.274959 18012 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:00.287912 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:00.288395 17284 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.213044 20875 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.268700 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.267284 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.267926 17980 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.274349 18011 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:00.287117 17291 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:00.242499 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.295285 17980 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:00.269196 20849 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:00.262763 17333 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.296500 20849 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.298198 17433 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:00.298780 20849 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:00.299273 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:00.299857 17438 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.278810 20881 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:00.281960 20840 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:00.303259 17284 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:00.304247 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:00.304927 17284 raft_consensus.cc:2393] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:00.305680 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.302520 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:00.307717 20671 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.308295 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:00.309094 18013 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:00.309379 17438 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:00.309721 17432 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.310561 18012 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:00.311004 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:00.311975 17441 raft_consensus.cc:2410] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:11:00.306587 17286 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.315053 17284 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:00.291810 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:00.318481 17290 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:00.315968 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:00.345381 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.321048 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:00.349455 17284 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:00.350461 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:00.351874 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:00.352236 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:00.352135 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 89473us
I20260709 12:11:00.353773 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:00.317049 20608 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:00.354715 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:00.286878 20893 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:00.320538 20840 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.344820 20542 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:00.345079 20555 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:00.347775 20843 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:00.316879 20919 raft_consensus.cc:697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:00.390249 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:00.321190 20603 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.364184 17284 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:00.363596 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:00.401999 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:00.368310 20926 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.350s	user 0.004s	sys 0.000s
I20260709 12:11:00.408962 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:00.408631 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:00.369520 20921 log.cc:927] Time spent T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.385s	user 0.002s	sys 0.000s
I20260709 12:11:00.355544 20854 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.357414 20608 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:00.394883 20840 raft_consensus.cc:697] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:00.368201 20671 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:00.355484 20849 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:11:00.355546 20478 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:11:00.353864 20920 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.400506 20909 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.398895 20571 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:00.411405 17360 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:00.466384 17284 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:00.357266 20730 consensus_queue.cc:1059] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:11:00.370606 20900 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:00.468869 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:00.472872 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.473624 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1750) took 1228 ms. Trace:
I20260709 12:11:00.474043 17366 rpcz_store.cc:276] 0709 12:10:59.245040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.246230 (+  1190us) service_pool.cc:224] Handling call
0709 12:10:59.246544 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.461061 (+214517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.473383 (+1012322us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b540014a0d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:00.473564 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420276480}
I20260709 12:11:00.474584 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:00.452775 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2585) took 1077 ms. Trace:
I20260709 12:11:00.467197 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.477145 17361 rpcz_store.cc:276] 0709 12:10:59.375888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.451909 (+1076021us) service_pool.cc:224] Handling call
0709 12:11:00.452256 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.452445 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.452472 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.452514 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:00.452546 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.452595 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.452711 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.477208 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:00.480448 17439 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:00.484220 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.485157 18008 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:00.487807 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1753) took 1242 ms. Trace:
I20260709 12:11:00.488233 17365 rpcz_store.cc:276] 0709 12:10:59.245863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.261825 (+ 15962us) service_pool.cc:224] Handling call
0709 12:10:59.297243 (+ 35418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.404704 (+107461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.404736 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.404774 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:59.404806 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.487578 (+1082772us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000f46d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:00.487625 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.487747 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246616320}
W20260709 12:11:00.489802 17406 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.564s (SENT)
I20260709 12:11:00.490306 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:00.491328 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.358259 20886 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.492205 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1749) took 1247 ms. Trace:
I20260709 12:11:00.514401 17364 rpcz_store.cc:276] 0709 12:10:59.244748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.279090 (+ 34342us) service_pool.cc:224] Handling call
0709 12:11:00.492049 (+1212959us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400082854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:00.492151 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591543680}
I20260709 12:11:00.460306 20880 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:00.484155 20571 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.410574 20918 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.483816 20900 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:00.495325 20841 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.518695 20743 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.409691 20903 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.169s
W20260709 12:11:00.683712 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.429194 20842 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 12:11:00.449877 20897 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.161s
W20260709 12:11:00.861649 17978 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 2.313s (SENT) [suppressed 30 similar messages]
I20260709 12:11:00.708999 18012 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:00.710175 20843 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:00.710623 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:00.873472 18006 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:00.711344 18013 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:00.852239 20571 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:11:00.715536 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 196746us
I20260709 12:11:00.716539 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.717455 17361 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:00.696689 20921 log.cc:927] Time spent T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:00.695502 20919 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.450197 20542 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.578383 20909 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.119s
I20260709 12:11:00.718858 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.719050 17441 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:00.719015 20840 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.719552 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.719957 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.720464 17432 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:00.721499 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:00.722129 17440 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:00.722324 20313 raft_consensus.cc:3055] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:00.923168 20313 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:00.924192 20313 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.925501 20313 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.723340 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:00.725596 20477 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:00.927275 20477 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.929526 20477 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:00.731698 20868 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.737228 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2583) took 1574 ms. Trace:
I20260709 12:11:00.935359 17363 rpcz_store.cc:276] 0709 12:10:59.163340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.163478 (+   138us) service_pool.cc:224] Handling call
0709 12:11:00.737025 (+1573547us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540014e954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:00.737165 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142772608}
I20260709 12:11:00.513827 20608 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.458444 20881 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.492460 20854 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.747699 17283 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.493836 20603 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.916254 18006 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
W20260709 12:11:00.753687 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 299964us
W20260709 12:11:00.760342 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 273721us
W20260709 12:11:00.942452 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.760710 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 270913us
I20260709 12:11:00.945652 20778 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:00.951261 20778 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.953514 20778 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:00.763628 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:00.717067 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.867609 20920 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:00.868479 20938 log.cc:927] Time spent T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:11:00.868728 20875 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.714850 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.851549 20901 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.885005 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.887804 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:00.857559 20918 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:00.975278 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2536) took 1394 ms. Trace:
I20260709 12:11:00.975485 17283 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:00.889150 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 601) took 1045 ms. Trace:
W20260709 12:11:00.919610 17332 leader_election.cc:336] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.550s (SENT)
I20260709 12:11:00.858911 20837 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:00.934008 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:00.459640 20924 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.946985 20753 consensus_queue.cc:1059] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:00.760967 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 279917us
W20260709 12:11:00.987087 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.948873 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:00.964622 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.970659 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 85745.9us
I20260709 12:11:00.975090 20918 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.851297 20899 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:00.976112 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.864902 20743 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.976748 17361 rpcz_store.cc:276] 0709 12:10:59.843082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.496933 (+653851us) service_pool.cc:224] Handling call
0709 12:11:00.717266 (+220333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.887931 (+170665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.888871 (+   940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.975786 17292 rpcz_store.cc:276] 0709 12:10:59.580892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.581010 (+   118us) service_pool.cc:224] Handling call
0709 12:10:59.637233 (+ 56223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.637604 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.637631 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.662914 (+ 25283us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.828286 (+165372us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:59.838614 (+ 10328us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.838853 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.838937 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.368777 (+529840us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:00.971324 (+602547us) raft_consensus.cc:1685] finished
0709 12:11:00.975077 (+  3753us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.975216 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10099,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":29461,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"spinlock_wait_cycles":2770304,"thread_start_us":157948,"threads_started":1,"wal-append.queue_time_us":240909}
I20260709 12:11:00.937813 20854 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.888440 20843 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:00.978636 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 261634us
I20260709 12:11:00.931123 20947 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.980573 18012 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
W20260709 12:11:00.961588 20942 log.cc:927] Time spent T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:00.999498 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:00.988871 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:00.989701 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.980772 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1760) took 1668 ms. Trace:
I20260709 12:11:00.978781 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 598) took 1120 ms. Trace:
I20260709 12:11:00.980070 20864 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.008308 17358 rpcz_store.cc:276] 0709 12:10:59.312867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.495110 (+182243us) service_pool.cc:224] Handling call
0709 12:10:59.505654 (+ 10544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.505884 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:59.519829 (+ 13945us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.581950 (+ 62121us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.146275 (+564325us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b18000ef200. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e522 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
0709 12:11:00.157284 (+ 11009us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b18000ef200. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f12299ef58f 00007f1222a2e571 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd
0709 12:11:00.743161 (+585877us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b18000ef200. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229fc2a6 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9
0709 12:11:00.744481 (+  1320us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b18000ef200. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:11:00.980365 (+235884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.980421 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:00.980462 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.980595 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.980718 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9329,"prepare.queue_time_us":22252,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":575439,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":49666,"spinlock_wait_cycles":38811904,"thread_start_us":286503,"threads_started":2,"wal-append.queue_time_us":155677,"wal-append.run_cpu_time_us":4917,"wal-append.run_wall_time_us":1277001}
W20260709 12:11:01.045495 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 56723.1us
I20260709 12:11:01.008417 17362 rpcz_store.cc:276] 0709 12:10:59.842324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.217261 (+374937us) service_pool.cc:224] Handling call
0709 12:11:00.962737 (+745476us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b54003c4454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:00.962892 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123644160}
I20260709 12:11:01.009522 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.003990 17981 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:01.047940 17361 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:11:00.938052 20603 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:00.933257 20542 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:00.975507 20841 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:01.050634 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 131048us
I20260709 12:11:01.055896 17358 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:01.058182 18015 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:01.055043 17362 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:00.987912 20924 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.986184 20855 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:01.064950 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.049790 20730 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.002828 20837 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.069679 20837 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:01.051187 20842 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:01.070495 20842 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.072682 20842 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:01.051025 20852 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.077883 20852 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:01.079418 20532 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.991321 20948 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.084723 20827 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.975992 20478 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:11:00.972661 20920 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:01.089247 20920 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:01.054261 20864 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.093097 20864 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:01.051379 20947 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.094928 20843 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:01.046012 20938 log.cc:927] Time spent T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:01.096522 20947 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:01.097287 20743 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:01.098924 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:01.099352 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.956251 20881 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:00.998910 20702 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.061839 20869 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.111001 17366 raft_consensus.cc:2368] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8.
I20260709 12:11:00.981180 20875 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:01.061439 20924 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.111642 20837 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:11:01.113798 20702 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.125881 20881 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:01.131255 20885 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.780s	user 0.000s	sys 0.006s
I20260709 12:11:01.131959 20603 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.138875 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.139655 17366 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 2.
W20260709 12:11:01.122120 20941 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:01.146467 20603 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.155948 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:01.184949 20753 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.172683 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 311033us
I20260709 12:11:01.185657 20753 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:01.188261 20753 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:01.188493 20949 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.188704 17978 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:01.201056 20843 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.202401 17978 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:01.202800 20924 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.204545 20843 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:01.205049 20843 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.205204 20924 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:01.205458 20843 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:01.214769 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 270562us
I20260709 12:11:01.214711 20843 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.218250 20843 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:01.222154 17404 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:01.252895 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.253953 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:01.226608 20868 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:01.237741 20880 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:01.252645 20875 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:01.284490 20753 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:01.357028 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 412182us
W20260709 12:11:01.357841 17406 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.023s (SENT)
I20260709 12:11:01.358306 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:01.227550 20949 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:01.360947 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.361644 20542 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:01.362136 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 140071us
W20260709 12:11:01.372311 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 368348us
I20260709 12:11:01.373592 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:01.375555 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.378450 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.350049 20948 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.383091 17432 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.384460 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:01.386020 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:01.386773 17441 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:01.384948 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:01.390491 17432 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:01.393378 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:01.394208 17432 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 2.
I20260709 12:11:01.398309 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:01.401320 17432 raft_consensus.cc:2410] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:11:01.397305 20532 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:01.405485 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.406299 17365 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:01.407471 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.408126 17365 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:01.409101 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.422333 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:01.423561 17365 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.415738 17404 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:01.426896 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 53388.6us
I20260709 12:11:01.353803 20868 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:01.379309 20753 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:01.388906 20743 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:01.392861 20843 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:01.398262 20901 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:01.444001 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.382943 20542 consensus_queue.cc:1059] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:11:01.439743 20571 consensus_meta.cc:287] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 12:11:01.429999 20532 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.394891 20864 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:11:01.449255 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 91442.8us
I20260709 12:11:01.451004 17360 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:01.455793 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:01.456670 17367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 607) took 1587 ms (client timeout 1582 ms). Trace:
W20260709 12:11:01.457029 17367 rpcz_store.cc:269] 0709 12:10:59.869396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.141676 (+272280us) service_pool.cc:224] Handling call
0709 12:11:01.455722 (+1314046us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5c000c710c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1229485161 00007f1229626a79 00007f122aae09b6 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:01.456592 (+   870us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3736320}
I20260709 12:11:01.441362 20958 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.461369 17365 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
W20260709 12:11:01.454751 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.444533 20843 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:01.458707 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.470945 17367 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:01.472098 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.472373 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:01.474650 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 427752us
I20260709 12:11:01.453048 20503 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.453444 20532 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:01.485242 17406 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:01.488554 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:01.490150 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.476342 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:01.472935 20919 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.510944 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:01.513742 17258 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:01.479120 20313 consensus_meta.cc:287] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.001s
I20260709 12:11:01.473802 20920 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.473856 20843 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:01.449522 20743 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.468679 20958 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.510349 20532 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.448050 20753 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.451900 20571 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:01.531096 20841 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.548623 17365 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:11:01.541014 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 437691us
W20260709 12:11:01.538666 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.511675 20901 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.531474 20730 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:11:01.510018 20840 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:01.450384 20880 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:01.573204 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 136501us
I20260709 12:11:01.582671 20952 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.583278 20952 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:01.585649 20952 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:01.559414 20608 consensus_meta.cc:287] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.584s	user 0.004s	sys 0.008s
W20260709 12:11:01.588127 17256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.008s
I20260709 12:11:01.531351 20948 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:01.547749 20958 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.550537 20841 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.604039 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:01.604635 18006 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.533237 20964 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:11:01.599426 18009 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:01.561596 20730 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.609987 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:01.610716 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.531596 20478 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 12:11:01.598474 17256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.017s	sys 0.009s
I20260709 12:11:01.606190 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:01.611181 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 95964.5us
I20260709 12:11:01.608758 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:01.556715 20901 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:01.533315 20919 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.609625 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:01.550045 20918 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.644711 18014 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.601581 20899 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.648090 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:01.651187 18012 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:01.566325 20718 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:01.653313 18006 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:01.635464 20901 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.608763 20841 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.580803 20840 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:01.656740 17363 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.602006 20949 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:01.634902 20730 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:01.636504 20955 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.599015 20608 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:01.660449 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 188118us
I20260709 12:11:01.594485 20542 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:11:01.669848 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:01.805866 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.837181 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 348703us
I20260709 12:11:01.668601 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:01.838217 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:01.713013 18006 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEARNER]: Advancing to term 10
I20260709 12:11:01.841089 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:01.848404 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:01.880985 20702 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:01.881330 18009 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:01.792475 20888 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.855886 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 630) took 1602 ms. Trace:
I20260709 12:11:01.858209 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 639) took 1563 ms. Trace:
W20260709 12:11:01.858815 20990 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:11:01.860808 20312 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.861444 20855 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:01.861644 20743 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:01.863227 20962 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:11:01.863782 20542 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.866209 20841 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:01.906960 20603 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.760s	user 0.003s	sys 0.007s
I20260709 12:11:01.907904 20841 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:01.866994 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1763) took 1663 ms. Trace:
I20260709 12:11:01.908605 17362 rpcz_store.cc:276] 0709 12:11:00.203332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.059312 (+855980us) service_pool.cc:224] Handling call
0709 12:11:01.059671 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:01.117030 (+ 57359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.117067 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:01.117712 (+   645us) log.cc:844] Serialized 52 byte log entry
0709 12:11:01.474407 (+356695us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:01.474441 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.866571 (+392130us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b54000f4bd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:01.866621 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.866682 (+    61us) raft_consensus.cc:1685] finished
0709 12:11:01.866695 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.866930 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11226,"raft.queue_time_us":13120,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":2954,"spinlock_wait_cycles":105063808,"thread_start_us":318905,"threads_started":1,"wal-append.queue_time_us":457706}
I20260709 12:11:01.910665 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.868216 20778 raft_consensus.cc:3055] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:01.911259 17362 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:01.911492 20778 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:01.912156 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:01.912415 20778 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:01.912923 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 609) took 1740 ms. Trace:
I20260709 12:11:01.913404 20778 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.869216 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 612) took 1695 ms. Trace:
I20260709 12:11:01.905536 20542 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.914532 17363 rpcz_store.cc:276] 0709 12:11:00.173325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.954990 (+781665us) service_pool.cc:224] Handling call
0709 12:11:00.955313 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.662441 (+707128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.868942 (+206501us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54002909d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:01.869119 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612684160}
I20260709 12:11:01.915407 20918 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:01.915851 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:01.916725 20542 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:01.916985 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.870792 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 638) took 1578 ms. Trace:
I20260709 12:11:01.913285 17359 rpcz_store.cc:276] 0709 12:11:00.172496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.734862 (+562366us) service_pool.cc:224] Handling call
0709 12:11:00.735198 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.861087 (+125889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.861115 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.869256 (+  8141us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.359791 (+490535us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.359836 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.359936 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.912716 (+552780us) raft_consensus.cc:1685] finished
0709 12:11:01.912735 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.912865 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128764,"raft.queue_time_us":155752,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":155,"thread_start_us":490111,"threads_started":1,"wal-append.queue_time_us":666085}
I20260709 12:11:01.918190 17292 rpcz_store.cc:276] 0709 12:11:00.292171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.992756 (+700585us) service_pool.cc:224] Handling call
0709 12:11:01.048545 (+ 55789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.071542 (+ 22997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.071574 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.071617 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:01.071654 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.870575 (+798921us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b5400200dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:01.870618 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.870736 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52469120}
W20260709 12:11:01.872521 20827 consensus_meta.cc:287] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.787s	user 0.011s	sys 0.000s
I20260709 12:11:01.875133 20753 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:01.875860 20840 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:01.884392 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.697420 20868 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:01.718372 20899 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.887434 17288 rpcz_store.cc:276] 0709 12:11:00.294330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.131223 (+836893us) service_pool.cc:224] Handling call
0709 12:11:01.131578 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.131943 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.131971 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.132422 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.454951 (+322529us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.454990 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.455054 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.857953 (+402899us) raft_consensus.cc:1685] finished
0709 12:11:01.857974 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.858135 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3121,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5534,"thread_start_us":322158,"threads_started":1,"wal-append.queue_time_us":535658}
I20260709 12:11:01.886760 17290 rpcz_store.cc:276] 0709 12:11:00.253542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.253688 (+   146us) service_pool.cc:224] Handling call
0709 12:11:00.254056 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.318920 (+ 64864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.855614 (+1536694us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b540020eed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:01.855812 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147333504}
I20260709 12:11:01.851214 20985 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.960753 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.808264 20571 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:01.895433 18006 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:11:01.961951 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.899507 20855 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:01.901778 20980 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 12:11:01.902598 20977 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:11:01.887323 20952 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.902848 20900 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:01.903489 20971 log.cc:927] Time spent T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:01.903816 20728 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:01.919459 17362 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.954775 20542 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.917548 17363 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 2.
I20260709 12:11:01.973477 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:01.931710 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.975560 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 137461us
I20260709 12:11:01.843896 20955 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:01.961570 17359 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:01.865814 20532 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.899206 20312 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.986057 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1743) took 1042 ms. Trace:
I20260709 12:11:01.986248 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:01.947670 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 283181us
I20260709 12:11:01.976758 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:01.880815 20843 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.980063 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:01.997073 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:01.967790 20856 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.975685 17404 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:01.986508 17440 rpcz_store.cc:276] 0709 12:11:00.943388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.949524 (+  6136us) service_pool.cc:224] Handling call
0709 12:11:00.949831 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.950075 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:01.235369 (+285294us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.971948 (+736579us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.985719 (+ 13771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.985770 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.985819 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.985881 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.986000 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17798,"prepare.queue_time_us":513093,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":299171,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5123,"thread_start_us":1020581,"threads_started":3,"wal-append.queue_time_us":477703}
I20260709 12:11:02.008028 17362 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:02.011723 18011 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:11:01.989753 20854 consensus_meta.cc:287] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.938s	user 0.012s	sys 0.000s
I20260709 12:11:01.983088 20571 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:02.016114 17434 raft_consensus.cc:2410] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:11:01.991119 20900 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.021590 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 44912us
I20260709 12:11:02.018455 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:02.024868 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:02.022125 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 46543.4us
I20260709 12:11:02.025784 17362 raft_consensus.cc:2410] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:02.026651 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:01.921288 20888 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.024561 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1762) took 1821 ms. Trace:
I20260709 12:11:01.988170 20998 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.964773 20985 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:01.972378 20952 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.026724 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:02.035912 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:01.983377 20901 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.027983 17361 rpcz_store.cc:276] 0709 12:11:00.203175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.049913 (+846738us) service_pool.cc:224] Handling call
0709 12:11:01.052032 (+  2119us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.108154 (+ 56122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.108198 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.112536 (+  4338us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.467118 (+354582us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:01.467164 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.467243 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.024337 (+557094us) raft_consensus.cc:1685] finished
0709 12:11:02.024358 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.024499 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14545,"raft.queue_time_us":58196,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3155,"thread_start_us":322957,"threads_started":1,"wal-append.queue_time_us":668270}
I20260709 12:11:02.034497 18007 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:02.027292 17407 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:01.985248 20542 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.040256 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:02.043601 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:02.045991 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1765) took 1831 ms. Trace:
I20260709 12:11:02.058606 17361 rpcz_store.cc:276] 0709 12:11:00.214811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.045153 (+1830342us) service_pool.cc:224] Handling call
0709 12:11:02.045468 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.045664 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.045691 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.045731 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:02.045786 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.045836 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.045933 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.062759 17362 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:02.071866 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 617) took 1121 ms. Trace:
I20260709 12:11:02.072315 17361 rpcz_store.cc:276] 0709 12:11:00.939096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.059755 (+1120659us) service_pool.cc:224] Handling call
0709 12:11:02.060283 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.060471 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.060497 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.060541 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:02.060580 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.060633 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.060759 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.011435 20856 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.075856 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 616) took 1124 ms. Trace:
I20260709 12:11:02.079568 17362 rpcz_store.cc:276] 0709 12:11:00.938820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.057707 (+1118887us) service_pool.cc:224] Handling call
0709 12:11:02.062447 (+  4740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.063136 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.063319 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.074173 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 619) took 1134 ms. Trace:
I20260709 12:11:02.081640 17361 rpcz_store.cc:276] 0709 12:11:00.939594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.073225 (+1133631us) service_pool.cc:224] Handling call
0709 12:11:02.073543 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.073731 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.073754 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.073798 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:02.073836 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.073895 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.074037 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.021930 20854 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.023756 20571 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.099993 17362 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:02.105083 17362 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:02.106209 17362 pending_rounds.cc:85] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:11:02.107939 17362 pending_rounds.cc:107] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:02.108609 17362 raft_consensus.cc:2889] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:02.107393 17361 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:02.115321 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1715) took 1823 ms. Trace:
I20260709 12:11:02.115768 17283 rpcz_store.cc:276] 0709 12:11:00.291462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.992240 (+700778us) service_pool.cc:224] Handling call
0709 12:11:01.006904 (+ 14664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.007135 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:01.431461 (+424326us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.114789 (+683328us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b1800436660. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f1222a30a40 00007f1222a2b4e4 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:11:02.114935 (+   146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.114985 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:02.115036 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.115112 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.115259 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2673,"prepare.queue_time_us":553638,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":7390,"spinlock_wait_cycles":2562944,"thread_start_us":503107,"threads_started":2,"wal-append.queue_time_us":322775}
I20260709 12:11:02.118247 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1716) took 1709 ms. Trace:
I20260709 12:11:02.118641 17287 rpcz_store.cc:276] 0709 12:11:00.408724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.170872 (+762148us) service_pool.cc:224] Handling call
0709 12:11:01.171188 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.171395 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:01.416227 (+244832us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.117877 (+701650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.117930 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:02.117976 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.118044 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.118188 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":553388,"prepare.queue_time_us":407886,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":373880,"threads_started":2,"wal-append.queue_time_us":421286}
I20260709 12:11:02.132323 20998 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:11:02.132869 20312 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:02.133495 20975 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:02.134583 20542 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
W20260709 12:11:02.134907 21002 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:11:02.135578 20992 log.cc:927] Time spent T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:11:02.136138 20532 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:02.136281 20958 consensus_meta.cc:287] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 12:11:02.136744 20958 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.137682 20952 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.097983 20608 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.138566 21006 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:02.138797 18008 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.139246 20901 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:02.098420 20706 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.139797 20854 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:02.122861 20919 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.142274 20571 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:02.144070 20997 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:11:02.144943 20991 log.cc:927] Time spent T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 12:11:02.145232 20503 consensus_meta.cc:287] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 12:11:02.133654 20888 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.152631 20313 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:02.153187 20985 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.153644 20924 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:02.153899 21007 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.154666 20978 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:02.155341 20978 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.158363 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:02.159751 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:02.160444 20963 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.161078 20963 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.162376 20312 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.162829 20312 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:02.163188 20312 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.164073 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 597) took 2322 ms. Trace:
I20260709 12:11:02.164481 17360 rpcz_store.cc:276] 0709 12:10:59.841988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.494745 (+652757us) service_pool.cc:224] Handling call
0709 12:11:00.724830 (+230085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.454154 (+729324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.163832 (+709678us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540040b5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:02.164008 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669579008}
I20260709 12:11:02.165645 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:02.166406 17434 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:11:02.166635 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.167163 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:02.167825 17432 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:11:02.168686 17255 leader_election.cc:400] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8.
I20260709 12:11:02.169034 17255 leader_election.cc:403] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:02.171100 20901 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.171841 20901 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.172235 20901 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:02.132807 20998 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.172621 20901 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.172695 20998 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:02.146134 17439 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:02.175056 20623 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.175334 20967 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.175551 20623 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.176584 20988 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.177088 20988 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.168682 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:02.178925 17441 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:02.161444 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:02.609717 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:02.375808 18015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 824) took 1899 ms (client timeout 1872 ms). Trace:
I20260709 12:11:02.202435 17360 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:02.610877 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:02.612511 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 568935us
I20260709 12:11:02.612818 17359 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:02.240659 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 183746us
I20260709 12:11:02.613633 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:02.543639 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.197626 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:02.211896 17433 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:02.180114 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:02.613106 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.459082 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 620) took 1960 ms. Trace:
I20260709 12:11:02.637125 17439 rpcz_store.cc:276] 0709 12:11:00.498592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.722180 (+223588us) service_pool.cc:224] Handling call
0709 12:11:00.722458 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.174454 (+1451996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.458743 (+284289us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000cb554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:02.458994 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3273281408}
I20260709 12:11:02.609091 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:02.635788 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 1.02268e+06us
I20260709 12:11:02.639734 17432 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.640916 17441 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:02.171841 17365 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:02.642462 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2596) took 1388 ms. Trace:
I20260709 12:11:02.643822 17288 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:02.643939 17290 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:02.612535 18015 rpcz_store.cc:269] 0709 12:11:00.480704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.480844 (+   140us) service_pool.cc:224] Handling call
0709 12:11:02.374256 (+1893412us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400573354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:02.375720 (+  1464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317291136}
W20260709 12:11:02.211710 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 184516us
I20260709 12:11:02.647435 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:02.365101 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.645762 17361 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:11:02.646180 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 466130us
I20260709 12:11:02.647758 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:02.649664 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.650365 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.653633 20993 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.654284 20993 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:02.655139 20730 consensus_meta.cc:287] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.000s
I20260709 12:11:02.654596 20849 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:02.655565 20730 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.655891 20849 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.120119 21001 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:02.656819 21001 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:02.657853 20778 consensus_meta.cc:287] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.004s
I20260709 12:11:02.657632 21001 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.659297 20849 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.660051 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:02.661235 17284 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:11:02.371585 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.008s
I20260709 12:11:02.663432 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:02.664043 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:02.664258 21007 consensus_meta.cc:287] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.510s	user 0.000s	sys 0.009s
I20260709 12:11:02.324123 20978 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.390908 20955 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.523293 20856 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.665510 20989 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:02.666617 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:02.710552 17359 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:02.711187 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 622) took 1457 ms. Trace:
I20260709 12:11:02.484776 20958 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.719313 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:02.721858 17283 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:11:02.671231 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:02.715967 17441 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:11:02.501794 20843 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.673548 17407 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:02.197700 20477 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.638222 20967 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.738318 20477 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:02.646802 20900 consensus_meta.cc:287] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.000s
I20260709 12:11:02.741683 17367 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:02.197409 20893 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.742920 20893 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.743995 20974 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.716s	user 0.003s	sys 0.000s
I20260709 12:11:02.461051 21003 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.744793 17432 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:02.746037 21003 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:02.197409 20928 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8.
I20260709 12:11:02.752821 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1777) took 1559 ms. Trace:
I20260709 12:11:02.753211 17361 rpcz_store.cc:276] 0709 12:11:01.193336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.121488 (+928152us) service_pool.cc:224] Handling call
0709 12:11:02.639076 (+517588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.654287 (+ 15211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.752622 (+ 98335us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540014a0d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:02.752753 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189343616}
I20260709 12:11:02.758643 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 833) took 2042 ms. Trace:
I20260709 12:11:02.711361 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:02.263533 20864 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:02.642998 17365 rpcz_store.cc:276] 0709 12:11:01.253871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.171251 (+917380us) service_pool.cc:224] Handling call
0709 12:11:02.171523 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.642140 (+470617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.642398 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.711426 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:02.653975 20986 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.712607 17360 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 12:11:02.712643 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.010s	sys 0.027s
W20260709 12:11:02.673022 20855 consensus_meta.cc:287] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.000s
I20260709 12:11:02.646287 20903 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.711542 17359 rpcz_store.cc:276] 0709 12:11:01.253557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.017626 (+764069us) service_pool.cc:224] Handling call
0709 12:11:02.460216 (+442590us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6a22 00007f122b90f8d9 00007f122aa69ee0 00007f122ab330ab 00007f122ab33131 00007f122aae10a0 00007f122aae0984 00007f122405b6d4 00007f122405b662
0709 12:11:02.711125 (+250909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3291520}
I20260709 12:11:02.762053 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1764) took 2555 ms. Trace:
I20260709 12:11:02.227612 20985 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.728600 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 92521.1us
I20260709 12:11:02.727591 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:02.226500 20924 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:02.645768 20842 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:02.747947 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:02.750950 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:02.760936 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.672323 20999 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.760145 17284 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:11:02.763814 17292 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:02.763711 17367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2599) took 1458 ms (client timeout 1755 ms). Trace:
W20260709 12:11:02.782137 17367 rpcz_store.cc:269] 0709 12:11:01.305700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.471771 (+166071us) service_pool.cc:224] Handling call
0709 12:11:02.763538 (+1291767us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400291dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:02.763653 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2918232320}
I20260709 12:11:02.758982 18008 rpcz_store.cc:276] 0709 12:11:00.716205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.890805 (+174600us) service_pool.cc:224] Handling call
0709 12:11:00.891178 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.139279 (+1248101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.758383 (+619104us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400633dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:02.758579 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868749056}
I20260709 12:11:02.703572 20623 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:02.765695 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.727984 20312 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.002s
I20260709 12:11:02.705150 20987 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.761991 20864 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:02.711716 21007 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:02.789922 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 116438us
I20260709 12:11:02.771968 17291 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:11:02.772393 17255 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:02.768273 17358 rpcz_store.cc:276] 0709 12:11:00.206919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.103862 (+896943us) service_pool.cc:224] Handling call
0709 12:11:01.104290 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:01.138382 (+ 34092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.138415 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:01.151597 (+ 13182us) log.cc:844] Serialized 52 byte log entry
0709 12:11:01.474072 (+322475us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.474139 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.474213 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.743380 (+1269167us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:02.746758 (+  3378us) raft_consensus.cc:1685] finished
0709 12:11:02.746778 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.761978 (+ 15200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12142,"raft.queue_time_us":13236,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":13622,"spinlock_wait_cycles":4082048,"thread_start_us":298673,"threads_started":1,"wal-append.queue_time_us":812516}
W20260709 12:11:02.773975 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 55865.1us
W20260709 12:11:02.770376 20313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.023s
I20260709 12:11:02.776423 17433 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:02.777598 20843 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.779366 17365 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:02.758184 20909 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.676272 20608 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:11:02.771838 20903 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:02.784365 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 113208us
I20260709 12:11:02.797361 21014 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:02.798920 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:02.762509 21003 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.751726 20837 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:02.762188 20963 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.767712 20841 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.791953 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:02.775275 20855 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.787029 21011 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.807884 17361 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:02.778357 20886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.922s	user 0.017s	sys 0.026s
I20260709 12:11:02.776669 17286 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.759179 20849 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:11:02.795496 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2600) took 1471 ms. Trace:
I20260709 12:11:02.746181 20989 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.814333 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:02.793063 20313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.000s	sys 0.023s
I20260709 12:11:02.773758 20985 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.812049 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:02.812583 17404 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:02.788373 20987 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.818689 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:02.814950 17439 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:02.797667 20999 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:02.814733 17365 rpcz_store.cc:276] 0709 12:11:01.324355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.760806 (+1436451us) service_pool.cc:224] Handling call
0709 12:11:02.779236 (+ 18430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.795295 (+ 16059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.795451 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.799527 20903 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.821277 17363 raft_consensus.cc:2393] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:02.787256 20842 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.807825 20955 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.833472 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:02.813671 20901 consensus_meta.cc:287] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.005s
I20260709 12:11:02.790194 20312 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.821640 20987 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.834227 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:02.815863 21015 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.840198 17439 raft_consensus.cc:2368] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
W20260709 12:11:02.818817 20886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.968s	user 0.017s	sys 0.026s
I20260709 12:11:02.799785 20909 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.813110 20841 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.797789 20843 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.845388 17438 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:02.818888 21007 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:02.829182 20503 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.808727 20837 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.841045 20958 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:02.867825 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.818622 20924 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.871063 20841 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.872921 20985 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.874375 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 635) took 1174 ms. Trace:
I20260709 12:11:02.874516 20855 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.875226 20855 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:02.875566 20837 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.876081 20842 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.877156 20989 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.847373 21015 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.836994 21017 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:11:02.815336 20864 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.840181 20955 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.880853 20312 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:02.881248 20955 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:02.848999 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:02.880755 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:02.867691 17286 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:02.879480 21015 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:02.883605 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 43614.5us
I20260709 12:11:02.874792 17436 rpcz_store.cc:276] 0709 12:11:01.699849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.849039 (+149190us) service_pool.cc:224] Handling call
0709 12:11:01.849432 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.980531 (+131099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.980582 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.981053 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.327660 (+346607us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:02.327709 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.327792 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.874175 (+546383us) raft_consensus.cc:1685] finished
0709 12:11:02.874194 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.874314 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161198,"raft.queue_time_us":149033,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":133416,"thread_start_us":442692,"threads_started":2,"wal-append.queue_time_us":804705}
I20260709 12:11:02.889582 17437 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:02.857640 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:02.883740 17434 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 4.
I20260709 12:11:02.843340 20886 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:02.950512 17361 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:02.973321 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:02.841472 20901 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:02.881902 20955 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.979458 20886 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:02.971674 21010 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:02.983201 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.039463 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:03.042788 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 178341us
I20260709 12:11:03.051913 17404 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:03.043758 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:03.055760 17439 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.879473 20864 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.892330 20999 raft_consensus.cc:697] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:03.067134 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:03.067814 17438 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
W20260709 12:11:03.085229 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 434159us
W20260709 12:11:03.088160 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.089401 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:03.085119 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:02.886209 20728 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.181s
W20260709 12:11:03.093564 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.086694 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 421986us
I20260709 12:11:02.888630 21012 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.205s
I20260709 12:11:03.100819 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:03.086771 20986 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:03.090641 20958 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.108158 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.131928 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.132761 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.126588 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:03.072324 21015 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.102025 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:03.129988 17361 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:03.130226 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:03.128113 20998 consensus_meta.cc:287] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.952s	user 0.011s	sys 0.000s
I20260709 12:11:03.052627 20955 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:03.136873 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.060912 21010 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:03.121913 17439 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:03.144505 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:03.144384 17434 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
W20260709 12:11:03.146623 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.143358 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 381657us
W20260709 12:11:03.148528 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 354366us
I20260709 12:11:03.156724 20928 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:03.158987 20928 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:03.160969 17255 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:03.161864 20928 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.135329 20993 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:03.149780 21013 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.182682 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2598) took 1882 ms. Trace:
I20260709 12:11:03.185344 17360 rpcz_store.cc:276] 0709 12:11:01.300283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.667142 (+1366859us) service_pool.cc:224] Handling call
0709 12:11:02.712379 (+ 45237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.762604 (+ 50225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.182428 (+419824us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54002df350. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:03.182604 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103259904}
I20260709 12:11:03.187006 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:03.189888 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:03.181794 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 60203.8us
I20260709 12:11:03.165714 21012 raft_consensus.cc:3055] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:03.199551 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:03.200219 17358 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:03.201423 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.203127 17285 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:03.203325 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.204051 17288 raft_consensus.cc:2393] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:03.210027 17255 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:03.210314 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:03.210862 17358 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:03.214614 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.216105 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.216785 17285 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:03.217891 17364 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.218158 17434 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:11:03.219081 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.223579 17288 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:03.224501 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.225162 17288 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:03.229113 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:03.229981 17365 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:03.170634 20928 consensus_queue.cc:1059] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:11:03.232038 20477 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:03.145442 20958 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.232218 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:03.232695 21021 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:03.233546 21001 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.234303 20718 raft_consensus.cc:3055] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.234683 21021 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.235205 21021 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.235888 20843 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:03.236990 20843 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.237205 21021 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:03.237761 21021 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:03.194806 21013 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.238451 21027 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:03.240310 21013 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:03.240880 21013 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:03.241437 20901 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:03.218717 21012 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:03.242823 21012 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.244345 21012 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:03.246265 17291 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:03.247426 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.248661 20909 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:03.249826 20928 raft_consensus.cc:3055] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:03.250087 21040 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:03.217604 20842 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:03.251021 20842 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:03.218998 20999 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.150183 21015 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.246280 17360 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:03.226008 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.219724 17358 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 3.
I20260709 12:11:03.149037 20998 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:03.264413 17978 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.582s (SENT)
I20260709 12:11:03.248641 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:03.267073 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.270650 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.271543 17285 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:11:03.273054 17285 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:11:03.273952 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 118760us
I20260709 12:11:03.275569 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:03.276818 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:03.265915 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.278123 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:03.264771 17292 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:03.295373 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:03.296128 17283 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:03.267881 17288 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:03.298982 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:03.299858 17358 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:03.300680 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:03.301491 17358 raft_consensus.cc:2410] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:03.232575 20728 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.234208 21010 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:03.217381 20989 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.242698 21024 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:03.315325 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 118005us
I20260709 12:11:03.317636 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:03.319810 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:03.321930 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:03.316318 21021 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.322968 18009 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:03.333588 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:03.258329 20886 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:03.323611 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:03.324198 21041 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:03.325145 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 115183us
I20260709 12:11:03.255115 20928 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:03.326323 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:03.343559 17365 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:03.325909 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:03.326294 20924 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.328298 20477 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:03.330598 20842 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:03.309404 21029 raft_consensus.cc:3055] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.234689 20718 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:03.233951 20955 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:03.327188 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:03.362583 17367 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:03.326635 20542 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:03.323390 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:03.319262 20778 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:03.334990 17980 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:03.339146 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1746) took 1961 ms. Trace:
I20260709 12:11:03.340378 18007 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
W20260709 12:11:03.346977 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 179488us
I20260709 12:11:03.349541 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:03.330811 21026 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:03.296339 20843 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.330884 21043 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:03.318316 20986 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:03.332917 21024 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:03.358314 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 81730us
I20260709 12:11:03.436161 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:03.462357 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 127428us
I20260709 12:11:03.463059 17980 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:03.465773 18015 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:11:03.466471 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 116987us
I20260709 12:11:03.468660 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:03.466640 17435 rpcz_store.cc:276] 0709 12:11:01.377374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.377508 (+   134us) service_pool.cc:224] Handling call
0709 12:11:01.377839 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.378124 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:01.550878 (+172754us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.703483 (+152605us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.841772 (+138289us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.143472 (+301700us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b180039a4e0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f122aa44328 00007f122aa3b901 00007f122aa3b8a7 00007f122ab33288 00007f122ab32f37 00007f122ab4755c 00007f122ab47508
0709 12:11:03.149844 (+1006372us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.318160 (+168316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:03.318524 (+   364us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:03.318802 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.338734 (+ 19932us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.339014 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":313145,"prepare.queue_time_us":691715,"prepare.run_cpu_time_us":157,"prepare.run_wall_time_us":163,"raft.queue_time_us":583924,"raft.run_cpu_time_us":2776,"raft.run_wall_time_us":452438,"spinlock_wait_cycles":13422976,"thread_start_us":1877670,"threads_started":6,"wal-append.queue_time_us":415512,"wal-append.run_cpu_time_us":2468,"wal-append.run_wall_time_us":1178346}
I20260709 12:11:03.475841 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:03.477296 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:03.478785 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.477952 17435 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:11:03.479948 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:03.478542 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 134165us
W20260709 12:11:03.460785 20903 consensus_meta.cc:287] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.001s
I20260709 12:11:03.598572 17435 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:03.348634 20924 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.599936 17332 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:03.335049 20728 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:11:03.601518 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 124104us
I20260709 12:11:03.651640 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:03.694578 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 94701.6us
I20260709 12:11:03.695426 17332 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:03.623003 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.696274 17332 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:03.398152 20886 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:03.354082 20478 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:03.698683 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 47417.8us
I20260709 12:11:03.479981 21033 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.745359 21033 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:03.745965 21033 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.437543 20920 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.749415 20920 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.361915 21029 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:03.749987 20920 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.750620 20920 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.750867 21029 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.752058 21029 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.339540 20989 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.461788 21026 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:03.597811 20837 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:03.421594 20958 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:03.361352 21015 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:03.422941 21020 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.338s
W20260709 12:11:03.735898 21048 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
W20260709 12:11:03.736662 21011 consensus_meta.cc:287] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.920s	user 0.008s	sys 0.003s
I20260709 12:11:03.738201 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:03.872502 17435 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:03.597757 20928 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:03.739140 20886 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.731506 20903 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.698897 20924 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.740222 20728 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:03.744097 21043 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.745311 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:03.464685 20998 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:03.895938 21043 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.629001 21021 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:03.867502 17333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.001s	sys 0.006s
I20260709 12:11:03.629568 20909 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.629323 21046 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:03.896649 21021 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.897446 21021 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.897094 21046 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.871549 20837 raft_consensus.cc:697] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:03.897837 21021 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.898229 21021 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.876762 21011 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.881008 21053 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:03.899434 21053 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.899813 21053 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.900137 17440 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:03.882138 20903 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:03.886698 20893 consensus_meta.cc:287] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.143s	user 0.005s	sys 0.006s
I20260709 12:11:03.901283 20900 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.901139 20837 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.901791 20900 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:03.883244 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.874665 20886 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:03.895413 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.896596 17333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.001s	sys 0.006s
I20260709 12:11:03.903077 17366 raft_consensus.cc:2410] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:11:03.883338 21049 log.cc:927] Time spent T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:11:03.897024 20909 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:03.894759 20503 consensus_meta.cc:287] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.010s	user 0.007s	sys 0.002s
I20260709 12:11:03.526456 20778 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:03.904428 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 252858us
W20260709 12:11:03.907933 17358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.022s
I20260709 12:11:03.907984 20886 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.939528 20503 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:03.962570 17358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.011s	sys 0.031s
I20260709 12:11:03.960494 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:03.964905 17435 raft_consensus.cc:2410] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:11:03.908537 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 163332us
I20260709 12:11:03.968356 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:03.967411 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 689319us
I20260709 12:11:03.970031 17333 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:03.966483 17981 leader_election.cc:400] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
I20260709 12:11:03.972182 17981 leader_election.cc:403] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:03.976853 17333 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:03.896387 21043 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.869189 21051 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:03.979597 17436 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:03.973575 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:03.964962 20987 consensus_meta.cc:287] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.118s	user 0.005s	sys 0.008s
I20260709 12:11:03.986408 20987 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.988708 20987 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:03.658416 20718 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:03.993628 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:03.995744 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 646190us
I20260709 12:11:03.996658 17255 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:03.998870 17255 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:03.871421 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 175108us
I20260709 12:11:04.002259 17435 raft_consensus.cc:2393] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 3: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:03.939248 20903 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.098687 20920 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:03.978968 20993 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:03.873415 21041 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 12:11:03.877005 20978 consensus_queue.cc:1059] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
W20260709 12:11:04.115728 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.000s	sys 0.016s
I20260709 12:11:03.978214 20893 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.117123 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.147722 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:04.118479 17286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.028s	sys 0.048s
W20260709 12:11:04.148895 17286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.029s	sys 0.061s
W20260709 12:11:03.995009 21003 consensus_meta.cc:287] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.185s	user 0.012s	sys 0.001s
I20260709 12:11:04.129558 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:04.118228 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:04.118866 17439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.013s	sys 0.032s
W20260709 12:11:04.178191 17439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.017s	sys 0.033s
I20260709 12:11:04.099795 20841 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:04.187345 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:04.140970 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:04.142817 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.000s	sys 0.016s
I20260709 12:11:04.117376 21062 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:04.174752 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.117435 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.001490 20478 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:04.188700 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 725648us
I20260709 12:11:04.225031 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.229960 17283 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:11:04.266721 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.269500 18009 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:04.269609 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:04.164165 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:04.186785 20841 raft_consensus.cc:697] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:04.196177 21060 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.274164 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.274619 18015 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:04.274853 17283 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:04.199874 20920 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:04.116694 21042 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:04.114305 20993 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:04.271862 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 107805us
I20260709 12:11:04.272641 20909 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:04.273597 18008 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 11: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:04.273334 20841 consensus_queue.cc:237] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:04.291464 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:03.904625 20986 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:04.310570 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.311651 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:04.312192 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.296892 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 298071us
I20260709 12:11:04.273913 20893 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:04.180102 20903 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.114185 20955 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 12:11:04.299255 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:04.304487 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.312618 17285 raft_consensus.cc:2410] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:04.296298 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1789) took 1087 ms. Trace:
I20260709 12:11:04.314968 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:04.344807 20999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.011s	sys 0.016s
I20260709 12:11:04.276721 20718 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.367237 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:04.234308 21062 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:04.331985 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.378754 17284 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:04.304587 21042 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:04.228600 20478 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:04.335635 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 636) took 1524 ms. Trace:
I20260709 12:11:03.992697 21026 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:04.341254 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 355907us
I20260709 12:11:04.444262 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:04.304491 20993 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.004313 21051 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:04.346336 18013 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:11:04.368739 20999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.011s	sys 0.016s
I20260709 12:11:04.368505 20909 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:04.355363 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.469045 20864 consensus_meta.cc:287] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.400s	user 0.012s	sys 0.001s
W20260709 12:11:04.362816 17363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2605) took 2219 ms (client timeout 1806 ms). Trace:
I20260709 12:11:04.310004 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:04.495528 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:04.464800 20478 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.363572 17359 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:04.188959 21003 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:04.367130 17361 rpcz_store.cc:276] 0709 12:11:03.208719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.438737 (+230018us) service_pool.cc:224] Handling call
0709 12:11:03.599202 (+160465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.599408 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:03.882160 (+282752us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.295921 (+413761us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.295974 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:04.296019 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.296086 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.296229 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":389982,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":1878,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11627,"thread_start_us":585245,"threads_started":2}
W20260709 12:11:04.365397 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 66228.1us
W20260709 12:11:04.418396 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.438416 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:04.497783 18011 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:04.354584 20903 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.448278 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:04.397089 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.500854 17284 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:04.438733 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:04.332901 21050 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:11:04.480288 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.502727 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:04.473781 21026 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.203002 21044 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 12:11:04.369203 20988 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:04.466296 17433 rpcz_store.cc:276] 0709 12:11:02.810973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.811107 (+   134us) service_pool.cc:224] Handling call
0709 12:11:02.830079 (+ 18972us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:02.846850 (+ 16771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.846883 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:02.861565 (+ 14682us) log.cc:844] Serialized 52 byte log entry
0709 12:11:03.170227 (+308662us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:03.170270 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.170343 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.335397 (+1165054us) raft_consensus.cc:1685] finished
0709 12:11:04.335417 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.335566 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6468,"raft.queue_time_us":18804,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2972,"thread_start_us":299689,"threads_started":1,"wal-append.queue_time_us":1133148}
W20260709 12:11:04.493677 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.389710 21062 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.449071 20989 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:04.495890 18008 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.366987 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 655) took 1704 ms. Trace:
I20260709 12:11:04.491556 21071 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.499163 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:04.474684 21017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.239s	user 0.012s	sys 0.006s
I20260709 12:11:04.467303 21064 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.363571 21066 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.158s
I20260709 12:11:04.505119 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:04.503923 18013 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
W20260709 12:11:04.504397 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 60218.9us
I20260709 12:11:04.368386 20920 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:04.498251 17363 rpcz_store.cc:269] 0709 12:11:02.143167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.159496 (+ 16329us) service_pool.cc:224] Handling call
0709 12:11:04.362563 (+2203067us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b540014a5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:04.362732 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519660928}
I20260709 12:11:04.347234 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1664) took 1002 ms. Trace:
I20260709 12:11:04.724970 17292 raft_consensus.cc:2410] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:11:04.557490 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:04.915155 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.043485 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.511142 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.040297 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.533159 17433 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.050979 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1667) took 1704 ms. Trace:
I20260709 12:11:04.503283 20903 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.977226 20718 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.692396 21031 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 12:11:04.500109 20987 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:05.039531 20924 consensus_meta.cc:287] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.143s	user 0.007s	sys 0.003s
I20260709 12:11:05.118482 20987 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:05.042019 20920 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.615017 21050 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:05.042132 21017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.806s	user 0.013s	sys 0.018s
I20260709 12:11:05.118243 21044 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.120285 21044 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:04.691208 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.018978 21079 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.399s	user 0.000s	sys 0.000s
W20260709 12:11:04.625804 21021 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.001s
W20260709 12:11:05.000303 21056 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.017s	sys 0.040s
W20260709 12:11:05.172495 21056 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.017s	sys 0.040s
W20260709 12:11:05.172947 21060 consensus_meta.cc:287] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.899s	user 0.009s	sys 0.000s
I20260709 12:11:05.173413 21060 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
I20260709 12:11:04.722630 21024 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.117900 21070 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.193589 21070 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:05.195318 18008 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
W20260709 12:11:05.195982 21026 consensus_meta.cc:287] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.686s	user 0.006s	sys 0.002s
I20260709 12:11:05.196415 21070 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:04.553278 21065 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:11:04.495256 20909 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:05.198243 21053 consensus_meta.cc:287] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.298s	user 0.009s	sys 0.001s
I20260709 12:11:05.198735 21053 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.199816 20909 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:05.119081 20924 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:04.691305 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.101022 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.117583 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:05.201290 21053 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:05.201890 20924 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.151993 21044 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.173939 21003 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:05.117527 20718 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:05.051890 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 552775us
I20260709 12:11:05.095351 21071 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.131578 17433 rpcz_store.cc:276] 0709 12:11:03.346174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.532587 (+1186413us) service_pool.cc:224] Handling call
0709 12:11:04.532959 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.050680 (+517721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.050914 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.098767 17435 rpcz_store.cc:276] 0709 12:11:03.344934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.114694 (+769760us) service_pool.cc:224] Handling call
0709 12:11:04.175113 (+ 60419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.175351 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:04.230284 (+ 54933us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.346839 (+116555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.346899 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:04.346953 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.347029 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.347168 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73943,"prepare.queue_time_us":97597,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":100,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":7891,"thread_start_us":116006,"threads_started":1,"wal-append.queue_time_us":254373}
I20260709 12:11:05.213608 20909 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.214392 21003 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:05.214597 20909 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:05.214908 21003 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:04.718564 21067 log.cc:927] Time spent T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 12:11:05.148484 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.149329 17284 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:05.038960 21033 consensus_meta.cc:287] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.293s	user 0.005s	sys 0.005s
I20260709 12:11:05.214318 20924 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.216815 21033 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:05.217334 20924 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.218636 20718 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:05.097851 17289 rpcz_store.cc:276] 0709 12:11:02.662526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.717094 (+ 54568us) service_pool.cc:224] Handling call
0709 12:11:02.717474 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.837594 (+120120us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:03.129842 (+292248us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.184557 (+ 54715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:03.184605 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:03.184648 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.366740 (+1182092us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002ae9d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:04.366788 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.366927 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32693,"prepare.queue_time_us":397636,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":47,"raft.queue_time_us":106,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3959,"spinlock_wait_cycles":431875840,"thread_start_us":346324,"threads_started":2,"wal-append.queue_time_us":110202}
W20260709 12:11:05.220331 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 179212us
I20260709 12:11:05.226191 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:05.226958 17433 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:05.228070 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:05.228884 17433 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 11: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:05.025686 21043 consensus_meta.cc:287] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.030s	user 0.007s	sys 0.000s
I20260709 12:11:05.159417 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:04.994285 21080 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.717732 21063 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 12:11:05.261386 17283 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
W20260709 12:11:04.624673 21076 log.cc:927] Time spent T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:05.120745 21050 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.171594 21021 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:05.268076 17981 connection.cc:256] RPC call timeout handler was delayed by -1.2292352230001597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 12:11:05.269456 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.271623 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.272123 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:05.121266 21001 consensus_meta.cc:287] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.887s	user 0.004s	sys 0.009s
W20260709 12:11:04.554879 21068 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:05.019973 21042 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:05.119755 20920 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:05.150019 20886 consensus_meta.cc:287] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.187s	user 0.002s	sys 0.009s
W20260709 12:11:05.191118 21037 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.912s	user 0.022s	sys 0.021s
I20260709 12:11:05.193034 21024 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.210606 17285 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:05.211808 17333 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:05.299955 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 88241.5us
I20260709 12:11:05.300786 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:05.215099 21071 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.216362 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2550) took 1087 ms. Trace:
I20260709 12:11:05.303619 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 815) took 3698 ms. Trace:
I20260709 12:11:05.303756 17284 rpcz_store.cc:276] 0709 12:11:04.129310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.148683 (+1019373us) service_pool.cc:224] Handling call
0709 12:11:05.149110 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.216083 (+ 66973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.216289 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:05.036780 21012 consensus_meta.cc:287] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.792s	user 0.012s	sys 0.002s
W20260709 12:11:05.217427 21057 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.707s	user 0.000s	sys 0.001s
I20260709 12:11:05.237528 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:05.261404 17979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.027s	sys 0.016s
W20260709 12:11:05.307576 17979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.027s	sys 0.016s
W20260709 12:11:05.308423 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.307768 17433 raft_consensus.cc:2393] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:11:05.308787 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.263990 17406 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.005s	sys 0.013s
I20260709 12:11:05.265179 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:05.309528 17978 connection.cc:256] RPC call timeout handler was delayed by -1.7396873719999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23130000000000003s for a response
W20260709 12:11:05.310009 17978 connection.cc:256] RPC call timeout handler was delayed by -1.6893809179998698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 12:11:05.214341 21072 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
W20260709 12:11:05.310386 17978 connection.cc:256] RPC call timeout handler was delayed by -1.6272203900000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 12:11:05.310662 17406 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.005s	sys 0.013s
I20260709 12:11:05.280004 17283 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:05.262529 21029 consensus_meta.cc:287] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.510s	user 0.011s	sys 0.003s
I20260709 12:11:05.281191 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:05.283278 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:05.279709 18008 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:05.311836 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 658) took 1102 ms. Trace:
I20260709 12:11:05.230831 20987 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:05.304425 21026 raft_consensus.cc:2764] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:11:05.297662 18012 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.314947 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.315692 18014 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:05.316114 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 608) took 5144 ms. Trace:
I20260709 12:11:05.267307 21050 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.151414 21064 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.310019 17435 raft_consensus.cc:2410] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:05.316524 17364 rpcz_store.cc:276] 0709 12:11:00.172174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.720595 (+548421us) service_pool.cc:224] Handling call
0709 12:11:00.720890 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.223009 (+2502119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.315803 (+2092794us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b54003c5854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:05.316002 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5742047104}
I20260709 12:11:05.318054 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1793) took 2108 ms. Trace:
I20260709 12:11:05.219156 21033 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:05.311137 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 809247us
I20260709 12:11:05.320817 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2551) took 1191 ms. Trace:
I20260709 12:11:05.312175 17283 rpcz_store.cc:276] 0709 12:11:04.209508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.262680 (+1053172us) service_pool.cc:224] Handling call
0709 12:11:05.279838 (+ 17158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.311583 (+ 31745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.311769 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.305614 18010 rpcz_store.cc:276] 0709 12:11:01.605354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.605515 (+   161us) service_pool.cc:224] Handling call
0709 12:11:02.374412 (+768897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.374665 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:02.787229 (+412564us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.318859 (+531630us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.319161 (+   302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:03.319202 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:03.319240 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.319298 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.303389 (+1984091us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b5400573350. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:05.303540 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16663,"prepare.queue_time_us":451825,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3094,"raft.queue_time_us":109313,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":182,"spinlock_wait_cycles":1697821056,"thread_start_us":941981,"threads_started":3,"wal-append.queue_time_us":910539,"wal-append.run_cpu_time_us":1506,"wal-append.run_wall_time_us":1245937}
I20260709 12:11:05.281618 20924 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:05.320631 18006 raft_consensus.cc:2410] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:05.321321 17285 rpcz_store.cc:276] 0709 12:11:04.129583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.201824 (+1072241us) service_pool.cc:224] Handling call
0709 12:11:05.210263 (+  8439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.299153 (+ 88890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.320730 (+ 21577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.312369 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.318547 17358 rpcz_store.cc:276] 0709 12:11:03.214216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.965278 (+751062us) service_pool.cc:224] Handling call
0709 12:11:03.965626 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.965974 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.966000 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.966483 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:11:04.379358 (+412875us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:04.379402 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.379476 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.317842 (+938366us) raft_consensus.cc:1685] finished
0709 12:11:05.317864 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.317993 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2456,"raft.queue_time_us":8781,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":10597,"thread_start_us":232225,"threads_started":1,"wal-append.queue_time_us":520680}
I20260709 12:11:05.291929 20503 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.326766 18008 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:05.216741 20909 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:05.341979 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.071s	sys 0.072s
W20260709 12:11:05.342607 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.071s	sys 0.072s
I20260709 12:11:05.343986 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1719) took 2143 ms. Trace:
I20260709 12:11:05.344977 17435 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:05.345790 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 481258us
W20260709 12:11:05.216732 20478 consensus_meta.cc:287] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.000s
I20260709 12:11:05.344486 17286 rpcz_store.cc:276] 0709 12:11:03.200418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.202304 (+  1886us) service_pool.cc:224] Handling call
0709 12:11:03.202643 (+   339us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:03.217868 (+ 15225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.217896 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:03.264362 (+ 46466us) log.cc:844] Serialized 78 byte log entry
0709 12:11:04.149345 (+884983us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:04.472476 (+323131us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.480929 (+  8453us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.481360 (+   431us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.343478 (+862118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.343688 (+   210us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.343736 (+    48us) raft_consensus.cc:1685] finished
0709 12:11:05.343751 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.343922 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14789,"prepare.queue_time_us":2346931,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":2688,"raft.queue_time_us":105284,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":47608,"spinlock_wait_cycles":28927232,"thread_start_us":1953925,"threads_started":3,"wal-append.queue_time_us":986601}
W20260709 12:11:05.350940 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 69823.6us
W20260709 12:11:05.352396 17978 connection.cc:256] RPC call timeout handler was delayed by -1.1718203899999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260709 12:11:05.353004 17978 connection.cc:256] RPC call timeout handler was delayed by -1.1455234420000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3225s for a response
I20260709 12:11:05.356226 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:05.358175 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:05.358930 17286 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:11:05.264775 21043 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:05.361493 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:05.362247 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:05.362844 17285 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.363806 17258 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:05.322470 20967 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.325819 21003 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:05.364476 17283 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:11:05.365001 18009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.006s	sys 0.014s
I20260709 12:11:05.266363 21080 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.297156 20886 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:05.343622 21070 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:05.369223 18009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.006s	sys 0.014s
W20260709 12:11:05.348943 20841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.010s	sys 0.010s
I20260709 12:11:05.347637 20542 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:05.374356 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 51239.6us
I20260709 12:11:05.375413 17435 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.376654 18011 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:05.359592 21029 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:05.379073 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.380532 18015 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.001s	sys 0.011s
W20260709 12:11:05.380853 18015 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.001s	sys 0.011s
I20260709 12:11:05.347537 20478 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:05.536814 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.536676 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 53486.1us
W20260709 12:11:05.548062 17978 leader_election.cc:336] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 2.313s (SENT)
I20260709 12:11:05.548530 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:05.361562 21083 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.552418 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 791) took 1267 ms. Trace:
I20260709 12:11:05.350253 20503 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.552791 18015 rpcz_store.cc:276] 0709 12:11:04.284769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.284911 (+   142us) service_pool.cc:224] Handling call
0709 12:11:04.305957 (+ 21046us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:04.313312 (+  7355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.313351 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:04.316747 (+  3396us) log.cc:844] Serialized 52 byte log entry
0709 12:11:04.478119 (+161372us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:05.534701 (+1056582us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.552078 (+ 17377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.552158 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.552197 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:05.552207 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.552351 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7169,"raft.queue_time_us":251000,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":28587,"thread_start_us":1144607,"threads_started":2,"wal-append.queue_time_us":319847}
I20260709 12:11:05.378888 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:05.570412 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1651) took 2587 ms. Trace:
I20260709 12:11:05.367964 21087 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:05.376791 21033 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.574956 17439 rpcz_store.cc:276] 0709 12:11:02.951800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.165061 (+213261us) service_pool.cc:224] Handling call
0709 12:11:03.165431 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.165799 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:03.335769 (+169970us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.178719 (+842950us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:04.179225 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:11:04.179402 (+   177us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:04.179435 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.179501 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.538704 (+1359203us) raft_consensus.cc:1685] finished
0709 12:11:05.538732 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.538895 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74901,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":84491,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":166,"thread_start_us":911781,"threads_started":2,"wal-append.queue_time_us":974269}
I20260709 12:11:05.583274 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1655) took 2630 ms. Trace:
I20260709 12:11:05.381399 20542 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:05.619407 17406 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:05.583801 17434 rpcz_store.cc:276] 0709 12:11:02.952924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.223681 (+270757us) service_pool.cc:224] Handling call
0709 12:11:03.224059 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:03.273359 (+ 49300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.273398 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:03.304187 (+ 30789us) log.cc:844] Serialized 52 byte log entry
0709 12:11:03.602426 (+298239us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:03.602515 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.602611 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.582991 (+1980380us) raft_consensus.cc:1685] finished
0709 12:11:05.583018 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.583202 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5449,"raft.queue_time_us":18113,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":58,"thread_start_us":239174,"threads_started":1,"wal-append.queue_time_us":1040839}
I20260709 12:11:05.620752 17288 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:11:05.553956 20841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.010s	sys 0.010s
W20260709 12:11:05.624034 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 245189us
W20260709 12:11:05.632838 17332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.632s	user 0.019s	sys 0.048s
W20260709 12:11:05.633183 17332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.633s	user 0.019s	sys 0.048s
W20260709 12:11:05.633445 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 1.63301e+06us
W20260709 12:11:05.642966 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.643841 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.642561 17980 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.012s	sys 0.012s
W20260709 12:11:05.644956 17980 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.012s	sys 0.012s
W20260709 12:11:05.645318 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 603656us
I20260709 12:11:05.572310 21083 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.625231 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:05.574457 21066 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.634825 17332 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:05.535305 20842 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:11:05.538555 21060 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.094s
W20260709 12:11:05.669603 17441 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 638) took 2854 ms (client timeout 3371 ms). Trace:
I20260709 12:11:05.537747 21086 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.280s
I20260709 12:11:05.380059 21070 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:05.662068 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:05.692030 20987 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.694204 17406 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:05.670063 17441 rpcz_store.cc:269] 0709 12:11:02.811564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.811704 (+   140us) service_pool.cc:224] Handling call
0709 12:11:05.665537 (+2853833us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400162454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:05.665670 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3854716672}
I20260709 12:11:05.631166 20909 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.642149 21003 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:05.661933 21082 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:11:05.642167 21077 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.006s	sys 0.017s
W20260709 12:11:05.696969 21077 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.007s	sys 0.017s
I20260709 12:11:05.698197 21003 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:05.538350 21029 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:05.699025 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.700629 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:05.646077 20730 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 3 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.676277 21012 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:05.659763 21083 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.711071 21012 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:05.713217 21012 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:05.714428 21003 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.714931 21003 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.715312 21003 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.717067 21051 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:05.719408 20478 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:05.720494 20843 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.723074 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1781) took 2544 ms. Trace:
I20260709 12:11:05.723485 17359 rpcz_store.cc:276] 0709 12:11:03.178398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.178513 (+   115us) service_pool.cc:224] Handling call
0709 12:11:04.363383 (+1184870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.496342 (+132959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.722845 (+1226503us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540014a5d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:05.723000 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724078976}
I20260709 12:11:05.725075 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 798) took 1379 ms. Trace:
I20260709 12:11:05.725490 18006 rpcz_store.cc:276] 0709 12:11:04.345996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.346170 (+   174us) service_pool.cc:224] Handling call
0709 12:11:05.724865 (+1378695us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b540050d054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:05.725008 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187095936}
I20260709 12:11:05.731487 21046 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:05.733793 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.736984 21070 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:05.679998 18007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.034s	sys 0.065s
I20260709 12:11:05.680325 20900 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.681226 18011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 805) took 1148 ms. Trace:
I20260709 12:11:05.684476 21080 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:05.686280 21021 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:05.687740 20903 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.000s
I20260709 12:11:05.758314 20903 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.760797 20903 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:05.690990 20886 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.646899 17980 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:05.661276 20312 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.762326 20312 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.762768 20312 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:05.663010 20986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.004s	sys 0.019s
I20260709 12:11:05.741197 21029 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.714604 20856 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:11:05.677695 21090 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.765827 21090 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.766320 21090 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.766826 21043 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.733704 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 792) took 1448 ms. Trace:
I20260709 12:11:05.770279 18009 rpcz_store.cc:276] 0709 12:11:04.285216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.285324 (+   108us) service_pool.cc:224] Handling call
0709 12:11:04.286373 (+  1049us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:04.503643 (+217270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.503675 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:04.508866 (+  5191us) log.cc:844] Serialized 52 byte log entry
0709 12:11:05.377757 (+868891us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:05.377800 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.377881 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.733473 (+355592us) raft_consensus.cc:1685] finished
0709 12:11:05.733493 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.733639 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28232,"raft.queue_time_us":220643,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":38421,"thread_start_us":843195,"threads_started":2,"wal-append.queue_time_us":1055954}
W20260709 12:11:05.775005 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 128162us
I20260709 12:11:05.751336 17285 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:11:05.753568 18007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.035s	sys 0.065s
I20260709 12:11:05.776687 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 788) took 1508 ms. Trace:
I20260709 12:11:05.754555 18011 rpcz_store.cc:276] 0709 12:11:04.613479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.620245 (+  6766us) service_pool.cc:224] Handling call
0709 12:11:05.681053 (+1060808us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400610154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:05.681162 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404539648}
W20260709 12:11:05.749995 21044 consensus_meta.cc:287] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.000s
W20260709 12:11:05.780879 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 73841.7us
W20260709 12:11:05.779855 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.787489 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:05.788584 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.789656 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.790764 18014 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:05.793081 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.793782 18010 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:05.777063 18007 rpcz_store.cc:276] 0709 12:11:04.268494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.268606 (+   112us) service_pool.cc:224] Handling call
0709 12:11:04.273213 (+  4607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.480593 (+207380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.480642 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:04.501969 (+ 21327us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.776323 (+1274354us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:05.776370 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.776445 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.776491 (+    46us) raft_consensus.cc:1685] finished
0709 12:11:05.776502 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.776628 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33958,"raft.queue_time_us":225668,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":30010,"thread_start_us":1372273,"threads_started":2,"wal-append.queue_time_us":1200856}
W20260709 12:11:05.798868 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.815280 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.793995 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:05.775839 20986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.219s	user 0.004s	sys 0.019s
W20260709 12:11:05.816592 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 507661us
I20260709 12:11:05.818414 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:05.821486 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.747280 21064 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:05.833731 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:05.820887 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:05.830178 18015 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:05.829723 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:05.793076 21080 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:05.836340 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:05.837015 17286 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 4.
I20260709 12:11:05.834649 18009 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:05.839953 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:05.840919 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:05.841756 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:05.843009 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:05.846160 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:05.848731 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:05.849447 17285 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:11:05.832803 21012 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.831094 20988 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.832659 20987 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.819113 21051 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:11:05.815680 21044 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:05.860011 20928 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:05.861111 20987 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:05.863164 17288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2554) took 1732 ms (client timeout 1791 ms). Trace:
I20260709 12:11:05.863348 20987 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:05.863600 17288 rpcz_store.cc:269] 0709 12:11:04.130429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.174455 (+ 44026us) service_pool.cc:224] Handling call
0709 12:11:05.862947 (+1688492us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000b7a54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:05.863098 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3180841216}
I20260709 12:11:05.864727 21099 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:05.866398 17289 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.867141 20855 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:05.867687 20855 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:05.868103 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 657) took 1659 ms. Trace:
I20260709 12:11:05.868484 17289 rpcz_store.cc:276] 0709 12:11:04.209156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.262142 (+1052986us) service_pool.cc:224] Handling call
0709 12:11:05.866214 (+604072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.866815 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.867897 (+  1082us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54000b7a50. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:05.868035 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383737216}
I20260709 12:11:05.857846 17258 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:11:05.870891 17258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 2.365s (SENT) [suppressed 35 similar messages]
I20260709 12:11:05.871650 21099 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.872103 21099 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.872457 21099 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.844203 20900 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.839040 21080 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.877995 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:05.878692 17441 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.855901 21012 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.883849 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:05.887555 17439 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:05.892017 17441 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
W20260709 12:11:05.874756 21062 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.000s
W20260709 12:11:05.876935 21050 consensus_meta.cc:287] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.001s
I20260709 12:11:05.886240 21101 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.855077 20988 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.844518 21027 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 12:11:05.884279 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 220598us
I20260709 12:11:05.875528 20900 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:05.881307 20886 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:05.884034 21007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.821s	user 0.005s	sys 0.041s
I20260709 12:11:05.875762 21080 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:05.899448 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:05.903096 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:05.893844 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:05.902448 17332 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:05.854280 21043 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:05.901957 20988 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.889524 21012 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.909547 17332 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:05.899606 21024 consensus_meta.cc:287] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.002s
W20260709 12:11:05.904085 20920 consensus_meta.cc:287] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
W20260709 12:11:05.907626 21007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.857s	user 0.005s	sys 0.041s
I20260709 12:11:05.906008 20900 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.883869 20542 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.868546 20855 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:05.926079 20993 consensus_meta.cc:287] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.450s	user 0.008s	sys 0.004s
I20260709 12:11:05.912402 20886 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:05.950690 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 108982us
I20260709 12:11:05.902601 21062 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.955492 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:05.903620 21050 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.944837 21026 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.959656 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:05.956983 21083 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.950366 21024 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.963465 21024 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:05.963908 21024 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.962756 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:05.964874 17359 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:05.963953 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:05.942265 20920 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.968575 17361 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:05.937844 20312 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:05.970319 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 44656.9us
I20260709 12:11:05.971663 18013 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:05.972191 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:05.972847 17359 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:05.949689 20993 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.977160 20920 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:05.977555 20542 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.969254 21027 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.979604 21027 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.979964 21027 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:05.992007 21028 log.cc:927] Time spent T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 2.752s	user 0.024s	sys 0.033s
I20260709 12:11:06.016832 21044 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:06.017213 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 637) took 3206 ms. Trace:
I20260709 12:11:06.017625 17432 rpcz_store.cc:276] 0709 12:11:02.811282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.811429 (+   147us) service_pool.cc:224] Handling call
0709 12:11:02.811720 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.835327 (+ 23607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.835359 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.840573 (+  5214us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.166741 (+326168us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:03.166883 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.167219 (+   336us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.941162 (+2773943us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:06.016892 (+ 75730us) raft_consensus.cc:1685] finished
0709 12:11:06.016914 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.017145 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9817,"raft.queue_time_us":23343,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4474,"spinlock_wait_cycles":157210368,"thread_start_us":297611,"threads_started":1,"wal-append.queue_time_us":389656}
I20260709 12:11:06.019578 21083 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:06.019402 21024 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.021600 21024 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.993479 17359 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:11:06.022418 21108 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.023074 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:06.022959 21108 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.023813 17359 raft_consensus.cc:2368] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
I20260709 12:11:06.024644 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:06.025157 21108 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:06.026453 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:05.992004 20542 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:06.007705 20993 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.028798 21033 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.029261 20542 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.995234 20903 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:11:06.029922 17255 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:06.030839 20903 raft_consensus.cc:3055] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:06.031195 20903 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:06.031301 20928 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.031987 20903 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.033147 20903 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.008074 20886 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:05.973409 21043 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:06.013976 21003 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:06.039320 20542 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:06.040795 20989 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.041394 20989 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.042316 21113 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:06.042663 21003 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:06.038589 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:06.042887 21113 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.043560 21099 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.044713 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:06.045094 21113 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.045485 17359 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:06.027827 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1792) took 2818 ms. Trace:
I20260709 12:11:06.046645 17367 rpcz_store.cc:276] 0709 12:11:03.209563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.680992 (+471429us) service_pool.cc:224] Handling call
0709 12:11:03.860940 (+179948us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:03.868929 (+  7989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.868974 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:03.871759 (+  2785us) log.cc:844] Serialized 52 byte log entry
0709 12:11:05.721696 (+1849937us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b1800407320. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:05.944620 (+222924us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:05.944659 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.945010 (+   351us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.027520 (+ 82510us) raft_consensus.cc:1685] finished
0709 12:11:06.027537 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.027769 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5108,"spinlock_wait_cycles":47631232,"thread_start_us":222738,"threads_started":1,"wal-append.queue_time_us":2101701}
I20260709 12:11:06.027012 21119 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:06.027884 21050 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:05.977200 20312 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.026590 21062 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.050534 20854 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:06.051190 21039 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 2.811s	user 0.012s	sys 0.037s
I20260709 12:11:06.051365 21077 raft_consensus.cc:3055] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:06.009606 21090 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.052404 21083 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:06.040870 21012 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.056547 20928 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.058223 21080 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.058529 17980 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:06.064509 17360 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1783) took 2885 ms (client timeout 2339 ms). Trace:
I20260709 12:11:06.066737 21099 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:06.067988 21022 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 2.822s	user 0.017s	sys 0.028s
I20260709 12:11:06.558190 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:06.143409 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:06.562937 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.179416 18013 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 806) took 1559 ms (client timeout 1809 ms). Trace:
W20260709 12:11:06.569988 17360 rpcz_store.cc:269] 0709 12:11:03.179436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.186701 (+  7265us) service_pool.cc:224] Handling call
0709 12:11:06.064284 (+2877583us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b54003a02d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:06.064426 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128323328}
W20260709 12:11:06.142256 17407 connection.cc:256] RPC call timeout handler was delayed by -1.7332876539999234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 12:11:06.580519 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 522008us
I20260709 12:11:06.572254 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:06.571764 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.593567 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.587545 17291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2547) took 2456 ms (client timeout 2236 ms). Trace:
W20260709 12:11:06.587329 17366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1769) took 5434 ms (client timeout 3365 ms). Trace:
W20260709 12:11:06.594853 17366 rpcz_store.cc:269] 0709 12:11:01.138142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.144320 (+  6178us) service_pool.cc:224] Handling call
0709 12:11:06.572190 (+5427870us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b54002c7754. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:06.572318 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6315267456}
I20260709 12:11:06.596087 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:06.596819 18006 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:06.597313 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:06.570869 17367 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
W20260709 12:11:06.592998 17407 connection.cc:256] RPC call timeout handler was delayed by -1.657316056999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:11:06.599143 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:06.599252 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:06.569305 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:06.187006 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.600512 18008 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:06.591897 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:06.600962 17363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.017s	sys 0.041s
I20260709 12:11:06.603289 17360 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:06.603446 17359 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
W20260709 12:11:06.572294 18013 rpcz_store.cc:269] 0709 12:11:04.620395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.100723 (+480328us) service_pool.cc:224] Handling call
0709 12:11:06.179145 (+1078422us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400102a54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:06.179338 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1768961920}
I20260709 12:11:06.601408 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:06.604228 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:06.604415 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.594259 17291 rpcz_store.cc:269] 0709 12:11:04.116976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.117102 (+   126us) service_pool.cc:224] Handling call
0709 12:11:06.572950 (+2455848us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000b8954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:06.573077 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3373416320}
W20260709 12:11:06.603325 17407 connection.cc:256] RPC call timeout handler was delayed by -1.6351876539999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 12:11:06.605880 18010 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:06.606401 17407 connection.cc:256] RPC call timeout handler was delayed by -1.5298876540000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 12:11:06.606678 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:06.606964 17407 connection.cc:256] RPC call timeout handler was delayed by -1.2282693079998808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:11:06.607734 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:06.608924 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:06.609565 17286 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.605693 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:06.609930 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:06.610378 17359 raft_consensus.cc:2376] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5. Re-sending same reply.
I20260709 12:11:06.610471 18008 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.610630 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:06.612033 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:06.511245 21027 consensus_meta.cc:287] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.004s
I20260709 12:11:06.649258 17364 raft_consensus.cc:2368] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7.
I20260709 12:11:06.605886 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:06.612879 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:06.651891 17289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.019s	sys 0.052s
I20260709 12:11:06.110690 20503 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:06.652326 17289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.019s	sys 0.052s
I20260709 12:11:06.114988 20999 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:06.652271 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:06.578955 21113 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.613207 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:06.613240 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:06.628155 17286 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:06.655771 18008 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:06.602226 21060 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:06.114552 21003 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.603539 20849 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.642338 17189 catalog_manager.cc:5697] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 9, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 9 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:06.645423 21062 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:06.152419 21051 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.645808 21118 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.661693 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2586) took 5463 ms. Trace:
I20260709 12:11:06.114615 21108 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.578305 20900 consensus_meta.cc:287] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.001s
I20260709 12:11:06.653862 17283 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:06.587631 20312 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:06.654210 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:06.662128 17362 rpcz_store.cc:276] 0709 12:11:01.198672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.124244 (+925572us) service_pool.cc:224] Handling call
0709 12:11:02.185062 (+ 60818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.185528 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:02.185557 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.611579 (+426022us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.122736 (+511157us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.122778 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.122846 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.067360 (+2944514us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:06.659238 (+591878us) raft_consensus.cc:1685] finished
0709 12:11:06.659260 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.661616 (+  2356us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11685,"spinlock_wait_cycles":130613120,"thread_start_us":449644,"threads_started":1,"wal-append.queue_time_us":586375}
I20260709 12:11:06.666673 17285 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:06.511628 20988 consensus_meta.cc:287] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 12:11:06.562484 21007 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:06.605926 17363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.017s	sys 0.041s
I20260709 12:11:06.569832 21077 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:06.612399 20920 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.569587 20854 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:06.659615 20503 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:06.112054 21119 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.659832 18007 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 6: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:06.647114 21053 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:06.663713 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:06.652132 20886 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.658722 20999 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.674371 17285 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:06.678473 21007 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.679293 17438 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:06.664057 21051 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.687373 18010 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:06.689443 20312 raft_consensus.cc:697] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:06.658593 21060 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:06.654554 21027 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.590922 21083 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.659143 21113 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.696239 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:06.725090 17362 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:06.726032 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:06.660665 21003 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.662377 21062 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:06.680382 17440 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 641) took 3862 ms (client timeout 2063 ms). Trace:
I20260709 12:11:06.722203 17255 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:06.687199 20988 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.723150 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:06.664753 21118 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:06.718472 20886 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.710353 20503 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:06.674497 20900 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:06.727505 17440 rpcz_store.cc:269] 0709 12:11:02.818325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.818442 (+   117us) service_pool.cc:224] Handling call
0709 12:11:06.678806 (+3860364us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000ca154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:06.680249 (+  1443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485736192}
I20260709 12:11:06.719911 20849 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:06.732087 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:06.735571 17363 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:06.735914 17360 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:06.737242 17367 raft_consensus.cc:2368] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
I20260709 12:11:06.665482 21108 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.704856 20920 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.726058 20999 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:06.739553 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:06.758632 17366 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:06.746704 17363 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:11:06.730415 20903 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.748780 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:06.730088 21080 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:06.738605 20503 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:06.758554 20999 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:06.780890 17359 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:06.735270 20849 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:06.719791 20854 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:06.783962 21124 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:06.801040 20988 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.803122 21007 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.803412 21113 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.739085 21060 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.782341 20999 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:06.784587 21125 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:11:06.726562 21077 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.763458 21090 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.785146 21062 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:06.776681 20312 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:06.804576 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 232368us
W20260709 12:11:06.806425 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 196376us
I20260709 12:11:06.802984 21108 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.781323 21012 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:06.812091 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:06.811678 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:06.815438 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.806542 20999 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:06.809062 20854 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.818063 21083 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:06.813944 21077 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:06.816159 17404 connection.cc:256] RPC call timeout handler was delayed by -3.0197502320002059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 12:11:06.819168 17440 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:06.824361 17441 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:11:06.822751 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:06.820624 21127 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.817883 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:06.825578 17437 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:06.827678 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:06.828512 17439 raft_consensus.cc:2393] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:06.820540 20900 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:06.834244 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 224470us
I20260709 12:11:06.829556 21127 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.832707 21012 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.831861 20886 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.832177 21130 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:06.844297 21122 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:11:06.844594 21035 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 3.596s	user 0.049s	sys 0.047s
I20260709 12:11:06.840224 21127 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.837740 21083 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 12:11:06.850378 21023 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 3.674s	user 0.012s	sys 0.041s
I20260709 12:11:06.850575 20920 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:06.851189 21083 raft_consensus.cc:3055] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:06.850268 21051 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:06.851620 21083 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:06.852491 21083 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.853880 21083 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.854350 21119 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:06.860165 21127 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:06.863036 21127 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:06.863921 21121 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:11:06.906538 17258 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:06.908775 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:06.911445 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:06.913671 17189 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 5, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 5 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.918689 17189 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 7 to 10, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 10 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:06.920746 17189 catalog_manager.cc:5697] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.925601 17283 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:06.932528 17286 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 12:11:06.933982 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 642) took 4290 ms. Trace:
I20260709 12:11:06.935230 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:06.937546 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:06.938140 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:06.938763 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:06.939170 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 643) took 4280 ms. Trace:
I20260709 12:11:06.955245 17291 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:06.955068 17290 rpcz_store.cc:276] 0709 12:11:02.658678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.662229 (+  3551us) service_pool.cc:224] Handling call
0709 12:11:02.662521 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.777182 (+114661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.777212 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.777662 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.153369 (+375707us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:03.153405 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.044512 (+1891107us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54000514d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:05.044561 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.844023 (+1799462us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:06.938736 (+ 94713us) raft_consensus.cc:1685] finished
0709 12:11:06.938775 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.939009 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399065216,"thread_start_us":357239,"threads_started":1,"wal-append.queue_time_us":459747}
I20260709 12:11:06.938349 17189 catalog_manager.cc:5697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:06.941112 17292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2549) took 2812 ms (client timeout 2080 ms). Trace:
I20260709 12:11:06.965431 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:06.967482 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:06.968770 17291 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:06.972685 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:06.975119 17189 catalog_manager.cc:5697] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 7 to 8, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 8 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:06.973971 17288 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:11:06.980206 17331 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34702 dropped due to backpressure: service queue is full with 50 items [suppressed 10 similar messages]
I20260709 12:11:06.980842 17290 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:11:06.977583 17189 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:06.993355 17333 connection.cc:256] RPC call timeout handler was delayed by -2.645930448999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 12:11:06.998991 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:06.999814 21127 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:07.000499 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 624) took 1044 ms. Trace:
W20260709 12:11:07.011770 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 193847us
I20260709 12:11:07.014545 20849 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.015448 21138 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.016443 20849 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.016292 21138 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:07.019089 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.020200 17439 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:07.020390 20988 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.020968 20988 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:07.021673 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.022585 17440 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:07.022377 20988 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.022979 17189 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 9, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 9 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:07.025692 17432 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:07.026603 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 118073us
I20260709 12:11:07.032613 17285 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:06.997730 21083 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.034739 21083 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:06.957386 17404 connection.cc:256] RPC call timeout handler was delayed by -2.2892835060001744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:11:06.969925 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:06.960592 17292 rpcz_store.cc:269] 0709 12:11:04.128988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.129190 (+   202us) service_pool.cc:224] Handling call
0709 12:11:06.940601 (+2811411us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54001c0f54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:06.940885 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258385664}
I20260709 12:11:07.019127 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.045547 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1649) took 4158 ms. Trace:
I20260709 12:11:07.046697 20842 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:07.024179 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:07.047515 17333 connection.cc:256] RPC call timeout handler was delayed by -2.2625304489999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 12:11:07.050678 17291 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:07.052511 20842 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.046074 17438 rpcz_store.cc:276] 0709 12:11:02.886622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.084191 (+197569us) service_pool.cc:224] Handling call
0709 12:11:06.678937 (+3594746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.718871 (+ 39934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.042532 (+323661us) spinlock_profiling.cc:243] Waited 3.56 s on lock 0x7b54000ca150. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:07.045333 (+  2801us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8179299584}
W20260709 12:11:07.054685 17333 connection.cc:256] RPC call timeout handler was delayed by -2.1932304489998842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 12:11:07.009143 17358 rpcz_store.cc:276] 0709 12:11:05.956244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.957406 (+  1162us) service_pool.cc:224] Handling call
0709 12:11:06.068496 (+111090us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.068885 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.068914 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.069382 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:11:06.517345 (+447963us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:06.517392 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.517474 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.651747 (+134273us) raft_consensus.cc:1685] finished
0709 12:11:06.651768 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.999877 (+348109us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003a02d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:07.000219 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1006,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":31380,"spinlock_wait_cycles":238648576,"thread_start_us":447577,"threads_started":1,"wal-append.queue_time_us":572853}
I20260709 12:11:07.046490 20928 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:07.057126 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.057786 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:07.060479 17333 connection.cc:256] RPC call timeout handler was delayed by -2.08703044899994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
I20260709 12:11:07.058599 21127 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:07.057734 17286 raft_consensus.cc:2368] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10.
I20260709 12:11:07.025940 17189 catalog_manager.cc:5697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 5, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 5 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:07.062563 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.067188 17438 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:07.067724 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.067983 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 799) took 2714 ms. Trace:
I20260709 12:11:07.068373 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.068539 18014 raft_consensus.cc:2376] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7. Re-sending same reply.
I20260709 12:11:07.070752 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.071579 18009 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.072665 20623 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:07.069759 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.074267 20623 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:06.954290 17287 rpcz_store.cc:276] 0709 12:11:02.643695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.643804 (+   109us) service_pool.cc:224] Handling call
0709 12:11:02.644091 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.672290 (+ 28199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.672320 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.723072 (+ 50752us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.086421 (+363349us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.086460 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.086527 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.849678 (+3763151us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:06.933192 (+ 83514us) raft_consensus.cc:1685] finished
0709 12:11:06.933238 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.933666 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38314,"raft.queue_time_us":29998,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7728,"spinlock_wait_cycles":263465216,"thread_start_us":359389,"threads_started":1,"wal-append.queue_time_us":404789}
I20260709 12:11:07.076460 20623 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.076923 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.078174 17437 raft_consensus.cc:2410] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:07.081609 20778 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:07.082594 21026 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:07.087057 21026 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.083807 20928 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:07.087759 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.068408 18012 rpcz_store.cc:276] 0709 12:11:04.353978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.368680 (+ 14702us) service_pool.cc:224] Handling call
0709 12:11:04.368999 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.314394 (+945395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.067467 (+1753073us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54005f2dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:07.067785 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2135155072}
I20260709 12:11:07.079443 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.073411 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.097545 17438 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:07.076936 21083 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:07.087540 21026 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:07.114475 20623 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:07.115880 21138 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:07.114477 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:06.983706 17331 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34702 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 634)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 652)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 639)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 659)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 654)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2616)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2618)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2621)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 646)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2619)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 655)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2625)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2620)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 658)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 636)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1797)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1801)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 642)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1817)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1821)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2609)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2623)
I20260709 12:11:07.071101 17189 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:07.087589 21060 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.126421 18014 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
W20260709 12:11:07.128142 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 79737.8us
I20260709 12:11:07.128342 21026 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.129225 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:07.130435 20778 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:07.131204 20778 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:07.127746 20503 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.132236 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.131929 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:07.140134 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 80795.4us
I20260709 12:11:07.094463 20928 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.141711 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.142513 17441 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.129999 21026 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.148504 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.149412 17438 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:07.150470 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.151292 17438 raft_consensus.cc:2393] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:07.152117 17438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "119706da80854a2680f098d29fac4c43"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:41644
I20260709 12:11:07.141561 17440 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.154422 21127 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:07.155361 17189 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 7, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 7 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:07.156646 20778 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:07.157670 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.163429 17362 raft_consensus.cc:2376] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5. Re-sending same reply.
I20260709 12:11:07.164122 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 652) took 1022 ms. Trace:
I20260709 12:11:07.164462 17362 rpcz_store.cc:276] 0709 12:11:06.141327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.157084 (+1015757us) service_pool.cc:224] Handling call
0709 12:11:07.164029 (+  6945us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.165663 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.152029 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1795) took 3808 ms. Trace:
I20260709 12:11:07.167075 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.167802 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.169847 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 625) took 1212 ms. Trace:
I20260709 12:11:07.160516 17189 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: leader changed from <none> to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 6 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:07.177114 20842 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:07.179077 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:07.191416 17440 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:07.189144 17364 rpcz_store.cc:276] 0709 12:11:05.957740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.958333 (+   593us) service_pool.cc:224] Handling call
0709 12:11:07.169438 (+1211105us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54003c4454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:07.169637 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1571813120}
I20260709 12:11:07.188284 17361 rpcz_store.cc:276] 0709 12:11:03.343595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.496777 (+1153182us) service_pool.cc:224] Handling call
0709 12:11:04.509654 (+ 12877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.969011 (+1459357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.151540 (+1182529us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540040c9d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:07.151834 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3354779392}
I20260709 12:11:07.187376 17438 raft_consensus.cc:606] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:07.201264 17441 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:07.201967 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.161908 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:07.208828 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.208981 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:07.210242 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.211058 17440 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:11:07.211400 17437 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.211903 17432 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:07.212908 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.214486 20999 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.214355 17189 catalog_manager.cc:5697] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 5, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 5 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:07.217465 20999 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:07.218345 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:07.218999 17186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55944 (request call id 311) took 16769 ms (client timeout 15000 ms). Trace:
I20260709 12:11:07.219257 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1814) took 1209 ms. Trace:
I20260709 12:11:07.219583 17364 rpcz_store.cc:276] 0709 12:11:06.010009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.212481 (+1202472us) service_pool.cc:224] Handling call
0709 12:11:07.219178 (+  6697us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.220597 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.221195 20623 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:07.222833 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 60354.8us
I20260709 12:11:07.225178 17291 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:07.217417 17189 catalog_manager.cc:5697] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 6, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 6 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:07.227902 18009 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
W20260709 12:11:07.230835 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.231300 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.214382 17362 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:07.311283 17363 raft_consensus.cc:2410] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:07.474747 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.256230 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.329244 17189 catalog_manager.cc:5697] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 1 to 4, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:07.311623 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 80851.9us
I20260709 12:11:07.258199 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 639) took 1173 ms. Trace:
I20260709 12:11:07.375118 17437 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:07.350052 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.310796 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 654) took 1123 ms. Trace:
I20260709 12:11:07.467108 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:11:07.258373 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.493943 17364 rpcz_store.cc:276] 0709 12:11:06.141896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.220199 (+1078303us) service_pool.cc:224] Handling call
0709 12:11:07.265528 (+ 45329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.491480 17362 rpcz_store.cc:276] 0709 12:11:06.059195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.165252 (+1106057us) service_pool.cc:224] Handling call
0709 12:11:07.232777 (+ 67525us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:07.256518 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 77586.6us
W20260709 12:11:07.337173 17978 leader_election.cc:336] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.724s (SENT)
I20260709 12:11:07.433341 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.258059 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.419323 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.336910 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.498350 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.499271 17432 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:07.343698 17433 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:07.476981 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 644) took 1416 ms. Trace:
I20260709 12:11:07.504458 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.440579 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1813) took 1430 ms. Trace:
I20260709 12:11:07.361348 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:07.504791 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:07.501225 17359 rpcz_store.cc:276] 0709 12:11:06.060597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.611808 (+551211us) service_pool.cc:224] Handling call
0709 12:11:07.476604 (+864796us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400291dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:07.476784 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322631936}
I20260709 12:11:07.508028 17440 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.508158 21003 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:07.466890 21118 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:07.509512 17436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1660) took 4176 ms (client timeout 2365 ms). Trace:
W20260709 12:11:07.509950 17436 rpcz_store.cc:269] 0709 12:11:03.333100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.333248 (+   148us) service_pool.cc:224] Handling call
0709 12:11:07.509167 (+4175919us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b540006ed54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:07.509317 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484022528}
W20260709 12:11:07.510727 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 398707us
I20260709 12:11:07.510339 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1806) took 1495 ms. Trace:
I20260709 12:11:07.514282 17358 rpcz_store.cc:276] 0709 12:11:06.007890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.474381 (+1466491us) service_pool.cc:224] Handling call
0709 12:11:07.502948 (+ 28567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.257727 20503 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:07.515543 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:07.515846 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 305721us
I20260709 12:11:07.516108 21131 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.516433 17358 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:07.516673 21131 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.517144 21131 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.517689 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2566) took 2965 ms. Trace:
W20260709 12:11:07.224896 17186 rpcz_store.cc:269] 0709 12:10:50.449587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.450061 (+   474us) service_pool.cc:224] Handling call
0709 12:11:07.218742 (+16768681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:59.533431 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:59.534174 (+   743us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:59.534230 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:10:59.534249 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:59.536100 (+  1851us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:59.536179 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:59.536208 (+    29us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:10:59.854923 (+318715us) tablet.cc:701] Row locks acquired
0709 12:10:59.854975 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:10:59.855142 (+   167us) write_op.cc:270] Start()
0709 12:10:59.855314 (+   172us) write_op.cc:276] Timestamp: P: 1783599059855074 usec, L: 0
0709 12:10:59.855338 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:59.980147 (+124809us) log.cc:844] Serialized 8246 byte log entry
0709 12:11:00.227216 (+247069us) op_driver.cc:464] REPLICATION: finished
0709 12:11:00.519433 (+292217us) write_op.cc:301] APPLY: starting
0709 12:11:00.709406 (+189973us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:00.709765 (+   359us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:00.709936 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:00.712165 (+  2229us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:00.712501 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:11:00.712550 (+    49us) write_op.cc:312] APPLY: finished
0709 12:11:00.712952 (+   402us) log.cc:844] Serialized 139 byte log entry
0709 12:11:00.713143 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.713326 (+   183us) write_op.cc:454] Released schema lock
0709 12:11:00.713376 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:00.713768 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.713805 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":913983,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":233510,"apply.run_cpu_time_us":13786,"apply.run_wall_time_us":228320,"num_ops":20,"prepare.queue_time_us":335154,"prepare.run_cpu_time_us":32189,"prepare.run_wall_time_us":541418,"raft.queue_time_us":106883,"raft.run_cpu_time_us":50954,"raft.run_wall_time_us":121485,"replication_time_us":371331,"thread_start_us":438193,"threads_started":4,"wal-append.queue_time_us":99425,"wal-append.run_cpu_time_us":8740,"wal-append.run_wall_time_us":1603389}]]}
W20260709 12:11:07.345978 21146 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:11:07.520423 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:07.518123 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:07.415086 21148 log.cc:927] Time spent T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
W20260709 12:11:07.428514 20985 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.960s	user 0.015s	sys 0.024s
W20260709 12:11:07.415004 21144 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:11:07.537257 17434 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:07.537194 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 653) took 1395 ms. Trace:
I20260709 12:11:07.537947 17363 rpcz_store.cc:276] 0709 12:11:06.141629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.159066 (+1017437us) service_pool.cc:224] Handling call
0709 12:11:07.536983 (+377917us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54002df854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:07.537136 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238980480}
I20260709 12:11:07.257602 21013 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.529422 21003 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.539424 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:07.539558 21003 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:07.526640 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 299023us
I20260709 12:11:07.540623 21003 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.542129 21012 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.542428 17358 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:07.543135 20999 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:07.543296 20985 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.322s	user 0.018s	sys 0.027s
I20260709 12:11:07.543761 17434 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:07.529963 17437 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.530062 18006 raft_consensus.cc:2410] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:07.530625 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.479939 20989 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:07.514302 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 177196us
I20260709 12:11:07.505785 17360 rpcz_store.cc:276] 0709 12:11:06.009697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.607517 (+597820us) service_pool.cc:224] Handling call
0709 12:11:07.440095 (+832578us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400083754. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:07.440372 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286225664}
I20260709 12:11:07.546429 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.548471 17365 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.535032 17441 raft_consensus.cc:1240] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:07.535849 17440 raft_consensus.cc:2410] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:07.529598 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.550612 17359 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.518090 17284 rpcz_store.cc:276] 0709 12:11:04.551866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.319147 (+767281us) service_pool.cc:224] Handling call
0709 12:11:06.941653 (+1622506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.942497 (+   844us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:06.943962 (+  1465us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.041093 (+ 97131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.041145 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:07.041200 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.043595 (+  2395us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.517370 (+473775us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54001c0f50. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:07.517480 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1377,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":85010,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":1490,"spinlock_wait_cycles":3716216704,"thread_start_us":97527,"threads_started":2,"wal-append.queue_time_us":150399}
I20260709 12:11:07.537514 17439 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:07.514601 17361 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:07.540679 17435 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.529603 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.551683 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 634) took 1566 ms. Trace:
I20260709 12:11:07.553781 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 659) took 1353 ms. Trace:
I20260709 12:11:07.551714 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1799) took 1556 ms. Trace:
I20260709 12:11:07.554891 17364 rpcz_store.cc:276] 0709 12:11:05.995033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.506892 (+1511859us) service_pool.cc:224] Handling call
0709 12:11:07.551645 (+ 44753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.555622 17361 rpcz_store.cc:276] 0709 12:11:06.208013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.212661 (+1004648us) service_pool.cc:224] Handling call
0709 12:11:07.553722 (+341061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.553800 17367 rpcz_store.cc:276] 0709 12:11:05.985663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.529092 (+1543429us) service_pool.cc:224] Handling call
0709 12:11:07.551619 (+ 22527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.558281 17432 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:11:07.549299 21012 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.569726 21066 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.569952 17980 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:07.570561 21150 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:07.571580 21150 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.572147 21150 raft_consensus.cc:697] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:07.572335 21060 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.572677 21060 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:07.573226 21150 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.573666 21060 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.575235 21060 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.571906 17980 leader_election.cc:400] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10.
I20260709 12:11:07.578837 17980 leader_election.cc:403] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:07.567054 21012 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.533046 17330 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48992 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2616)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2618)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2621)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 646)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2619)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 655)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2620)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 658)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 636)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1797)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1800)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1801)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 642)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1817)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1821)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2609)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2623)
I20260709 12:11:07.570473 21066 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.605989 20985 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10.
I20260709 12:11:07.613133 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.613394 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:07.618865 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.620658 18006 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:07.621871 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.626860 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.627508 17284 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.628536 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.629272 17287 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:07.630081 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.631129 17359 raft_consensus.cc:2410] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:07.609774 21027 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:07.634428 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.634598 17437 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:07.615058 20988 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:07.637061 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:07.634248 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:07.638926 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.637403 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.639671 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.644459 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.643044 17980 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:07.646204 17291 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:07.651574 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:07.646304 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:07.653213 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.655481 17363 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:07.642764 21066 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:07.658917 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:07.640952 21013 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.660360 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.660740 17366 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:07.667938 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1805) took 1660 ms. Trace:
I20260709 12:11:07.675699 17359 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:07.675761 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.640275 20988 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:07.677527 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.671202 17366 rpcz_store.cc:276] 0709 12:11:06.007632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.587705 (+1580073us) service_pool.cc:224] Handling call
0709 12:11:07.667863 (+ 80158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.684497 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.677382 21066 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:07.685547 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 136453us
I20260709 12:11:07.686270 17360 raft_consensus.cc:2393] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 3: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:07.677325 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:07.692344 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.694244 17433 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:11:07.694929 18009 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:07.696198 17286 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.695399 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1816) took 1644 ms. Trace:
I20260709 12:11:07.696913 17363 rpcz_store.cc:276] 0709 12:11:06.050564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.676184 (+1625620us) service_pool.cc:224] Handling call
0709 12:11:07.695337 (+ 19153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.695222 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:07.672513 21131 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.694644 17364 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:07.701586 17367 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:11:07.702836 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.703558 17367 raft_consensus.cc:2376] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11. Re-sending same reply.
I20260709 12:11:07.704121 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 655) took 1546 ms. Trace:
I20260709 12:11:07.704483 17367 rpcz_store.cc:276] 0709 12:11:06.157562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.702440 (+1544878us) service_pool.cc:224] Handling call
0709 12:11:07.704053 (+  1613us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:07.698372 21155 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:07.708492 17292 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:07.691403 21066 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:07.708737 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.711158 21071 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.712288 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:07.713258 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.712700 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:07.713471 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.715921 17283 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
W20260709 12:11:07.720396 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.721489 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 53165.5us
I20260709 12:11:07.721724 21131 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:07.722494 21118 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.723106 21118 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:07.724749 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.726178 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.726725 17291 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 10. Ops: [8.9-8.9]
I20260709 12:11:07.728715 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.728966 21066 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.711865 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.729646 17362 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:07.731822 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.732848 17285 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:07.733790 18009 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.686020 21013 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.740001 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.735536 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.743319 17361 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:07.743809 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1804) took 1736 ms. Trace:
I20260709 12:11:07.744131 17361 rpcz_store.cc:276] 0709 12:11:06.007392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.735227 (+1727835us) service_pool.cc:224] Handling call
0709 12:11:07.743740 (+  8513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.744942 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.745126 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.745434 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.740540 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.746292 17358 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.744874 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.735934 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:07.747772 21153 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.206s	user 0.001s	sys 0.001s
W20260709 12:11:07.749643 17255 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.942s (SENT)
I20260709 12:11:07.750342 21052 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:11:07.736726 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.734638 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.738693 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.738086 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:07.739575 17288 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: [6.6-10.8]
I20260709 12:11:07.751688 17436 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:11:07.754891 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.751695 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 646) took 1690 ms. Trace:
I20260709 12:11:07.756235 17360 rpcz_store.cc:276] 0709 12:11:06.061081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.693138 (+1632057us) service_pool.cc:224] Handling call
0709 12:11:07.751638 (+ 58500us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.706260 17404 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:07.758694 17364 raft_consensus.cc:2410] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:07.758733 17365 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:07.750975 17255 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:07.760349 17287 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:07.760521 17438 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:07.762315 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1809) took 1753 ms. Trace:
I20260709 12:11:07.762725 17364 rpcz_store.cc:276] 0709 12:11:06.008635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.700546 (+1691911us) service_pool.cc:224] Handling call
0709 12:11:07.762252 (+ 61706us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:07.739867 21154 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.208s	user 0.002s	sys 0.001s
I20260709 12:11:07.785194 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:07.785777 17365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1798) took 1765 ms (client timeout 2206 ms). Trace:
I20260709 12:11:07.785601 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.788050 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.791527 17434 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:11:07.788604 17365 rpcz_store.cc:269] 0709 12:11:05.994784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.545943 (+1551159us) service_pool.cc:224] Handling call
0709 12:11:07.759847 (+213904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.789299 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 656) took 1624 ms. Trace:
I20260709 12:11:07.789963 17362 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:07.792383 17367 rpcz_store.cc:276] 0709 12:11:06.164954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.709475 (+1544521us) service_pool.cc:224] Handling call
0709 12:11:07.789241 (+ 79766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.793807 17288 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:07.796831 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.799054 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.754835 21052 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:07.802918 17283 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.803503 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.810880 17359 raft_consensus.cc:2368] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8.
I20260709 12:11:07.811817 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.789083 20778 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.819363 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.822295 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2620) took 1014 ms. Trace:
I20260709 12:11:07.822777 17359 rpcz_store.cc:276] 0709 12:11:06.808233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.745958 (+937725us) service_pool.cc:224] Handling call
0709 12:11:07.822186 (+ 76228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.822507 17367 raft_consensus.cc:2410] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:07.821965 17366 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:07.823616 17978 leader_election.cc:400] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
I20260709 12:11:07.829720 17980 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:07.831147 20841 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.831270 17361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:07.832293 17361 raft_consensus.cc:606] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:07.832916 17361 raft_consensus.cc:614] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:07.762238 20842 consensus_queue.cc:1059] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 12:11:07.832787 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 81891.9us
I20260709 12:11:07.836807 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.803661 21027 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:07.838268 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.839057 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 1802) took 1832 ms. Trace:
I20260709 12:11:07.839363 17363 rpcz_store.cc:276] 0709 12:11:06.006838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.809586 (+1802748us) service_pool.cc:224] Handling call
0709 12:11:07.838993 (+ 29407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.840332 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.840868 17359 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:07.841233 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 635) took 1855 ms. Trace:
I20260709 12:11:07.841446 17359 rpcz_store.cc:276] 0709 12:11:05.985879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.827326 (+1841447us) service_pool.cc:224] Handling call
0709 12:11:07.841184 (+ 13858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.806672 21003 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.842797 18006 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:07.818629 20778 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:07.843853 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.844053 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.844187 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:07.847275 18009 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:07.844493 17291 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.827217 21118 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:07.853457 18012 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 5: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:07.856194 17364 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:07.831199 20955 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:07.857933 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 633) took 1871 ms. Trace:
I20260709 12:11:07.868534 17364 rpcz_store.cc:276] 0709 12:11:05.985419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.836467 (+1851048us) service_pool.cc:224] Handling call
0709 12:11:07.855871 (+ 19404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.856661 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.856887 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.864053 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.859738 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:07.862507 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.863304 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.863953 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.865087 20856 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:07.865026 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.850625 20778 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.883358 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.884061 18015 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:07.885028 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.858352 17360 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.886346 17365 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:11:07.854794 21012 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:07.887035 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 636) took 1901 ms. Trace:
I20260709 12:11:07.887363 17365 rpcz_store.cc:276] 0709 12:11:05.986646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.844391 (+1857745us) service_pool.cc:224] Handling call
0709 12:11:07.851854 (+  7463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.886763 (+ 34909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.886980 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.888322 21012 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:07.889103 21052 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.889566 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.871246 18012 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:07.890427 17364 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:07.890975 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.892199 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.892737 18012 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.851507 21038 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.893733 21038 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.867985 17284 raft_consensus.cc:2410] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:07.875298 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1801) took 1879 ms. Trace:
I20260709 12:11:07.894157 17362 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:07.867362 21027 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:07.878435 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:07.894487 21038 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.879144 18008 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:07.895701 18010 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:07.896836 20955 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.898140 21027 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:07.894461 17359 rpcz_store.cc:276] 0709 12:11:05.996021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.841932 (+1845911us) service_pool.cc:224] Handling call
0709 12:11:07.852284 (+ 10352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.874905 (+ 22621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.874940 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.874981 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:07.875038 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.875099 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.875217 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.899281 20955 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:07.891263 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.901268 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:07.901952 17364 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:07.888324 20841 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.880910 18009 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:07.905400 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.906086 17284 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.896061 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.880810 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.881685 20856 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.882115 17255 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:07.908461 17363 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.899887 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:07.915017 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1800) took 1914 ms. Trace:
I20260709 12:11:07.914752 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1797) took 1911 ms. Trace:
I20260709 12:11:07.915588 17363 rpcz_store.cc:276] 0709 12:11:05.995779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.844864 (+1849085us) service_pool.cc:224] Handling call
0709 12:11:07.908260 (+ 63396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.909500 (+  1240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.909718 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.915915 17362 rpcz_store.cc:276] 0709 12:11:05.994502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.849884 (+1855382us) service_pool.cc:224] Handling call
0709 12:11:07.867558 (+ 17674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.904860 (+ 37302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.905076 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.892840 21118 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.917896 21118 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:07.919983 17286 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:07.925092 17360 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:07.926630 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.948822 18009 raft_consensus.cc:2368] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6.
I20260709 12:11:07.928056 20842 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.949221 17363 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:07.928319 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:07.930755 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.931795 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:07.926515 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.936393 17283 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:07.926738 17359 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:07.941020 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 132971us
I20260709 12:11:07.945549 17284 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:07.950654 18014 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:07.951017 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 658) took 1773 ms. Trace:
I20260709 12:11:07.951391 17360 rpcz_store.cc:276] 0709 12:11:06.179754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.807876 (+1628122us) service_pool.cc:224] Handling call
0709 12:11:07.950958 (+143082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.952171 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:11:07.955735 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.955909 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.956096 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:07.927768 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.955658 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:07.958422 18013 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.959463 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 642) took 1890 ms. Trace:
I20260709 12:11:07.959918 17363 rpcz_store.cc:276] 0709 12:11:06.060087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.946535 (+1886448us) service_pool.cc:224] Handling call
0709 12:11:07.948967 (+  2432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.949707 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.949970 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.961500 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:07.956643 17360 raft_consensus.cc:606] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Received request to transfer leadership to TS 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:07.963204 17360 raft_consensus.cc:614] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:07.963243 17285 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.957170 17981 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:07.963510 17290 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:11:07.964247 17290 pending_rounds.cc:85] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 3
I20260709 12:11:07.849805 21003 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:07.964318 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 124573us
I20260709 12:11:07.964574 17290 pending_rounds.cc:107] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:11:07.972975 17290 raft_consensus.cc:2889] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.957872 20988 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:07.981727 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:07.984010 18008 raft_consensus.cc:2410] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:07.989120 20856 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:07.990490 21118 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:07.996254 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 114294us
I20260709 12:11:07.947853 20841 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 12:11:07.970954 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 44725.5us
I20260709 12:11:07.962957 21071 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:07.980741 17332 leader_election.cc:336] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.681s (SENT)
I20260709 12:11:08.006901 17255 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:08.007877 18009 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:08.009121 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1819) took 1400 ms. Trace:
I20260709 12:11:08.011511 17365 raft_consensus.cc:1275] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:11:08.012122 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1820) took 1341 ms. Trace:
I20260709 12:11:08.012434 17365 rpcz_store.cc:276] 0709 12:11:06.671065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.010759 (+1339694us) service_pool.cc:224] Handling call
0709 12:11:08.011166 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.011878 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.012052 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.002840 18013 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:08.015496 17366 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:08.016165 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2609) took 1228 ms. Trace:
I20260709 12:11:08.016228 21038 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.016531 17366 rpcz_store.cc:276] 0709 12:11:06.787498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.014825 (+1227327us) service_pool.cc:224] Handling call
0709 12:11:08.015219 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.015934 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.016114 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:08.018846 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.015535 20841 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.019651 20841 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:08.020073 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:08.020681 17286 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.004812 21071 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:08.023102 21071 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.005163 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:08.005704 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 312222us
I20260709 12:11:08.028434 17286 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:08.020660 17361 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:08.009578 17367 rpcz_store.cc:276] 0709 12:11:06.608747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.008210 (+1399463us) service_pool.cc:224] Handling call
0709 12:11:08.008563 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.008757 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.008785 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.008857 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:08.008898 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.008961 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.009050 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.014025 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1821) took 1325 ms. Trace:
I20260709 12:11:08.030040 17980 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:08.030074 17365 rpcz_store.cc:276] 0709 12:11:06.688535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.013196 (+1324661us) service_pool.cc:224] Handling call
0709 12:11:08.013560 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.013742 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.013765 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.013804 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:08.013831 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.013881 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.013976 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.039649 17359 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:08.041637 18015 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:08.041637 18014 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:08.042153 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2623) took 1224 ms. Trace:
I20260709 12:11:08.042649 17361 rpcz_store.cc:276] 0709 12:11:06.817437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.020115 (+1202678us) service_pool.cc:224] Handling call
0709 12:11:08.020469 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.041827 (+ 21358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.042063 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.044561 17358 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:08.045698 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2616) took 1251 ms. Trace:
I20260709 12:11:08.046113 17358 rpcz_store.cc:276] 0709 12:11:06.794271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.740212 (+945941us) service_pool.cc:224] Handling call
0709 12:11:08.045621 (+305409us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:08.015705 21157 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:11:08.044560 17332 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:08.047190 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:08.048249 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 115502us
I20260709 12:11:08.020629 20841 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.051329 17360 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:08.050420 21038 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:08.052026 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1818) took 1449 ms. Trace:
W20260709 12:11:08.051774 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 71101.8us
I20260709 12:11:08.052446 17360 rpcz_store.cc:276] 0709 12:11:06.602473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.001016 (+1398543us) service_pool.cc:224] Handling call
0709 12:11:08.051123 (+ 50107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.051750 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.051958 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.052976 20856 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.054738 17359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:08.055326 17359 raft_consensus.cc:606] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:08.061336 17359 raft_consensus.cc:614] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:08.042835 21066 raft_consensus.cc:2764] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:08.046828 21060 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:08.065937 17285 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:08.071859 17367 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:08.072778 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 67711.5us
I20260709 12:11:08.061887 17366 raft_consensus.cc:2955] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:08.091104 17404 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:08.100726 21173 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.101296 21173 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.101650 21173 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.103236 21127 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:08.103971 21127 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.070966 21060 raft_consensus.cc:697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:08.074937 21052 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:08.077913 21038 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.123796 18007 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:08.124286 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:08.109850 21013 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:08.129889 20985 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.128095 21038 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:08.130679 17978 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:08.131115 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 60248.3us
I20260709 12:11:08.131570 20985 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.132017 20985 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:08.132423 20985 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.132758 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:08.133369 17404 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:08.133857 21056 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.134215 17981 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:08.134307 21056 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:08.134898 21056 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.135349 21066 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.135680 17981 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:08.134403 20312 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:08.157234 17333 leader_election.cc:336] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.577s (SENT)
I20260709 12:11:08.157788 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:08.161223 21127 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:08.162001 21013 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:08.143071 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.175912 17404 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:08.128922 21052 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:08.136412 20623 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.164674 20312 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.195067 20312 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.183843 20478 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:08.183485 20985 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.188308 21173 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:08.188509 21038 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.189539 21003 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:08.191504 20842 consensus_queue.cc:1059] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:08.193445 20989 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:08.194447 21118 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:08.215086 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 48327.9us
I20260709 12:11:08.199054 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1815) took 2151 ms. Trace:
W20260709 12:11:08.204128 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 71435.3us
W20260709 12:11:08.204878 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.207901 18012 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:11:08.216984 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.173254 21071 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:08.218312 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 59287.4us
I20260709 12:11:08.181418 21012 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:11:08.137054 20778 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:08.134560 21060 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.223479 17978 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:08.202711 20478 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:08.226967 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:08.216660 17364 rpcz_store.cc:276] 0709 12:11:06.028626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.902629 (+1874003us) service_pool.cc:224] Handling call
0709 12:11:07.902997 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.939435 (+ 36438us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:08.063852 (+124417us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.179835 (+115983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.179891 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:08.179935 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.180001 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.180123 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172221,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":21776,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":140219,"threads_started":2}
W20260709 12:11:08.233438 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.235323 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 172029us
I20260709 12:11:08.238291 17404 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:08.240674 20985 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:08.235133 20623 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.241796 20623 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:08.242270 20623 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.245379 21013 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.246989 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:08.230913 21150 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.246629 20478 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.257383 20778 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:08.230732 21118 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.260156 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:08.261045 21052 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.288945 20478 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.289381 21173 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:08.287964 21150 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:08.237187 20842 raft_consensus.cc:3055] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.291599 20842 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:08.291157 21150 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.292587 20842 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:08.293819 20842 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:08.268074 21176 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:11:08.299181 21118 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:08.265823 21181 consensus_queue.cc:1048] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:11:08.275332 20503 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:08.300246 20503 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:08.300683 20503 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:08.286429 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 51288.1us
I20260709 12:11:08.262058 21020 raft_consensus.cc:2764] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:08.294832 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:08.306746 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 46722.9us
I20260709 12:11:08.307384 17404 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:08.308943 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:08.310282 20623 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.312022 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:08.306162 21071 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:08.312533 20312 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.314951 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:08.332118 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44525.8us
I20260709 12:11:08.336704 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:08.337463 17438 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.341464 20312 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:08.342689 17437 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:08.344468 17436 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:08.331759 21020 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.346570 21056 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.349085 21056 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:08.330539 20778 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.351442 17404 leader_election.cc:400] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8.
I20260709 12:11:08.351867 17404 leader_election.cc:403] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:08.354918 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:08.358070 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.358414 20312 consensus_queue.cc:1059] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:08.359477 21127 raft_consensus.cc:3055] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:08.364583 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.366739 17438 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:08.367478 18012 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:08.359640 21012 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:08.371433 21012 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:08.372083 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.373208 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.373678 21012 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:08.374297 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.322638 20985 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:08.367363 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.375356 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:08.375835 18015 raft_consensus.cc:2410] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:08.376619 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.376767 18013 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:08.377107 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.368238 18009 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEARNER]: Advancing to term 11
I20260709 12:11:08.322496 21071 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.375864 18012 raft_consensus.cc:2376] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11. Re-sending same reply.
I20260709 12:11:08.382635 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:08.357933 21003 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8.
I20260709 12:11:08.380971 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.381995 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.385540 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.386827 18011 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:08.392665 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:08.400307 18009 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:11:08.400794 18009 pending_rounds.cc:85] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 7
I20260709 12:11:08.401024 18009 pending_rounds.cc:107] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:11:08.401254 18009 raft_consensus.cc:2889] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:08.402727 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:08.366479 21127 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:08.404500 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:08.413269 18015 raft_consensus.cc:2410] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:08.403439 18010 raft_consensus.cc:2376] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7. Re-sending same reply.
I20260709 12:11:08.393554 21071 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:08.399566 21056 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.434145 21056 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.434653 21056 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.391556 21012 consensus_queue.cc:1059] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:08.439038 21003 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:08.439479 21003 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:08.440505 21003 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:08.415131 21038 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:11:08.442239 21038 raft_consensus.cc:3055] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:08.442629 21038 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:08.443958 21020 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:08.443630 21038 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.445045 21038 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.429831 17407 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:08.446651 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 114391us
I20260709 12:11:08.448462 17407 leader_election.cc:400] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6.
I20260709 12:11:08.448791 17407 leader_election.cc:403] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:08.433050 21127 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:08.450083 21127 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.450439 21058 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:08.451028 21058 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.453212 21058 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:08.458338 20985 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.414940 21060 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:08.459035 20985 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.460069 21066 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:08.460484 21066 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:08.461469 21066 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.462066 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:08.462843 21066 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.463815 20985 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:08.439072 17364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:08.466723 17364 raft_consensus.cc:606] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:08.446529 20778 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.439074 20503 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:08.490665 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 120080us
I20260709 12:11:08.485551 20778 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:08.490456 21186 log.cc:927] Time spent T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:11:08.495846 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:08.498898 17286 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:08.500382 21058 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:08.508467 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.493808 20778 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.500429 21196 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 5. Current term is 6.
W20260709 12:11:08.470286 21150 consensus_queue.cc:1175] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaafaad0810b4e95983d2d73ec814346" responder_term: 10 status { last_received { term: 7 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: [9.8-9.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:08.524385 21196 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.526031 21196 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:08.509989 21071 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.527029 21196 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.523242 20778 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:08.609514 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.523290 21193 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 12:11:08.630692 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 135411us
I20260709 12:11:08.631378 21195 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.650442 20985 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.689074 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.689337 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.690009 17434 raft_consensus.cc:2393] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:08.692288 21193 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.695497 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.670193 20503 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:08.694198 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:08.696015 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.697700 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.691809 21195 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.696393 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:08.697619 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:08.694022 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 50415.7us
I20260709 12:11:08.698562 17441 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:08.699935 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.712338 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.712400 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:08.699720 17438 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.689304 21203 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:08.711241 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.704238 17439 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:08.705703 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:08.706182 17432 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.713727 17436 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:11:08.713727 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.699895 17433 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:11:08.708642 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.706768 17440 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:11:08.715339 17434 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 3.
I20260709 12:11:08.720541 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.690613 20985 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.727978 17435 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 11: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:08.728719 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.727589 17292 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:08.729861 17438 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:08.707274 21193 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.721238 21202 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:08.734879 21202 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.704623 21056 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:08.727005 21203 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:08.739610 20985 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:08.707058 21195 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:08.741267 21203 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:08.707125 21194 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:11:08.698005 21197 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:08.737892 21202 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:08.742331 21204 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:09.104905 21204 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:08.749732 21193 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:08.753095 21197 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:09.107976 21197 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.109256 21197 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.109932 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:09.000074 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 185989us
I20260709 12:11:09.111330 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:09.111907 17438 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.114535 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:09.115458 17434 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:09.116669 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:09.117375 17435 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:11:09.118043 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:09.118664 17436 raft_consensus.cc:2376] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10. Re-sending same reply.
I20260709 12:11:09.105892 21204 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:09.125263 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.126219 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:08.741691 21056 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:08.892719 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.049767 21003 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:09.139340 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.140085 21193 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.140601 21193 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.142736 21193 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:09.143923 17438 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:09.144403 20623 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:09.163707 17432 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:09.167218 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:09.167940 17441 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:11:09.169059 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:09.184034 17436 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
W20260709 12:11:09.197113 20778 consensus_meta.cc:287] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.640s	user 0.015s	sys 0.000s
I20260709 12:11:09.197657 20778 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.198915 17437 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.201228 20778 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:09.213068 21013 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.213763 21013 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:09.215370 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.216032 21013 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:09.216629 21013 consensus_queue.cc:1059] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:09.217510 21013 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:09.219776 21207 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:09.220286 21207 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:09.222728 21013 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:09.223785 21013 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:09.224812 21013 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.226051 21013 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.228137 17365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:09.228771 17365 raft_consensus.cc:606] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:09.229076 17365 raft_consensus.cc:614] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:09.223191 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 109917us
W20260709 12:11:09.231246 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 994108us
I20260709 12:11:09.231668 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:09.233898 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:09.235419 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:09.236608 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.237193 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.240760 20988 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:09.241739 20988 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:09.246760 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 1.00752e+06us
I20260709 12:11:09.247785 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:09.250998 21207 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:09.263192 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.262573 21207 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:09.264364 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.266362 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.267170 17362 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:09.265769 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.268055 21013 consensus_queue.cc:1059] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:09.268882 21013 consensus_queue.cc:1243] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer e860f7e876b74ec589f447737822a4f6 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:09.271973 21210 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.273901 17365 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.275695 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.280403 17362 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:09.278247 17358 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.278452 17290 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:09.279206 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:09.283147 17285 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:09.284301 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.285473 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:09.269907 21066 consensus_meta.cc:287] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.005s
I20260709 12:11:09.286459 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:09.286952 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:09.287093 21066 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:09.286450 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:09.287750 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:09.288213 17438 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
W20260709 12:11:09.288872 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.289283 17432 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:09.290062 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.285864 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.291955 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.287539 17434 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:09.292933 17290 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:09.292532 17367 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:09.292820 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:09.294138 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.290851 17441 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:09.289407 17438 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:09.286391 17435 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:09.290805 17362 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:09.286450 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:09.297051 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 47461.2us
I20260709 12:11:09.297472 17358 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.297796 17365 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:09.298851 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.299394 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:09.299708 17362 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:09.300176 18015 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:09.300575 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.301241 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.301995 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.299228 21060 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:09.303277 17981 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:09.303303 21060 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.304280 21060 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.303483 21204 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.303457 17362 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:09.279418 21213 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:09.309154 17358 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:09.310039 17981 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.306041 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.322628 17362 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:11:09.287631 21066 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.312434 17435 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:09.315946 17432 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:09.304241 21208 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.325943 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.331761 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.339000 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:09.336406 17365 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.310585 21204 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.344156 17404 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.317750 21213 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:09.354887 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:09.355700 17433 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 5.
I20260709 12:11:09.344034 20778 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.356427 20778 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.355937 21213 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.314523 20985 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:09.349696 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.340626 21056 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.349942 21066 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:09.348203 17365 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.352787 17367 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:09.354156 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.345395 21204 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.362401 17358 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.323923 21210 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.348145 21012 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.337494 21208 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:09.360605 21056 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.356858 20778 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.359652 21213 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.359705 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1817) took 2776 ms. Trace:
I20260709 12:11:09.364547 17404 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:09.364993 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.371803 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.360685 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 118533us
I20260709 12:11:09.359480 21003 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:09.357910 21038 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
W20260709 12:11:09.365490 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 53604us
I20260709 12:11:09.373101 17286 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:11:09.485054 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 141945us
I20260709 12:11:09.464965 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.471587 17358 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:09.491178 17365 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:09.491621 17365 pending_rounds.cc:85] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:11:09.491873 17365 pending_rounds.cc:107] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:09.492106 17365 raft_consensus.cc:2889] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:09.490433 17404 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.372444 17363 rpcz_store.cc:276] 0709 12:11:06.583043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.983113 (+1400070us) service_pool.cc:224] Handling call
0709 12:11:07.983559 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.049670 (+ 66111us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:08.359704 (+310034us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.359133 (+999429us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.359331 (+   198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.359382 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:09.359432 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.359496 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.359628 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":893848,"prepare.queue_time_us":1002030,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":113,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3349,"thread_start_us":396652,"threads_started":2,"wal-append.queue_time_us":133668}
I20260709 12:11:09.369572 21208 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.371577 21056 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.364573 21012 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:09.363456 21066 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 12:11:09.503858 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:09.507103 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.486390 21197 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.464637 21003 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.510291 21012 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.525864 17358 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.511744 21066 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:11:09.505864 21198 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:11:09.508314 20312 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:09.559847 17433 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
W20260709 12:11:09.584739 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.464929 21215 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.195s
I20260709 12:11:09.585668 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.601640 17367 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:11:09.588508 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.495492 21211 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:09.584333 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 210309us
W20260709 12:11:09.606673 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.602609 17363 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:09.612768 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.620810 17358 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:09.625274 17404 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.627300 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.595642 21003 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:09.566567 21217 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:11:09.603739 21197 raft_consensus.cc:697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:09.650458 17367 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:09.615809 21212 raft_consensus.cc:3055] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:09.582716 21219 consensus_queue.cc:1059] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:11:09.616536 20312 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:09.658813 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2617) took 2864 ms. Trace:
I20260709 12:11:09.604377 21058 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:11:09.659588 17366 rpcz_store.cc:276] 0709 12:11:06.794499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.017383 (+1222884us) service_pool.cc:224] Handling call
0709 12:11:08.017694 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.018032 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:08.194903 (+176871us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.356903 (+1162000us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.599479 (+242576us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.658377 (+ 58898us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.658442 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:09.658505 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.658582 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.658732 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5,"prepare.queue_time_us":1119640,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":7107,"raft.queue_time_us":11432,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":27850,"thread_start_us":337810,"threads_started":4,"wal-append.queue_time_us":267730,"wal-append.run_cpu_time_us":1224,"wal-append.run_wall_time_us":1011396}
I20260709 12:11:09.647475 21196 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.654309 21212 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:09.684044 17366 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:09.691156 21229 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:09.698621 21233 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.689392 21066 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.703696 21066 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.705227 21222 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.705785 21222 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.709223 21207 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.673974 21196 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.710510 17361 raft_consensus.cc:2410] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:09.711104 20312 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:09.706226 21220 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:11:09.702852 21227 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:09.713500 17332 leader_election.cc:336] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.540s (SENT)
I20260709 12:11:09.723567 17363 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:09.727232 17366 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:09.709820 21207 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.710656 21218 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.699332 21233 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:09.731505 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.665974 21224 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 12:11:09.748911 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 377485us
I20260709 12:11:09.751051 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:09.751760 21237 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.752450 21237 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.752750 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:09.705833 21066 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:09.756006 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:09.756392 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.732095 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.758391 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 134311us
I20260709 12:11:09.759198 21056 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.760232 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.746090 21219 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.763574 21219 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.765251 21227 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:09.765662 21227 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:09.730695 21197 consensus_queue.cc:237] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.747260 21218 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:09.764843 21060 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:09.747785 17388 debug-util.cc:398] Leaking SignalData structure 0x7b08003b48e0 after lost signal to thread 16128
W20260709 12:11:09.767092 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.776149 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.777012 21235 raft_consensus.cc:2764] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:11:09.777771 17359 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.654s	user 0.010s	sys 0.024s
W20260709 12:11:09.778177 17359 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.655s	user 0.010s	sys 0.024s
I20260709 12:11:09.766040 21227 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.768771 21196 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:09.777935 21235 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.775134 21234 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.792676 21226 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.793308 21226 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.793864 21202 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:09.795280 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:09.761775 21056 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:09.796597 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:09.796365 21003 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.797376 21235 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:09.798319 21235 raft_consensus.cc:697] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:09.798848 21173 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:09.799378 21173 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:09.799925 21235 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.800277 21173 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.802858 21226 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:09.804077 20623 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:09.804563 21218 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:09.806288 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.761929 17333 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.765920 21219 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:09.812546 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.778360 21231 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.813751 21196 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.785465 21212 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:09.797438 21233 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:09.816084 20623 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:09.816552 21003 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:09.811398 21193 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:11:09.823101 17360 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:09.824398 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.821208 21196 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:09.824980 17360 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:09.825843 21196 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.829560 20623 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:09.818787 21237 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:09.832345 21231 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.833420 21207 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:09.834209 21204 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.820353 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:09.836632 21225 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.837967 17255 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:09.838816 21224 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:09.839187 21213 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:09.839752 21213 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:09.840653 21213 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.836632 21204 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:09.843397 21231 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:09.820314 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.843833 21012 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.846592 17358 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:09.851943 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:09.852978 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.853334 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 91600.3us
I20260709 12:11:09.847538 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.853866 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 665) took 1989 ms. Trace:
I20260709 12:11:09.854271 17359 rpcz_store.cc:276] 0709 12:11:07.864516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.068114 (+203598us) service_pool.cc:224] Handling call
0709 12:11:08.071451 (+  3337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.079089 (+  7638us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:09.788205 (+1709116us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.853459 (+ 65254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.853513 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:09.853559 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.853674 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.853797 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40006,"prepare.queue_time_us":65292,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"thread_start_us":1671446,"threads_started":2}
I20260709 12:11:09.855885 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.856786 17359 raft_consensus.cc:2410] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:09.834964 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1789) took 1139 ms. Trace:
I20260709 12:11:09.849632 20778 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.862874 21208 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.858916 17437 rpcz_store.cc:276] 0709 12:11:08.695178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.699076 (+  3898us) service_pool.cc:224] Handling call
0709 12:11:08.710385 (+ 11309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.199283 (+488898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.834636 (+635353us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540015fed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:09.834871 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123055488}
I20260709 12:11:09.863548 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:09.865614 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.866240 17365 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.868680 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:09.872826 17360 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
W20260709 12:11:09.874032 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.874450 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.878669 17333 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.863502 20778 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:09.884363 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.886312 17358 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.867826 21204 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.875433 21237 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.884061 21193 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:09.875439 21207 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.875820 21231 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.902864 21221 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:09.892453 21234 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.892835 17333 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.891412 17258 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:09.903530 21237 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.906821 21012 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:09.907950 21227 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:09.909155 21210 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:09.892357 21204 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.909626 17365 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:09.910470 21222 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:09.910935 21060 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:09.892220 21224 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.957387 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:09.903965 21225 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.957683 21222 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:09.955245 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:09.958217 17365 raft_consensus.cc:2368] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12.
I20260709 12:11:09.961630 21208 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:09.962445 20841 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.902531 21223 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
W20260709 12:11:09.968091 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.958196 21222 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.925967 21207 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:09.969448 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 78100.7us
I20260709 12:11:09.970485 17404 leader_election.cc:400] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12.
I20260709 12:11:09.971966 17404 leader_election.cc:403] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:11:09.973196 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.929906 21193 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:09.993050 21193 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.956766 21204 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.982963 17358 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:11:09.984892 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 97645.2us
I20260709 12:11:09.931118 21234 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:09.985991 20778 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.962441 21012 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:09.988492 21249 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.989706 21228 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:09.968092 21248 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:11:09.982466 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:10.000253 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:10.078142 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 77991.9us
I20260709 12:11:09.977854 21222 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:09.977710 21207 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.930070 21231 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:10.083709 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 82653.3us
I20260709 12:11:10.084508 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.066490 21215 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:10.096164 17332 leader_election.cc:336] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.574s (SENT)
W20260709 12:11:10.096946 17332 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.686s (SENT)
W20260709 12:11:10.098721 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 126060us
I20260709 12:11:10.104465 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.105823 21071 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.106556 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:10.111565 17434 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:10.082049 21248 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:10.083003 21197 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:10.077435 21228 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:10.109510 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:10.083206 21012 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:10.112187 17332 leader_election.cc:336] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.691s (SENT)
I20260709 12:11:09.956678 21221 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.088171 21173 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.115947 17439 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:10.116696 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:10.124069 17441 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.117028 17436 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
W20260709 12:11:10.117460 17332 leader_election.cc:336] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.700s (SENT)
I20260709 12:11:10.118427 21012 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.118865 17407 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:10.115643 21020 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.087514 21249 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:10.127586 21020 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.149117 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1800) took 1041 ms. Trace:
I20260709 12:11:10.149658 17439 rpcz_store.cc:276] 0709 12:11:09.108123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.087071 (+978948us) service_pool.cc:224] Handling call
0709 12:11:10.149048 (+ 61977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.128831 21231 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:10.100660 21215 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.134860 21227 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:10.138075 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.137970 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 52674.7us
I20260709 12:11:10.148301 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:10.111357 21071 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:10.137454 21211 consensus_meta.cc:287] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.004s
I20260709 12:11:10.113040 21248 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:10.139112 21237 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:10.126057 21173 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:10.155784 21213 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.147921 21252 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:10.165975 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.192044 21020 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:10.192914 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:10.193849 21245 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:10.194244 21230 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:10.194816 21230 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:10.195775 21230 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:10.196693 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 879740us
I20260709 12:11:10.198346 21223 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:10.198985 21223 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:10.199878 21223 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.200899 21208 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:10.206947 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.193868 17333 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.168015 17283 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:10.191888 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:10.164450 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:10.208657 17436 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:10.169195 21211 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.176304 21173 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.165499 21071 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:10.215922 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.163986 17441 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:10.184440 21249 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.155859 21197 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:10.190622 20623 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.175897 21012 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:10.214030 17332 leader_election.cc:336] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.736s (SENT)
I20260709 12:11:10.167362 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:10.191819 21252 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.222141 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:10.223317 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.227095 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:10.189710 21204 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:10.226027 17332 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.806s (SENT)
I20260709 12:11:10.225984 17434 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.229080 17332 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:10.209424 20842 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.233750 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:10.234006 20842 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.228228 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.232427 21253 raft_consensus.cc:2764] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:10.242846 21253 raft_consensus.cc:2764] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:11:10.243376 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:10.243542 21253 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:10.232858 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:10.233428 21254 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:10.244731 21254 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:10.245152 21254 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:10.248139 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.250087 21012 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:10.250819 21234 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:10.250695 21012 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.252245 21215 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:10.220902 21020 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:10.252880 21012 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:10.254262 21012 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.254755 21012 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.258494 21197 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.244732 21118 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:10.260767 21118 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:10.263432 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.264536 17440 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:11:10.265481 17440 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1797) took 1158 ms (client timeout 1540 ms). Trace:
W20260709 12:11:10.265992 17440 rpcz_store.cc:269] 0709 12:11:09.107195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.191605 (+1084410us) service_pool.cc:224] Handling call
0709 12:11:10.265414 (+ 73809us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.267916 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:10.268347 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:10.269057 21066 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:10.269785 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:10.272136 17287 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:10.268597 17292 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:10.270906 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:10.270252 20623 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:10.176147 21228 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.364080 21228 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.213073 21213 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.272899 21012 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:10.261600 21118 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.367270 21118 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.367936 21213 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:10.231412 21252 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.276724 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:10.370231 17291 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:10.271538 21066 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.371256 21066 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.283779 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:10.374650 17285 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:10.271617 17436 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:10.276530 21052 consensus_queue.cc:1059] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:10.316939 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:10.267297 17406 leader_election.cc:336] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.236s (SENT)
W20260709 12:11:10.376719 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 109467us
I20260709 12:11:10.326793 17434 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:10.271989 17289 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:10.323865 21236 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:10.330431 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 104428us
W20260709 12:11:10.331148 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.359906 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 117600us
W20260709 12:11:10.379601 17332 leader_election.cc:336] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.893s (SENT)
I20260709 12:11:10.379907 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:10.380628 17332 leader_election.cc:336] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.908s (SENT)
I20260709 12:11:10.381006 21236 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.382282 17333 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:10.383091 21236 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:10.383574 21236 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:10.384425 21236 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.387058 21012 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.387662 21012 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.390014 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:10.390453 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.390841 17361 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.391857 21012 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:10.394117 21012 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.394737 21012 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.397939 17364 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 11. Ops: []
I20260709 12:11:10.397186 21012 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:10.406986 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:10.404039 21252 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.410583 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:10.410799 21066 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.399413 17361 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:10.413360 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.414005 17366 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
W20260709 12:11:10.331267 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 58302.8us
I20260709 12:11:10.417092 17981 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.425541 17361 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:10.425976 17437 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:11:10.506690 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:10.507252 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 125717us
I20260709 12:11:10.513707 18010 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:10.428350 17361 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:10.433254 18011 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:10.464747 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 254477us
I20260709 12:11:10.533429 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:10.533623 17258 connection.cc:256] RPC call timeout handler was delayed by -1.6505385039999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 12:11:10.534590 18007 raft_consensus.cc:2410] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:11:10.534068 17258 connection.cc:256] RPC call timeout handler was delayed by -1.2395512810001037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
W20260709 12:11:10.535562 17258 connection.cc:256] RPC call timeout handler was delayed by -1.2332512810000935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 12:11:10.535895 17258 connection.cc:256] RPC call timeout handler was delayed by -1.0892512810000881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 12:11:10.536186 17258 connection.cc:256] RPC call timeout handler was delayed by -1.0568512810000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 12:11:10.483068 18015 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:10.494544 17366 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:10.539322 17287 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:11:10.543236 17388 debug-util.cc:398] Leaking SignalData structure 0x7b08000f5d00 after lost signal to thread 17224
W20260709 12:11:10.547313 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.547833 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.548164 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.548449 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.550832 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 1.81945e+06us
I20260709 12:11:10.551926 17407 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:10.554603 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:10.556828 17388 debug-util.cc:398] Leaking SignalData structure 0x7b080016bd80 after lost signal to thread 17316
W20260709 12:11:10.557348 17388 debug-util.cc:398] Leaking SignalData structure 0x7b080016bda0 after lost signal to thread 17317
W20260709 12:11:10.565972 17388 debug-util.cc:398] Leaking SignalData structure 0x7b080036d9a0 after lost signal to thread 17391
W20260709 12:11:10.566485 17388 debug-util.cc:398] Leaking SignalData structure 0x7b08003bab40 after lost signal to thread 17392
W20260709 12:11:10.567727 17388 debug-util.cc:398] Leaking SignalData structure 0x7b080029a3a0 after lost signal to thread 17465
W20260709 12:11:10.569229 17388 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfa40 after lost signal to thread 18039
I20260709 12:11:10.415803 20985 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:10.570381 17388 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc2a0 after lost signal to thread 21155
I20260709 12:11:10.424636 21038 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.611240 17359 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:10.603777 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:10.614472 17361 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:10.464673 20778 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12.
I20260709 12:11:10.623014 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.626139 17366 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
W20260709 12:11:10.626353 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.432325 21231 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:10.621732 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 69905.4us
I20260709 12:11:10.623127 17364 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:10.633479 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.627902 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.630086 17365 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:10.635761 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 85235.8us
I20260709 12:11:10.641021 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.641837 17358 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:10.643878 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:10.644089 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 211970us
I20260709 12:11:10.569947 21213 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:10.650326 21196 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:10.616407 21227 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.666676 21252 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:10.666503 21227 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.669238 21227 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:10.670720 17365 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:10.671749 21249 consensus_queue.cc:1059] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:10.672845 21249 raft_consensus.cc:3055] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:10.673223 21249 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:10.676131 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.676548 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.676937 17361 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:10.677445 17366 raft_consensus.cc:2410] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:10.634346 20985 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.549733 21228 consensus_queue.cc:1059] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:11:10.631510 20312 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:11:10.649824 17404 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.646952 17359 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:10.678000 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.678370 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:10.704190 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:10.704625 17366 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:10.704847 17361 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 11: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:10.679313 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.678877 17358 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:10.680357 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.708912 17362 raft_consensus.cc:2410] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:10.704843 17359 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:11:10.711498 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 61762.5us
W20260709 12:11:10.713531 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 58212.2us
W20260709 12:11:10.572353 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:10.445071 21248 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.622822 21038 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.659425 17363 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:10.662230 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 125532us
I20260709 12:11:10.713269 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.716969 17407 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:10.686836 21222 consensus_meta.cc:287] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.001s
I20260709 12:11:10.652043 21202 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:10.692106 21268 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.338s	user 0.003s	sys 0.000s
I20260709 12:11:10.686313 21066 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:10.719168 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:10.720108 17332 leader_election.cc:336] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.003s (SENT)
I20260709 12:11:10.613942 21003 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.784480 20842 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:10.687281 21213 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.687525 21204 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:10.679931 21208 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:10.772342 17359 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:10.661401 21254 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.689589 21020 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:11:10.784173 17364 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:10.784300 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 64238.8us
W20260709 12:11:10.783810 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 70622.3us
I20260709 12:11:10.720849 21197 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.721046 21227 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.771392 21060 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.829025 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.823529 21248 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:10.758802 17366 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:11:10.820544 17978 leader_election.cc:336] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.898s (SENT)
I20260709 12:11:10.859588 17978 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:10.774034 21202 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.825440 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.782864 21222 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:10.841904 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 196339us
W20260709 12:11:10.853484 21207 consensus_meta.cc:287] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.000s
I20260709 12:11:10.691308 21071 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:10.762837 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 209466us
I20260709 12:11:10.845610 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.716229 21173 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:10.896036 21273 log.cc:927] Time spent T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:10.897224 21173 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:10.897527 21258 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:11:10.869776 21202 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.721020 21193 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
W20260709 12:11:10.854247 17332 leader_election.cc:336] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.035s (SENT)
W20260709 12:11:10.900518 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46344.7us
W20260709 12:11:10.901115 17332 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.253s (SENT) [suppressed 71 similar messages]
W20260709 12:11:10.901806 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.902202 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.902494 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.904207 21254 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:10.855662 21242 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:11:10.907095 20985 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:10.907413 21211 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:10.853685 21208 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.831270 21196 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:10.824299 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 53991.3us
I20260709 12:11:10.910936 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:10.820780 21281 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.824162 21038 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:10.840651 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 123757us
I20260709 12:11:10.842653 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:10.861182 17361 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:10.844221 21118 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.862545 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:10.839643 21231 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:10.862527 17980 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:10.787299 21261 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.855938 21020 consensus_queue.cc:1243] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:10.935649 21231 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.924899 21281 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.944523 21281 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:10.930887 21253 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.710963 21249 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.857738 21197 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.946163 21197 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.946646 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:10.890059 21248 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:10.890632 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 70138.1us
I20260709 12:11:10.860554 21060 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.838460 21066 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.899327 17359 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:10.907997 21211 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:10.717312 21252 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 12:11:10.960031 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:10.897224 21272 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:10.859305 20623 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:11:10.909827 21208 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:11:10.859046 21227 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:10.922164 21282 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.913218 21196 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:10.934592 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 92042.4us
I20260709 12:11:10.924746 21193 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:11:10.918388 21234 raft_consensus.cc:2764] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:10.932216 17358 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:10.861199 17366 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:10.956406 17359 raft_consensus.cc:1240] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:11:10.888269 21207 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:10.962248 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 99785.4us
I20260709 12:11:10.986948 17980 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:10.987934 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:10.988876 17980 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:10.965479 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:10.967073 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 49992.3us
I20260709 12:11:10.977018 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:10.980690 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.981256 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:10.996071 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:10.997280 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.998128 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:11.000701 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:10.974558 21275 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.958635 21237 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:11.025843 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 44631.9us
I20260709 12:11:11.026782 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:11.027956 18014 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:10.931994 21118 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:10.980573 21196 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.036078 17360 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.048482 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:11.048873 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:11.049132 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.049539 18013 raft_consensus.cc:2410] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:10.963666 21248 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.050218 17288 raft_consensus.cc:1217] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 5.7->[6.8-9.10]   Dedup: 6.8->[7.9-9.10]
I20260709 12:11:11.050901 17288 pending_rounds.cc:85] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 8
I20260709 12:11:11.049686 17287 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:11.051159 17288 pending_rounds.cc:107] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:11.051458 17288 raft_consensus.cc:2889] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:11.048391 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:11.052147 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:10.967630 21012 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:11:11.054580 18010 raft_consensus.cc:2368] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:11.054711 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.059657 17285 raft_consensus.cc:2410] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:11:10.999832 20841 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.064927 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:10.993767 21261 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.027524 21265 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.964766 21066 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.029388 21282 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:11.031805 21275 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.029004 21038 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:11.057850 21003 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.062526 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:11.071026 17364 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:11.079797 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:11.032968 21208 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:11.080463 18010 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.033082 21281 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:11.079895 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:11.053290 21237 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:11.081405 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:11.072403 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:11.081173 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:11.060989 21254 raft_consensus.cc:2764] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:11:11.086491 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 95960.5us
I20260709 12:11:11.088218 18013 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:11:11.091791 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:11.074899 21282 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.073534 21265 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:11.077935 21275 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.054013 21211 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:11.077173 21038 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.118721 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:11.134764 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 64342.4us
I20260709 12:11:11.082566 21208 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.092170 21213 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.158449 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:11.156236 21234 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.157557 18013 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:11.154425 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 62726.4us
I20260709 12:11:11.159327 21279 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:11.159600 20841 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:11.094311 21281 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:11.141559 21282 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:11.141333 21222 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.140913 21265 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.084589 21003 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.152064 21038 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.148663 21254 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.168812 18013 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:11.257138 18013 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:11:11.216264 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.150482 21208 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.147838 21071 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:11.241267 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 75711us
I20260709 12:11:11.260046 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:11.241879 17406 leader_election.cc:336] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.514s (SENT)
W20260709 12:11:11.244206 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 217502us
I20260709 12:11:11.246150 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:11.159765 21276 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.075975 21261 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.161362 21294 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.261571 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:11.167326 21211 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.261204 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:11.265189 17358 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:11.258065 18013 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.163708 21234 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:11.238360 20841 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.278033 18013 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.167508 21295 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:11.297102 18010 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
W20260709 12:11:11.301144 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 59301.6us
I20260709 12:11:11.305445 18010 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:11.305883 18010 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:11:11.307265 17406 leader_election.cc:336] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.575s (SENT)
I20260709 12:11:11.304297 20623 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.291105 21221 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:11.311957 21297 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:11:11.313568 21297 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:11.284158 21234 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.315371 21003 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:11.245299 21279 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.305059 21295 raft_consensus.cc:697] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:11.273221 21237 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.320240 21212 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.264545 20989 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:11.272754 21254 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.324474 21281 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.291391 20841 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.277019 21276 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.327773 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.401916 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.402586 17288 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:11.402756 21295 consensus_queue.cc:237] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:11.404107 18009 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.330343 21118 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:11.334187 21227 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.324571 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.409780 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.410049 21197 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:11.411088 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.412235 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.412321 21197 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:11.346316 18013 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:11:11.379798 21251 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:11:11.380990 21289 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:11:11.376626 18010 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.386029 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1840) took 1547 ms. Trace:
I20260709 12:11:11.301966 21060 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.416320 21227 raft_consensus.cc:2764] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:11.417244 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.418543 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:11.419706 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.419857 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.420441 17288 raft_consensus.cc:2393] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:11.281859 21294 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:11.421105 21229 raft_consensus.cc:3055] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:11.442826 21213 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:11.421018 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.443338 21213 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:11.421643 18010 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:11.426718 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 697) took 1211 ms. Trace:
I20260709 12:11:11.446259 17360 rpcz_store.cc:276] 0709 12:11:09.838792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.969222 (+130430us) service_pool.cc:224] Handling call
0709 12:11:09.987041 (+ 17819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.036596 (+1049555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.385785 (+349189us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540032fad4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:11.385966 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412037504}
I20260709 12:11:11.427716 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.449560 17286 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
W20260709 12:11:11.450529 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.421226 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.466759 17436 rpcz_store.cc:276] 0709 12:11:10.215460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.215652 (+   192us) service_pool.cc:224] Handling call
0709 12:11:10.230954 (+ 15302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.375596 (+144642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.426407 (+1050811us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b5400115654. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:11.426643 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93027712}
I20260709 12:11:11.454322 17291 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
W20260709 12:11:11.430503 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.471009 18009 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:11.439254 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.474238 17289 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
W20260709 12:11:11.437143 21267 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.023s	user 0.002s	sys 0.000s
I20260709 12:11:11.487421 18010 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:11:11.487901 18010 pending_rounds.cc:85] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 6
I20260709 12:11:11.488133 18010 pending_rounds.cc:107] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:11:11.488499 18010 raft_consensus.cc:2889] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:11.487422 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 225909us
I20260709 12:11:11.431653 21254 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:11.423488 21294 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.449991 21229 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:11.506464 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:11.507212 17287 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.507571 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:11.508244 17288 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:11.497977 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:11.439576 21261 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:11.508467 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:11.375408 21202 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:11.522724 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:11.473246 21282 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.538975 17287 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:11.476178 21038 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:11.541771 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 203201us
I20260709 12:11:11.542816 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.548368 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:11.549302 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:11.559444 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:11.562500 17287 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.564180 17333 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:11.567026 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.561705 21265 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.571092 21038 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:11.571439 21282 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.571656 21265 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:11.572052 21317 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:11.572307 21265 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.568051 21020 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.573084 21266 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.212s	user 0.004s	sys 0.000s
I20260709 12:11:11.573261 21020 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.575152 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:11.576012 17287 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:11.522187 21196 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:11.583259 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.623942 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:11.624810 17289 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:11.631507 21261 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:11.632181 21261 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:11.635867 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.647560 21261 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:11.658485 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:11.547055 21213 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:11.662500 21311 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:11:11.666388 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 119943us
W20260709 12:11:11.667706 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.668529 17332 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.096s (SENT)
I20260709 12:11:11.576156 21317 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:11.668407 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:11.679100 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:11.683076 17438 raft_consensus.cc:2368] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11.
I20260709 12:11:11.685010 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:11.625978 21222 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.685796 17440 raft_consensus.cc:2368] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9.
I20260709 12:11:11.669250 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:11.669469 21208 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:11.686724 17332 leader_election.cc:336] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.117s (SENT)
W20260709 12:11:11.693930 17332 leader_election.cc:336] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.131s (SENT)
W20260709 12:11:11.694082 21310 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:11:11.694308 18014 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:11:11.694540 17332 leader_election.cc:336] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.133s (SENT)
W20260709 12:11:11.695408 17332 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.199s (SENT)
I20260709 12:11:11.696550 21208 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.581190 21229 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.698589 21229 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:11.689528 21020 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.689687 17432 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 9. Ops: []
I20260709 12:11:11.699481 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:11.700174 17438 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:11.659708 21215 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:11.701321 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:11.703722 17437 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:11.702360 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:11.704137 17439 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.704609 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:11.705227 17361 raft_consensus.cc:2376] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11. Re-sending same reply.
I20260709 12:11:11.706346 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:11.706948 17361 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.684944 21317 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:11.728938 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.701869 21236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.314s	user 0.029s	sys 0.036s
I20260709 12:11:11.755133 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:11.690234 21309 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.755272 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:11.764923 17358 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:11.764830 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:11.771870 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:11.772969 17360 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:11.775871 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:11.771907 21213 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:11.763334 21236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.029s	sys 0.036s
I20260709 12:11:11.780622 20841 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.711035 21276 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.784310 17438 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
W20260709 12:11:11.783128 21275 consensus_meta.cc:287] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.628s	user 0.013s	sys 0.006s
I20260709 12:11:11.798277 21275 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.790171 21323 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:11.803880 21323 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.807080 21323 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:11.789733 21320 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:11:11.792872 21234 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:11.809374 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:11.809983 17364 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.810926 21234 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:11.812177 18012 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.813110 17367 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:11:11.813266 21275 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:11.814489 17362 raft_consensus.cc:1217] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[7.5-9.6]   Dedup: 7.5->[9.6-9.6]
I20260709 12:11:11.817356 17367 pending_rounds.cc:85] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 7
I20260709 12:11:11.817658 17367 pending_rounds.cc:107] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:11:11.817904 17367 raft_consensus.cc:2889] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:11.820392 17364 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:11.829226 17435 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:11.835531 17362 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:11.899646 17439 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
W20260709 12:11:11.942348 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.982174 21325 log.cc:927] Time spent T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:11:12.003500 17361 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:12.014736 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:12.015733 17438 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:11.984018 21221 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.017269 21221 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:12.023432 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:12.023701 17436 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:12.024765 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:12.025581 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:12.070566 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.180913 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.188228 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.461627 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.569401 17440 consensus_meta.cc:287] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.797s	user 0.004s	sys 0.000s
I20260709 12:11:12.576504 17440 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:12.010069 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:12.570608 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:12.578600 17361 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:12.579725 17364 raft_consensus.cc:2376] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12. Re-sending same reply.
W20260709 12:11:12.581669 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.583976 17439 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
W20260709 12:11:12.610240 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.025771 21300 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
W20260709 12:11:12.629549 17330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.261s	user 0.061s	sys 0.117s
W20260709 12:11:12.634580 17330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.266s	user 0.061s	sys 0.118s
I20260709 12:11:12.629984 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:12.640065 17438 raft_consensus.cc:2410] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:12.026544 21196 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:12.722736 20841 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:12.734510 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 693232us
W20260709 12:11:12.735749 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.759182 21300 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:11:12.726703 21323 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:12.816557 21316 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.117s	user 0.039s	sys 0.105s
W20260709 12:11:12.844087 17366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.133s	user 0.033s	sys 0.120s
W20260709 12:11:12.844455 17366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.033s	sys 0.120s
W20260709 12:11:12.848505 21316 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.040s	sys 0.106s
I20260709 12:11:12.852814 21323 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:12.946499 17438 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:12.941920 21340 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.950745 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 373157us
W20260709 12:11:12.951694 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.956849 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.964283 21229 consensus_meta.cc:287] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.265s	user 0.010s	sys 0.000s
I20260709 12:11:12.964955 21229 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.965467 21229 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:12.983928 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.994696 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.996012 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:12.999779 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2679) took 1829 ms. Trace:
I20260709 12:11:13.002998 17366 rpcz_store.cc:276] 0709 12:11:11.169986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.387825 (+217839us) service_pool.cc:224] Handling call
0709 12:11:11.388122 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.579038 (+190916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.579069 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.679004 (+ 99935us) log.cc:844] Serialized 26 byte log entry
0709 12:11:12.844822 (+1165818us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:12.844867 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.844942 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.999528 (+154586us) raft_consensus.cc:1685] finished
0709 12:11:12.999551 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.999705 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135232,"thread_start_us":1323771,"threads_started":2,"wal-append.queue_time_us":1247916}
I20260709 12:11:12.949908 21340 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:13.007095 17291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2631) took 1433 ms (client timeout 1649 ms). Trace:
W20260709 12:11:13.007617 17291 rpcz_store.cc:269] 0709 12:11:11.573699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.576710 (+  3011us) service_pool.cc:224] Handling call
0709 12:11:13.006991 (+1430281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.008890 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.009542 17291 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:13.015637 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:13.016599 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2601) took 1698 ms (client timeout 2169 ms). Trace:
W20260709 12:11:13.017618 17332 leader_election.cc:336] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.092s (SENT)
W20260709 12:11:13.016978 17285 rpcz_store.cc:269] 0709 12:11:11.318468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.015213 (+1696745us) service_pool.cc:224] Handling call
0709 12:11:13.016526 (+  1313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.018172 17332 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:13.019371 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:13.019914 21317 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.248s	user 0.007s	sys 0.004s
W20260709 12:11:13.020176 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2590) took 1708 ms (client timeout 2215 ms). Trace:
I20260709 12:11:13.020421 21317 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.021546 17358 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:13.022305 21342 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.022868 21317 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.022815 21342 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.023756 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 692) took 1318 ms. Trace:
W20260709 12:11:13.024037 17285 rpcz_store.cc:269] 0709 12:11:11.311772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.019031 (+1707259us) service_pool.cc:224] Handling call
0709 12:11:13.020114 (+  1083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.024209 17358 rpcz_store.cc:276] 0709 12:11:11.705262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.775547 (+ 70285us) service_pool.cc:224] Handling call
0709 12:11:13.023593 (+1248046us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540014afd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:13.023687 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2862968704}
I20260709 12:11:13.027021 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:13.027805 17438 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 11: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:13.028033 21343 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.028577 21343 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.036414 21228 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.037151 21228 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.038722 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 715) took 2606 ms. Trace:
I20260709 12:11:13.039497 21228 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.040199 21228 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.029158 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.041018 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:13.041599 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2613) took 1720 ms (client timeout 2215 ms). Trace:
W20260709 12:11:13.041724 17287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2592) took 1729 ms (client timeout 2127 ms). Trace:
W20260709 12:11:13.041972 17285 rpcz_store.cc:269] 0709 12:11:11.321404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.024890 (+1703486us) service_pool.cc:224] Handling call
0709 12:11:13.041539 (+ 16649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.043525 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:13.043289 17406 leader_election.cc:336] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.930s (SENT)
W20260709 12:11:13.043352 17287 rpcz_store.cc:269] 0709 12:11:11.312297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.630885 (+318588us) service_pool.cc:224] Handling call
0709 12:11:13.041672 (+1410787us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.045501 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:13.045668 17406 leader_election.cc:336] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.930s (SENT)
I20260709 12:11:13.039129 17292 rpcz_store.cc:276] 0709 12:11:10.432724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.511200 (+ 78476us) service_pool.cc:224] Handling call
0709 12:11:10.511654 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.550118 (+ 38464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.550151 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.440687 (+890536us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b1800377980. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229fc2a6 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a
0709 12:11:11.441159 (+   472us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b2c000fc478. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:11:11.441759 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.602397 (+160638us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:11.602441 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.602530 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.038488 (+1435958us) raft_consensus.cc:1685] finished
0709 12:11:13.038509 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.038665 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37938,"raft.queue_time_us":59815,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":38265,"spinlock_wait_cycles":5641344,"thread_start_us":160186,"threads_started":1,"wal-append.queue_time_us":340306,"wal-append.run_cpu_time_us":1864,"wal-append.run_wall_time_us":1018073}
I20260709 12:11:13.046067 17287 raft_consensus.cc:2376] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10. Re-sending same reply.
W20260709 12:11:13.046633 17287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2607) took 1726 ms (client timeout 2251 ms). Trace:
I20260709 12:11:13.047264 21230 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:13.046882 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.048118 17292 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:13.047830 21230 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.048393 21323 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.049005 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2628) took 1493 ms. Trace:
I20260709 12:11:13.049382 17292 rpcz_store.cc:276] 0709 12:11:11.555168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.046603 (+1491435us) service_pool.cc:224] Handling call
0709 12:11:13.048945 (+  2342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.050166 21230 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.050968 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.051326 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:13.051707 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:13.052109 17438 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:13.047237 17287 rpcz_store.cc:269] 0709 12:11:11.319918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.045220 (+1725302us) service_pool.cc:224] Handling call
0709 12:11:13.046577 (+  1357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.056782 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.041018 17291 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:11:13.053198 21342 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.053534 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.057592 17292 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:13.054157 21343 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.058260 17439 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:13.056815 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.059538 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2603) took 1740 ms. Trace:
I20260709 12:11:13.058126 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2619) took 1625 ms. Trace:
I20260709 12:11:13.055714 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:13.052120 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2582) took 1748 ms (client timeout 2236 ms). Trace:
I20260709 12:11:13.060444 17440 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:13.060787 17291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2612) took 1739 ms (client timeout 2127 ms). Trace:
I20260709 12:11:13.059993 17287 rpcz_store.cc:276] 0709 12:11:11.318972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.056553 (+1737581us) service_pool.cc:224] Handling call
0709 12:11:13.059477 (+  2924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20224}
I20260709 12:11:13.051908 21340 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.061136 17292 rpcz_store.cc:276] 0709 12:11:11.433528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.050043 (+1616515us) service_pool.cc:224] Handling call
0709 12:11:13.058038 (+  7995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.062186 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:13.059455 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.063746 17406 connection.cc:256] RPC call timeout handler was delayed by -1.2936086630002137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 12:11:13.061502 17285 rpcz_store.cc:269] 0709 12:11:11.304105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.050689 (+1746584us) service_pool.cc:224] Handling call
0709 12:11:13.052061 (+  1372us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.062258 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.074447 17292 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:11:13.074900 17406 leader_election.cc:336] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.973s (SENT)
I20260709 12:11:13.075058 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2587) took 1764 ms. Trace:
I20260709 12:11:13.075408 17406 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:13.075738 17292 rpcz_store.cc:276] 0709 12:11:11.311013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.062041 (+1751028us) service_pool.cc:224] Handling call
0709 12:11:13.074982 (+ 12941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.073036 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 729) took 1491 ms. Trace:
I20260709 12:11:13.077008 17287 rpcz_store.cc:276] 0709 12:11:11.581307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.061894 (+1480587us) service_pool.cc:224] Handling call
0709 12:11:13.072924 (+ 11030us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.061161 17291 rpcz_store.cc:269] 0709 12:11:11.321138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.008575 (+1687437us) service_pool.cc:224] Handling call
0709 12:11:13.060728 (+ 52153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.079342 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:13.079694 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:13.081943 17332 leader_election.cc:336] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 3.085s (SENT)
I20260709 12:11:13.061256 21229 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.087544 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:13.088107 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.088276 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1766) took 1512 ms. Trace:
I20260709 12:11:13.073213 21340 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:13.089056 17287 raft_consensus.cc:2410] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:13.079753 21342 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:13.082827 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:13.090433 17364 raft_consensus.cc:2410] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:13.091550 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:13.083590 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:13.092682 17366 raft_consensus.cc:2410] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:13.084421 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:13.093259 17361 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:13.088258 17358 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:13.023530 21317 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.082154 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.096525 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2595) took 1783 ms. Trace:
I20260709 12:11:13.097039 17287 rpcz_store.cc:276] 0709 12:11:11.313042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.077722 (+1764680us) service_pool.cc:224] Handling call
0709 12:11:13.096457 (+ 18735us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.102432 17978 connection.cc:256] RPC call timeout handler was delayed by -1.6383514809999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 12:11:13.103075 17978 connection.cc:256] RPC call timeout handler was delayed by -1.5340397530001155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 12:11:13.103518 17978 connection.cc:256] RPC call timeout handler was delayed by -1.4974396940001498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 12:11:13.088976 17285 rpcz_store.cc:276] 0709 12:11:11.574777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.079472 (+1504695us) service_pool.cc:224] Handling call
0709 12:11:13.087170 (+  7698us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.104164 17978 connection.cc:256] RPC call timeout handler was delayed by -1.4536706590001813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 12:11:13.104672 17978 connection.cc:256] RPC call timeout handler was delayed by -1.1751097670000945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23399999999999999s for a response
I20260709 12:11:13.107744 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.107770 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:13.082576 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:13.103443 17361 raft_consensus.cc:2410] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:13.109383 17358 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.106216 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.110788 17285 raft_consensus.cc:2410] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:13.111366 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2629) took 1552 ms. Trace:
I20260709 12:11:13.111732 17287 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:13.112762 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2624) took 1603 ms. Trace:
I20260709 12:11:13.114076 17287 rpcz_store.cc:276] 0709 12:11:11.509209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.097796 (+1588587us) service_pool.cc:224] Handling call
0709 12:11:13.112700 (+ 14904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.114559 17285 rpcz_store.cc:276] 0709 12:11:11.561987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.105896 (+1543909us) service_pool.cc:224] Handling call
0709 12:11:13.111288 (+  5392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.107162 21229 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.117040 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.117767 17285 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:11:13.118451 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 728) took 1698 ms. Trace:
I20260709 12:11:13.118904 17285 rpcz_store.cc:276] 0709 12:11:11.420398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.115714 (+1695316us) service_pool.cc:224] Handling call
0709 12:11:13.118358 (+  2644us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.119992 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:13.120743 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.121779 17285 raft_consensus.cc:2410] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:13.095404 21340 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.122611 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2630) took 1549 ms. Trace:
I20260709 12:11:13.123970 17285 rpcz_store.cc:276] 0709 12:11:11.573382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.119711 (+1546329us) service_pool.cc:224] Handling call
0709 12:11:13.122549 (+  2838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.102561 21317 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.131286 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.132264 17287 raft_consensus.cc:2410] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:13.106600 21342 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.132860 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.132499 17358 raft_consensus.cc:2410] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:13.136075 17364 raft_consensus.cc:2410] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:13.136360 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2584) took 1831 ms. Trace:
W20260709 12:11:13.137036 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 55129.3us
I20260709 12:11:13.136772 17287 rpcz_store.cc:276] 0709 12:11:11.304634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.116586 (+1811952us) service_pool.cc:224] Handling call
0709 12:11:13.136286 (+ 19700us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.122525 21343 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:13.136808 17285 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.124048 21229 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.134912 21344 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.133668 21221 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:13.142788 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.147446 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.148514 17287 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:13.149041 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1765) took 1574 ms. Trace:
I20260709 12:11:13.149420 17287 rpcz_store.cc:276] 0709 12:11:11.574498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.139330 (+1564832us) service_pool.cc:224] Handling call
0709 12:11:13.148973 (+  9643us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.158768 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.159785 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2633) took 1585 ms. Trace:
I20260709 12:11:13.164031 17287 rpcz_store.cc:276] 0709 12:11:11.574236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.151897 (+1577661us) service_pool.cc:224] Handling call
0709 12:11:13.159710 (+  7813us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.173550 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.197343 21196 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:13.199663 21340 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.200008 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.200934 17287 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:13.201512 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2617) took 1823 ms. Trace:
I20260709 12:11:13.201920 17287 rpcz_store.cc:276] 0709 12:11:11.387090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.165369 (+1778279us) service_pool.cc:224] Handling call
0709 12:11:13.201441 (+ 36072us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.204282 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:13.205998 17981 connection.cc:256] RPC call timeout handler was delayed by -1.3427521309999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 12:11:13.206983 17981 connection.cc:256] RPC call timeout handler was delayed by -1.2164652550000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
I20260709 12:11:13.206908 17285 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:13.208345 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:13.209199 18010 raft_consensus.cc:2368] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11.
I20260709 12:11:13.208360 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2632) took 1634 ms. Trace:
I20260709 12:11:13.210435 17285 rpcz_store.cc:276] 0709 12:11:11.573966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.132592 (+1558626us) service_pool.cc:224] Handling call
0709 12:11:13.208299 (+ 75707us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.210345 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.211850 17285 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:13.212639 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2593) took 1900 ms. Trace:
W20260709 12:11:13.211714 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 136861us
I20260709 12:11:13.212932 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:13.213117 17285 rpcz_store.cc:276] 0709 12:11:11.312556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.211313 (+1898757us) service_pool.cc:224] Handling call
0709 12:11:13.211628 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.212380 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.212581 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.213223 17406 connection.cc:256] RPC call timeout handler was delayed by -1.2831037189998824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
I20260709 12:11:13.214758 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:13.215035 17406 leader_election.cc:336] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.127s (SENT)
I20260709 12:11:13.215565 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2594) took 1902 ms. Trace:
I20260709 12:11:13.215394 18010 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:13.216037 17285 rpcz_store.cc:276] 0709 12:11:11.312789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.214569 (+1901780us) service_pool.cc:224] Handling call
0709 12:11:13.214895 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.215080 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.215106 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.215229 (+   123us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:13.215274 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.215332 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.215505 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.215514 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:13.220479 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.221248 17285 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:11:13.221455 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 104813us
I20260709 12:11:13.222060 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2596) took 1908 ms. Trace:
I20260709 12:11:13.221719 17287 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:13.222862 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.223029 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.223196 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.223716 18015 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 11: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:13.222473 17285 rpcz_store.cc:276] 0709 12:11:11.313291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.217335 (+1904044us) service_pool.cc:224] Handling call
0709 12:11:13.217647 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.221776 (+  4129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.222003 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.223843 18011 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:13.226006 17285 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:13.226796 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:13.227372 21347 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:13.227448 21317 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.227380 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:13.225871 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.230345 18011 raft_consensus.cc:2393] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:13.207340 21340 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.231352 18010 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:13.228943 21347 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:13.231596 21348 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:13.232235 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.232812 18010 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:13.233716 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.234367 18010 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:11:13.235201 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:13.236171 17406 connection.cc:256] RPC call timeout handler was delayed by -1.0983086630001253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 12:11:13.237154 21207 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.237324 18010 raft_consensus.cc:2368] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11.
I20260709 12:11:13.233783 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:13.238595 17406 connection.cc:256] RPC call timeout handler was delayed by -1.0941001379999307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4912s for a response
I20260709 12:11:13.239032 18013 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
W20260709 12:11:13.239387 17406 connection.cc:256] RPC call timeout handler was delayed by -1.0497086630000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260709 12:11:13.230963 17978 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:13.242417 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:13.242434 17332 leader_election.cc:336] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.253s (SENT)
I20260709 12:11:13.240095 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:13.243588 18011 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:11:13.240324 17406 leader_election.cc:336] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.506s (SENT)
I20260709 12:11:13.224053 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2589) took 1912 ms. Trace:
I20260709 12:11:13.244187 17406 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:13.246750 18007 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:13.247525 21196 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.247828 21229 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:13.251116 21340 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.258893 21229 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:13.246987 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:13.248349 17406 leader_election.cc:336] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.649s (SENT)
I20260709 12:11:13.240005 21351 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.261658 17981 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:13.262598 21351 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.264139 17292 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:13.264513 21229 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.264889 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2605) took 1945 ms. Trace:
I20260709 12:11:13.265031 21229 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:13.266216 21229 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.270519 21340 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.272560 21352 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.251612 17287 rpcz_store.cc:276] 0709 12:11:11.311538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.206038 (+1894500us) service_pool.cc:224] Handling call
0709 12:11:13.223991 (+ 17953us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.274030 17406 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:13.280182 21352 raft_consensus.cc:697] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:13.280393 21202 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:13.292996 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 727) took 1962 ms. Trace:
I20260709 12:11:13.294302 21351 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:13.295120 17406 leader_election.cc:336] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.723s (SENT)
I20260709 12:11:13.294816 21352 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.265334 17292 rpcz_store.cc:276] 0709 12:11:11.319438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.261089 (+1941651us) service_pool.cc:224] Handling call
0709 12:11:13.261553 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.264608 (+  3055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.264823 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.296921 21302 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 1.479s	user 0.010s	sys 0.011s
I20260709 12:11:13.226787 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2604) took 1907 ms. Trace:
I20260709 12:11:13.254335 21354 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.255792 18015 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:13.257473 21248 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.297557 17285 rpcz_store.cc:276] 0709 12:11:11.319207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.224924 (+1905717us) service_pool.cc:224] Handling call
0709 12:11:13.225630 (+   706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.226508 (+   878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.226723 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.293372 17287 rpcz_store.cc:276] 0709 12:11:11.330516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.276438 (+1945922us) service_pool.cc:224] Handling call
0709 12:11:13.276779 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.276972 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.277002 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.277044 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:13.277074 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.277129 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.292927 (+ 15798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.295646 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:13.301047 17406 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.760s (SENT)
I20260709 12:11:13.301751 21351 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.302536 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:13.303474 21296 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.304031 17406 leader_election.cc:336] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.080s (SENT)
W20260709 12:11:13.305248 17406 leader_election.cc:336] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.215s (SENT)
I20260709 12:11:13.305424 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:13.305621 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:13.306082 17361 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.299397 17285 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:13.306730 17285 pending_rounds.cc:85] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 5
I20260709 12:11:13.306962 17285 pending_rounds.cc:107] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:13.307199 17285 raft_consensus.cc:2889] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.307423 21249 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.307953 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2625) took 1791 ms. Trace:
W20260709 12:11:13.302706 21328 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 1.522s	user 0.013s	sys 0.025s
I20260709 12:11:13.304087 21296 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.287178 21348 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.293565 17284 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:13.316125 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2620) took 1881 ms. Trace:
I20260709 12:11:13.316313 21296 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.316483 17284 rpcz_store.cc:276] 0709 12:11:11.435345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.282597 (+1847252us) service_pool.cc:224] Handling call
0709 12:11:13.283033 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.315869 (+ 32836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.316070 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.317296 17361 raft_consensus.cc:2410] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:13.317157 21296 consensus_queue.cc:1059] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:11:13.313323 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.296963 17292 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:13.320119 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2621) took 1884 ms. Trace:
I20260709 12:11:13.320350 17292 rpcz_store.cc:276] 0709 12:11:11.437323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.296171 (+1858848us) service_pool.cc:224] Handling call
0709 12:11:13.296576 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.319920 (+ 23344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.320073 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.322351 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 57678.5us
I20260709 12:11:13.323644 17437 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:13.306322 21351 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.310611 21316 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.312317 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:13.325042 17366 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.325309 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.308355 17285 rpcz_store.cc:276] 0709 12:11:11.516762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.298666 (+1781904us) service_pool.cc:224] Handling call
0709 12:11:13.299016 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.307660 (+  8644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.307888 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.309605 17406 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.415s (SENT)
I20260709 12:11:13.313301 17358 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:13.326537 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:13.323134 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 61968.8us
I20260709 12:11:13.313786 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 856) took 2317 ms. Trace:
I20260709 12:11:13.328015 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.328984 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:13.330396 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:13.331833 21335 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 1.305s	user 0.001s	sys 0.000s
I20260709 12:11:13.333158 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1809) took 1652 ms. Trace:
I20260709 12:11:13.333607 17433 rpcz_store.cc:276] 0709 12:11:11.681041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.681228 (+   187us) service_pool.cc:224] Handling call
0709 12:11:11.681633 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.688518 (+  6885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.688555 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.695217 (+  6662us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.785109 (+ 89892us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:11.785155 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.785242 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.331242 (+1546000us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:13.332821 (+  1579us) raft_consensus.cc:1685] finished
0709 12:11:13.332847 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.333081 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2751,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2313,"spinlock_wait_cycles":1279721344,"thread_start_us":89477,"threads_started":1,"wal-append.queue_time_us":331375}
I20260709 12:11:13.335242 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:13.335999 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.327558 18008 rpcz_store.cc:276] 0709 12:11:10.996006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.996134 (+   128us) service_pool.cc:224] Handling call
0709 12:11:11.063825 (+ 67691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.064094 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.064117 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.072024 (+  7907us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.255337 (+183313us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:11.255375 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.255441 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.296312 (+2040871us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:13.309454 (+ 13142us) raft_consensus.cc:1685] finished
0709 12:11:13.309477 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.313718 (+  4241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338180992,"thread_start_us":175822,"threads_started":1,"wal-append.queue_time_us":639081}
I20260709 12:11:13.336284 17365 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:11:13.336675 17365 pending_rounds.cc:85] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 6
I20260709 12:11:13.336905 17365 pending_rounds.cc:107] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:11:13.337119 17365 raft_consensus.cc:2889] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.337713 21345 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.338354 21345 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.338696 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.339378 17439 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:13.347719 17366 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:13.346069 17432 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:13.345911 17179 maintenance_manager.cc:419] P 437023cdfca24d7494e0818062a37383: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033465
I20260709 12:11:13.349154 17439 raft_consensus.cc:1240] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:11:13.349987 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:13.354480 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:13.361032 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 60323.6us
I20260709 12:11:13.355724 21357 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.363771 17978 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:13.364102 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 861) took 2366 ms. Trace:
I20260709 12:11:13.355851 21316 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:13.351517 17406 leader_election.cc:336] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.415s (SENT)
I20260709 12:11:13.364578 18012 rpcz_store.cc:276] 0709 12:11:10.997338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.092417 (+ 95079us) service_pool.cc:224] Handling call
0709 12:11:11.150701 (+ 58284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.812560 (+661859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.363819 (+1551259us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b540067ff54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:13.364029 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520788352}
I20260709 12:11:13.377444 17407 leader_election.cc:400] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:13.378000 17407 leader_election.cc:403] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:13.364432 21229 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.363642 21357 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.382751 21363 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.383047 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:13.383391 21363 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:13.375120 21196 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:13.381070 21351 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.389599 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:13.400535 21229 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.401221 21229 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:13.384591 21357 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.392953 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:13.391906 21359 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:13.389083 21360 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:13.408530 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:13.386757 21196 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.413643 21369 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:13.402225 21229 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.404841 21363 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.407256 21360 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:13.438880 21196 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.440171 21366 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.446285 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.446772 21366 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.447258 21366 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.448269 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2641) took 4163 ms. Trace:
I20260709 12:11:13.448689 17367 rpcz_store.cc:276] 0709 12:11:09.285097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.653165 (+368068us) service_pool.cc:224] Handling call
0709 12:11:09.653492 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.983202 (+2329710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.447994 (+1464792us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54002922d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:13.448189 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4965884160}
I20260709 12:11:13.417691 21369 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.450824 21369 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.417390 21355 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.452584 21355 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.452953 21355 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:13.456782 17288 consensus_meta.cc:287] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.943s	user 0.011s	sys 0.016s
I20260709 12:11:13.457139 17288 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
W20260709 12:11:13.457665 17288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2591) took 2145 ms (client timeout 1973 ms). Trace:
W20260709 12:11:13.458089 17288 rpcz_store.cc:269] 0709 12:11:11.312020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.479163 (+167143us) service_pool.cc:224] Handling call
0709 12:11:13.457588 (+1978425us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.459043 17286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2602) took 2140 ms (client timeout 1649 ms). Trace:
W20260709 12:11:13.459499 17286 rpcz_store.cc:269] 0709 12:11:11.318735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.411979 (+ 93244us) service_pool.cc:224] Handling call
0709 12:11:13.458851 (+2046872us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b54001b6054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:13.458963 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84371840}
W20260709 12:11:13.460108 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 51648.8us
I20260709 12:11:13.460870 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:13.462533 21304 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:13.463179 21304 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.464148 21357 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.466863 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:13.468159 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.466130 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.467610 17437 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:13.469658 17439 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:13.472002 17333 leader_election.cc:400] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11.
I20260709 12:11:13.472599 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:13.473019 17333 leader_election.cc:403] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:13.475222 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.475167 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.475991 17436 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
W20260709 12:11:13.477459 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 115035us
I20260709 12:11:13.465492 21304 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.474551 17333 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:13.469607 21354 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.479554 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:13.474994 21252 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.476011 21249 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11.
I20260709 12:11:13.465741 21196 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:13.484246 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:13.486438 21373 consensus_queue.cc:1059] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:13.487936 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:13.490891 17333 leader_election.cc:400] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11.
I20260709 12:11:13.491235 17333 leader_election.cc:403] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:13.487668 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 110376us
I20260709 12:11:13.492787 17407 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:13.495142 17333 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:13.496009 21207 raft_consensus.cc:2764] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:11:13.496435 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:13.496949 21202 consensus_queue.cc:1059] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:13.481593 21248 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.508796 21372 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:13.510867 21372 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:13.511505 21372 consensus_queue.cc:1243] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer 868a5e341d0a41b4ac0927342c8cd598 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:13.512357 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:13.487670 21304 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:13.517524 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.513173 21248 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:13.494534 21341 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:13.519747 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:13.520742 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.521497 17361 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:13.507298 21207 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.523236 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.523983 17432 raft_consensus.cc:2410] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:13.506170 21223 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:13.512223 21357 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:13.494450 21348 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.506232 21340 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11.
W20260709 12:11:13.519742 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.525251 21223 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.519631 21248 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.489176 21252 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.484956 21360 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.531625 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:13.532372 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 53787.1us
I20260709 12:11:13.521091 21341 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:13.535765 21351 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:13.539461 17436 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:13.542423 21066 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.543583 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.544206 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:13.526962 21207 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:13.536849 21341 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.530393 21223 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.547552 17439 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:13.546909 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.550563 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.555102 17433 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:13.546360 21249 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.552441 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:13.555979 17434 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.556164 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.556770 17440 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:13.558269 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:13.558931 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.558537 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:13.559576 17437 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:11:13.534904 21304 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:13.561728 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.562551 17440 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 11: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:13.561767 21304 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.555743 21249 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.566342 21304 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.566649 21249 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.555269 21207 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.552829 21360 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.566684 21252 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.575109 21355 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.552987 21373 raft_consensus.cc:3055] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:11:13.577090 21223 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.577520 21373 raft_consensus.cc:740] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:13.558408 21366 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.578895 17433 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:13.579015 17332 leader_election.cc:336] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.882s (SENT)
I20260709 12:11:13.579464 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:13.581113 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.583015 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.583778 17288 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:13.584626 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.585214 17292 raft_consensus.cc:2376] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10. Re-sending same reply.
I20260709 12:11:13.586427 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.586277 21252 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.592310 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.593101 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.594180 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:13.594357 17406 leader_election.cc:336] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.897s (SENT)
I20260709 12:11:13.594780 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:13.594971 17292 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:13.593923 17285 raft_consensus.cc:2410] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:13.553380 21380 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.600592 17432 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:13.592847 21248 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.602250 21204 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.605020 21248 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.593990 17434 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:13.610673 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:13.612483 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.613405 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.613766 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.614200 17286 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:13.615943 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.616634 17287 raft_consensus.cc:2368] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10.
I20260709 12:11:13.618690 21215 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:13.619202 21215 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.622505 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.623423 17284 raft_consensus.cc:2410] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:13.624500 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:13.624495 21366 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.624718 21355 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.630461 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.631132 17292 raft_consensus.cc:2376] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8. Re-sending same reply.
I20260709 12:11:13.631214 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.625926 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:13.633340 17360 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.615358 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.646829 17285 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:13.638368 17333 leader_election.cc:336] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 1.964s (SENT)
I20260709 12:11:13.651052 17288 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:13.654527 17433 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
W20260709 12:11:13.661412 17333 leader_election.cc:336] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 2.003s (SENT)
I20260709 12:11:13.661979 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:13.665256 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.665959 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.666260 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:13.666818 17436 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:11:13.669296 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.670198 17284 raft_consensus.cc:2368] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12.
I20260709 12:11:13.671793 21341 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.692904 17366 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:13.701385 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.681605 21248 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.598848 21380 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.710027 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.705914 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:13.708318 17333 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 2.096s (SENT)
I20260709 12:11:13.712248 17333 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:13.712947 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.714193 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 180396us
I20260709 12:11:13.717504 17360 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:13.717559 17433 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:13.720541 17287 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:13.723531 17286 raft_consensus.cc:2410] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:13.722505 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.725678 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.725939 17358 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:11:13.727923 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:13.729049 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:13.729598 17333 leader_election.cc:336] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 2.117s (SENT)
I20260709 12:11:13.651976 21373 consensus_queue.cc:260] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.729724 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1854) took 2611 ms. Trace:
I20260709 12:11:13.732188 17362 rpcz_store.cc:276] 0709 12:11:11.118155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.276728 (+158573us) service_pool.cc:224] Handling call
0709 12:11:11.814273 (+537545us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:11.836105 (+ 21832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.729543 (+1893438us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54003f0050. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:13.729669 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190839680}
I20260709 12:11:13.730406 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:13.716406 21374 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.735558 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 227341us
I20260709 12:11:13.736218 21373 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:13.737351 17287 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:13.739167 21196 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:13.742789 21386 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:13.731271 21230 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.743608 21386 consensus_queue.cc:1243] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer 868a5e341d0a41b4ac0927342c8cd598 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:13.743914 21381 consensus_queue.cc:1059] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:11:13.744777 21204 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:13.745164 21204 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:13.746031 21204 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.747027 21204 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.732671 21369 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.750700 21369 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.751776 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.753182 21380 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:13.757828 21207 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.759037 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.760543 17285 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:13.761658 17285 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:13.762483 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.762671 17292 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:11:13.763159 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.767462 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:13.768244 17363 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.772718 21349 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.773432 21349 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.762930 21374 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.778618 17287 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:13.779882 21374 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:13.785377 21333 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 1.775s	user 0.001s	sys 0.000s
I20260709 12:11:13.786540 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.787811 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.788865 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.734122 21366 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.790732 21366 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:13.791742 21366 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.792719 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.793817 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 714) took 3477 ms. Trace:
I20260709 12:11:13.764230 21369 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:13.794235 17283 rpcz_store.cc:276] 0709 12:11:10.316677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.420173 (+103496us) service_pool.cc:224] Handling call
0709 12:11:10.465592 (+ 45419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.507286 (+ 41694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.507317 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:10.524533 (+ 17216us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.422270 (+897737us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b1800369940. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:11.630206 (+207936us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:11.630254 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.630341 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.302080 (+1671739us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:13.793614 (+491534us) raft_consensus.cc:1685] finished
0709 12:11:13.793635 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.793761 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79967,"raft.queue_time_us":48190,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":804,"spinlock_wait_cycles":13617280,"thread_start_us":207674,"threads_started":1,"wal-append.queue_time_us":1248408}
I20260709 12:11:13.796115 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.796527 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:13.765219 17333 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 2.199s (SENT)
I20260709 12:11:13.799863 17333 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:13.801649 17363 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:13.803578 17284 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:13.804725 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.807196 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:13.808195 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.808568 21215 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.809136 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.809877 17285 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:13.811256 21215 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.812882 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.813099 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.813516 17283 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:13.813757 17291 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:13.814393 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.815128 17283 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:13.815848 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.816484 17283 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:13.817490 17283 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:13.818734 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.818831 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.819430 18015 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:11:13.820346 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.821959 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.822708 18015 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:11:13.825332 17407 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:13.826313 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 61116.4us
I20260709 12:11:13.829994 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:13.835960 18012 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:13.836925 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.837736 18008 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:13.839102 18008 pending_rounds.cc:85] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 7
I20260709 12:11:13.839449 18008 pending_rounds.cc:107] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:13.839699 18008 raft_consensus.cc:2889] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.835875 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:13.843618 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.844391 18011 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:11:13.833901 21237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.255s	user 0.058s	sys 0.055s
I20260709 12:11:13.844439 17285 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:13.832406 21351 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:13.838758 21066 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:13.846917 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 128231us
W20260709 12:11:13.847807 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.874737 17255 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:13.875485 17332 leader_election.cc:336] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.847s (SENT)
I20260709 12:11:13.875654 21215 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:13.838864 21207 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:13.877547 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.878068 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:13.818424 21380 consensus_queue.cc:1059] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 12:11:13.868677 21237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.293s	user 0.058s	sys 0.059s
W20260709 12:11:13.881265 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.870529 21351 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.890170 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:13.881990 21173 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.889879 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:13.873780 21261 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.850s	user 0.023s	sys 0.016s
I20260709 12:11:13.893826 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:13.904062 17362 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:13.904695 21351 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.882184 21066 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:13.890741 21215 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:13.912767 21173 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:13.909312 21389 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:11:13.904161 21386 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:13.908157 17360 raft_consensus.cc:2410] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:13.956362 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.957276 17361 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:13.964406 17359 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.968200 17285 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
W20260709 12:11:13.958851 21261 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.935s	user 0.029s	sys 0.016s
I20260709 12:11:13.957834 21347 raft_consensus.cc:3055] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:11:13.963423 21387 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
I20260709 12:11:13.974301 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.974664 17358 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:13.975474 18010 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:11:13.976742 21215 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.977983 21066 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.996286 17288 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4.
I20260709 12:11:13.971041 21347 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:13.999300 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:13.999991 17285 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:14.000125 21347 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.001377 21347 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:14.002331 21374 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.002929 21374 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:13.992923 21366 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:11:14.005234 21374 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:14.001672 21173 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:13.970371 21386 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:13.977342 21279 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:14.022630 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.995776 21370 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:14.037588 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.037840 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 870) took 3027 ms. Trace:
I20260709 12:11:14.038410 17285 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:14.038925 18014 rpcz_store.cc:276] 0709 12:11:11.010618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.384935 (+374317us) service_pool.cc:224] Handling call
0709 12:11:11.385274 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.695823 (+310549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.037576 (+2341753us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400649e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:14.037775 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710091008}
W20260709 12:11:14.051738 18009 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 863) took 3049 ms (client timeout 2044 ms). Trace:
I20260709 12:11:14.052026 21351 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:14.052222 18009 rpcz_store.cc:269] 0709 12:11:10.997853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.062257 (+ 64404us) service_pool.cc:224] Handling call
0709 12:11:14.046831 (+2984574us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400680954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:14.046944 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745238784}
I20260709 12:11:14.053267 21386 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:14.053809 21392 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:11:14.056113 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.056476 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.056785 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:14.085860 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.114055 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.113711 17283 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:14.076833 21351 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:14.130174 21345 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:14.150791 17258 connection.cc:256] RPC call timeout handler was delayed by -2.2734189790000983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 12:11:14.151366 17258 connection.cc:256] RPC call timeout handler was delayed by -2.1546189790001335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 12:11:14.151721 17258 connection.cc:256] RPC call timeout handler was delayed by -2.0016189790001135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 12:11:14.152077 17258 connection.cc:256] RPC call timeout handler was delayed by -1.1034189790000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3171s for a response
W20260709 12:11:14.152428 17258 connection.cc:256] RPC call timeout handler was delayed by -1.0647189790001903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3214s for a response
I20260709 12:11:14.153288 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:14.154135 21374 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.154778 21374 consensus_queue.cc:1059] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:14.155562 21374 raft_consensus.cc:3055] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:14.155905 21374 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:14.156762 21374 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.157946 21374 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.158049 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 680) took 3483 ms. Trace:
I20260709 12:11:14.162397 17365 rpcz_store.cc:276] 0709 12:11:10.674710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.702039 (+ 27329us) service_pool.cc:224] Handling call
0709 12:11:10.722130 (+ 20091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.337559 (+2615429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.157807 (+820248us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b540040b5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:14.157987 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6011124608}
I20260709 12:11:14.154853 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:14.165113 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:14.165813 21380 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.172096 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.173492 21380 raft_consensus.cc:2764] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:14.172727 21374 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.175379 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:14.177709 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.178290 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.178835 17291 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.178911 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.179973 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.180943 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.181933 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.177743 21374 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.182776 17292 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:14.183099 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.183784 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.184175 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.184700 17285 raft_consensus.cc:2376] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9. Re-sending same reply.
I20260709 12:11:14.184825 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.185258 17292 raft_consensus.cc:2376] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10. Re-sending same reply.
I20260709 12:11:14.185575 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.186440 17283 raft_consensus.cc:2393] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:14.186519 17292 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:14.186471 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.187448 17289 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:14.186398 17291 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:14.243260 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.244712 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.245607 18008 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:14.247905 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 704) took 1165 ms. Trace:
I20260709 12:11:14.248329 17364 rpcz_store.cc:276] 0709 12:11:13.082446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.091249 (+  8803us) service_pool.cc:224] Handling call
0709 12:11:14.247714 (+1156465us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b54002df354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:14.247847 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100347648}
I20260709 12:11:14.251014 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:14.252174 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.253291 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:14.254454 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:14.255184 18008 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:14.256790 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.258719 21380 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.260247 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.261076 18008 raft_consensus.cc:2393] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 9: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:14.274293 18006 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:14.275753 21316 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:14.276144 21173 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:14.276985 21173 consensus_queue.cc:1243] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer 868a5e341d0a41b4ac0927342c8cd598 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:14.276193 21316 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:14.278296 21388 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:14.278771 21388 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:14.278404 21316 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.279724 21316 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.279600 21388 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.286859 21223 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:14.290859 17436 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:14.293320 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.294008 17286 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:14.294808 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.295490 17283 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 5.
I20260709 12:11:14.296324 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.297335 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.297822 17283 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.298494 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.299396 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.299557 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.299870 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.300478 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.301085 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.301501 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.301798 17288 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:14.302661 17289 raft_consensus.cc:3055] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:14.303124 17289 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:14.303841 17286 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:14.304443 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.304937 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.305595 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.307034 17292 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:14.300051 17291 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.312175 17283 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:14.303895 17289 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.313964 17289 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.321975 21384 raft_consensus.cc:3055] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:14.322495 21384 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:14.323348 21384 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:14.324795 21384 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.057808 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:14.329504 17291 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:14.331072 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.334353 21374 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:14.334968 21374 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.335707 21173 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:14.336283 21173 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.337266 21374 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:14.338265 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.339052 21173 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:14.339883 17980 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:14.340838 21347 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:14.341245 21347 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.341583 21347 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:14.343231 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.344694 17980 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.352810 21365 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.353327 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.355293 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.358608 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 721) took 3350 ms. Trace:
I20260709 12:11:14.358861 21357 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.359408 21366 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:14.360641 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.364212 21370 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.364781 21370 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.359063 17290 rpcz_store.cc:276] 0709 12:11:11.008078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.008889 (+   811us) service_pool.cc:224] Handling call
0709 12:11:11.030708 (+ 21819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.034142 (+  3434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.034174 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.034221 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:11.034258 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.358360 (+3324102us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b54002ae9d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:14.358412 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.358543 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7392512}
I20260709 12:11:14.362347 21066 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:14.367044 21370 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:14.368372 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:14.363709 17980 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:14.358654 21347 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.369242 17365 raft_consensus.cc:2410] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:14.371619 21347 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:14.372918 18014 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.375937 17980 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.381390 17980 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:14.354002 17289 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:14.386969 17980 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.388227 21229 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:14.390460 21361 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:14.387033 17289 pending_rounds.cc:85] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 8
I20260709 12:11:14.391650 17289 pending_rounds.cc:107] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:14.391980 17289 raft_consensus.cc:2889] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:14.392676 17364 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:14.367636 21066 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:11:14.392858 17283 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:14.391078 21361 raft_consensus.cc:697] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:14.391325 21357 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.387190 21347 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.404947 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.405243 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.429962 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:14.430693 17292 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:14.433593 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.399755 21361 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.444835 21365 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.422648 21374 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:11:14.422631 21347 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:14.407927 21366 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:11:14.454747 18008 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:14.457418 21347 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.464450 18013 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
W20260709 12:11:14.465219 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.480353 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.466018 21173 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:11:14.497274 21357 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.501690 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:14.504118 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:14.505329 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:14.507107 17291 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:14.508719 17981 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.515388 17438 raft_consensus.cc:1217] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Deduplicated request from leader. Original: 7.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 12:11:14.516024 17438 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:14.508019 21366 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:14.507380 21354 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:14.534646 21380 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:11:14.072613 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:14.543053 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.544750 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.549203 17366 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.550531 21279 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:14.551139 21279 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:14.552045 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:14.554011 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.557924 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.558846 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:14.559186 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:14.559916 17436 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.561733 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:14.562510 17364 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:14.559585 17362 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.563349 17365 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:14.519047 21229 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.567500 21229 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:14.568480 21229 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.562484 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.575441 17255 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:14.579533 21393 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:14.582445 17366 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:14.583421 21375 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.583895 21375 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.584245 21375 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.587201 18011 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:14.522326 21366 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.591071 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.591820 17432 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.598956 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.599710 17439 raft_consensus.cc:2376] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11. Re-sending same reply.
I20260709 12:11:14.601198 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:14.604930 17432 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:14.607141 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:14.613240 21343 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:14.615343 21343 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:14.616600 21384 raft_consensus.cc:3055] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:14.617084 21384 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:11.577198 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:14.624539 21354 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:14.625046 21354 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:14.625960 21354 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:14.630231 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.580426 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:14.635439 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 55088.4us
I20260709 12:11:14.580650 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1840) took 1010 ms. Trace:
I20260709 12:11:14.636934 17440 rpcz_store.cc:276] 0709 12:11:13.570652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.072299 (+501647us) service_pool.cc:224] Handling call
0709 12:11:14.580574 (+508275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:14.651593 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:14.652308 17365 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.581779 17362 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:14.655125 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.658967 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:14.662679 17362 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.590926 21366 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:14.667421 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.667920 17436 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:14.669577 17364 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:14.671252 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 212492us
I20260709 12:11:14.673151 17364 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:14.678802 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.679767 17436 raft_consensus.cc:2368] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13.
I20260709 12:11:14.690601 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:14.671252 21393 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:14.631146 21380 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:11:14.702996 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.703537 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:14.703810 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.704236 17437 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:14.704276 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:14.705076 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.705170 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:14.705610 17439 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:14.705753 17435 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:14.703621 17432 raft_consensus.cc:2376] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7. Re-sending same reply.
I20260709 12:11:14.702464 17365 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:14.713121 17362 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:14.714461 17437 raft_consensus.cc:2368] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11.
I20260709 12:11:14.715584 17292 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:11:14.692315 21393 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:14.674501 21173 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:14.552109 21279 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.735512 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:14.735229 17362 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:14.618002 21384 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.754144 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:14.714143 21316 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.758665 17404 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:14.760244 21316 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:14.761300 21351 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.762560 21316 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:14.763208 21316 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:14.766522 21384 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.738849 21393 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.773789 21341 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:14.779196 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.792935 17436 raft_consensus.cc:2376] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 4. Re-sending same reply.
I20260709 12:11:14.739794 17365 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.734756 17440 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
W20260709 12:11:14.751866 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 243179us
I20260709 12:11:14.798852 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:14.803946 17981 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.859083 17363 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:14.789716 21366 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.801139 21370 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:14.876436 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.870371 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 66507.9us
I20260709 12:11:14.807471 21361 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:11:14.880793 18009 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:14.879326 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 306830us
I20260709 12:11:14.874461 21412 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:14.885612 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.889254 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.890079 18008 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:14.896000 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.901058 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:14.904145 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.894985 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.917021 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:14.920063 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.921468 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:14.904057 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 331807us
I20260709 12:11:14.881309 21393 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:14.944779 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:14.946180 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.946256 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:14.902287 21412 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:14.893344 21173 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 12:11:14.955152 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 276590us
I20260709 12:11:14.956898 17255 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:14.958189 21423 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 12:11:14.955003 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 194160us
I20260709 12:11:15.012902 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:15.013614 18011 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:15.014341 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:14.938243 21341 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:11:15.021744 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.958850 21366 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.024340 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:14.944626 21223 consensus_queue.cc:1059] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:14.947420 21230 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:11:15.039290 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:15.040548 17363 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.048568 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:15.052774 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.054406 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.119930 21416 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.121569 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.100382 21380 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:15.055328 21411 log.cc:927] Time spent T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:11:15.039340 21349 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:15.098627 17178 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.414s	user 0.005s	sys 0.037s
I20260709 12:11:15.060670 21412 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.093708 21432 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.059374 21351 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:15.049261 21413 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:11:15.138029 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:15.139356 17363 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.122247 17435 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:15.122418 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.123082 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:15.127657 17313 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd620 after lost signal to thread 16128
I20260709 12:11:15.122273 17437 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:15.142179 17439 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:11:15.142782 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:15.127753 17440 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:11:15.142978 17313 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1b00 after lost signal to thread 17224
W20260709 12:11:15.128839 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 225701us
I20260709 12:11:15.143043 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:15.144536 17313 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2c40 after lost signal to thread 17316
W20260709 12:11:15.144896 17313 debug-util.cc:398] Leaking SignalData structure 0x7b08003723e0 after lost signal to thread 17317
I20260709 12:11:15.144752 17980 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:15.143478 17437 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.119603 21428 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:15.136529 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.155526 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:15.158649 17433 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:15.171983 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:15.173605 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:15.174333 17283 raft_consensus.cc:2376] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10. Re-sending same reply.
I20260709 12:11:15.164225 17437 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:11:15.127306 21380 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:15.176388 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:15.176306 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:15.136891 21432 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:15.180994 17287 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:15.189857 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:15.191586 17292 raft_consensus.cc:2376] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9. Re-sending same reply.
I20260709 12:11:15.190136 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:15.193174 17284 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 6: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:15.190413 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:15.194676 21419 log.cc:927] Time spent T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:11:15.196223 21410 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:11:15.202505 21393 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:15.150427 21349 consensus_queue.cc:1059] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 12:11:15.190238 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:15.210811 21437 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:15.211998 17289 raft_consensus.cc:2410] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:11:15.212657 21222 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:15.213567 21222 consensus_queue.cc:1243] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer aaafaad0810b4e95983d2d73ec814346 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:15.175491 21342 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:15.214843 21342 raft_consensus.cc:3055] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:15.215216 21342 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:15.216027 21342 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.217216 21342 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.219076 21430 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.219497 21430 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:15.220268 21430 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:15.221504 21417 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:11:15.222290 21436 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.221884 21432 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.222803 21436 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.223554 21432 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.225054 21436 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:15.217949 21375 consensus_meta.cc:287] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.005s
I20260709 12:11:15.189005 17363 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
W20260709 12:11:15.234403 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 273109us
I20260709 12:11:15.256498 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:15.238760 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 288367us
I20260709 12:11:15.193114 21229 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:11:15.237025 21413 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:11:15.305898 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 49513.1us
I20260709 12:11:15.315397 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:15.307782 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:15.230460 21436 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:15.141925 21416 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.329010 17332 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:15.330909 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 848) took 1089 ms. Trace:
I20260709 12:11:15.341671 18013 rpcz_store.cc:276] 0709 12:11:14.241743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.370890 (+129147us) service_pool.cc:224] Handling call
0709 12:11:14.371283 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:14.464959 (+ 93676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.330606 (+865647us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b540024ead4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:15.330843 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213634816}
I20260709 12:11:15.345443 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:15.347615 17257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.004s	sys 0.017s
W20260709 12:11:15.349706 17257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.005s	sys 0.017s
I20260709 12:11:15.325732 21207 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.322960 21436 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:15.239374 21375 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.325973 21370 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:15.356591 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.363684 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.236410 21351 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:15.358661 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 212934us
W20260709 12:11:15.351258 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 329957us
I20260709 12:11:15.349730 21229 raft_consensus.cc:697] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:11:15.374375 17358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.002s	sys 0.023s
I20260709 12:11:15.353111 21439 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:15.356010 21173 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.356015 21207 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:15.362705 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:15.381342 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 240595us
I20260709 12:11:15.396682 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:15.397819 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:15.398123 18014 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.323994 21380 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.419804 17367 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:15.380738 21433 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:15.431788 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 114545us
I20260709 12:11:15.374191 21370 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.399643 21207 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.377669 21450 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:15.421119 21446 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.446941 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:15.396183 21439 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.485499 21229 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.487728 21439 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.400388 21173 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:15.469992 21445 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:11:15.471133 21375 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.499060 17432 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:15.499547 17432 pending_rounds.cc:85] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 6
I20260709 12:11:15.499825 17432 pending_rounds.cc:107] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:11:15.500073 17432 raft_consensus.cc:2889] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:15.500391 17432 pending_rounds.cc:107] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:11:15.500608 17432 raft_consensus.cc:2889] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:15.472065 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:15.474836 20989 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:15.478827 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.410554 21223 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:11:15.432076 21449 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:15.471935 21440 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:11:15.521518 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 76603.9us
I20260709 12:11:15.501747 17367 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:15.507843 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 111228us
I20260709 12:11:15.518275 21450 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:15.516346 17178 maintenance_manager.cc:643] P 437023cdfca24d7494e0818062a37383: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 1.371s	user 0.153s	sys 0.059s Metrics: {"bytes_written":29707,"cfile_init":1,"dirs.queue_time_us":89190,"dirs.run_cpu_time_us":374,"dirs.run_wall_time_us":6204,"drs_written":1,"lbm_read_time_us":371,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3904,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":63,"thread_start_us":247715,"threads_started":2,"wal-append.queue_time_us":340705}
W20260709 12:11:15.520161 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 74472.1us
I20260709 12:11:15.419828 21436 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.522890 17332 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:15.496114 21222 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.479779 21451 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.479525 21457 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:11:15.541821 17367 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
W20260709 12:11:15.542446 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 161959us
I20260709 12:11:15.544476 21450 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.545302 21432 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:15.550067 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.550477 21370 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.551316 21416 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:15.552079 21438 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 12:11:15.552899 21447 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:11:15.533406 21449 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:15.554553 21475 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.541997 17179 maintenance_manager.cc:419] P 437023cdfca24d7494e0818062a37383: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10419 bytes on disk
I20260709 12:11:15.493373 21448 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:11:15.531980 21451 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:15.541538 21436 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.559391 21457 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.567492 21448 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:15.568296 21474 raft_consensus.cc:3055] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:15.563279 21431 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:11:15.575876 17178 maintenance_manager.cc:643] P 437023cdfca24d7494e0818062a37383: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.017s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":369,"lbm_reads_lt_1ms":4}
I20260709 12:11:15.539721 21466 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:11:15.579070 21471 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:11:15.578006 21474 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:15.533716 21222 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.541077 21443 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:15.578701 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:15.563875 21451 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.607462 21459 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:15.608028 21459 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:15.578205 21457 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.608450 21459 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.608824 21468 raft_consensus.cc:2764] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:15.610006 21457 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:15.612388 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.586064 21223 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:15.615335 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 91910.8us
I20260709 12:11:15.614437 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:15.608712 21222 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.561761 21475 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.655987 21450 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.613052 21471 consensus_queue.cc:1243] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:15.656890 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 880) took 1825 ms. Trace:
I20260709 12:11:15.657096 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:15.567366 21449 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.615624 21448 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:15.673002 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 117815us
I20260709 12:11:15.611841 21433 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:15.679854 21433 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.680785 21388 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.681347 21446 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:15.641753 21457 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:15.656330 21351 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.614917 21466 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:11:15.660073 18015 rpcz_store.cc:276] 0709 12:11:13.822180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.834347 (+ 12167us) service_pool.cc:224] Handling call
0709 12:11:13.834606 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.834882 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.834901 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.628117 (+793216us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b2c000b05a8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:11:14.628598 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.097305 (+468707us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:15.097349 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.097425 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.644529 (+547104us) raft_consensus.cc:1685] finished
0709 12:11:15.644552 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.647503 (+  2951us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3676,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":16455040,"thread_start_us":468355,"threads_started":1,"wal-append.queue_time_us":697388}
I20260709 12:11:15.684441 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2685) took 1041 ms. Trace:
I20260709 12:11:15.750093 17359 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:15.675431 21471 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:15.749801 17313 debug-util.cc:398] Leaking SignalData structure 0x7b080039c200 after lost signal to thread 17391
I20260709 12:11:15.684705 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:15.748376 21316 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:15.725939 21478 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.725791 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:15.697070 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 53508.9us
I20260709 12:11:15.676564 21450 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.613605 21463 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:11:15.752954 21477 log.cc:927] Time spent T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:11:15.709995 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.714926 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 192084us
I20260709 12:11:15.674220 21342 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:11:15.762938 17358 rpcz_store.cc:276] 0709 12:11:14.642665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.642759 (+    94us) service_pool.cc:224] Handling call
0709 12:11:14.643055 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.643262 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:14.872171 (+228909us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.676906 (+804735us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.684044 (+  7138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.684107 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:15.684158 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.684233 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.684374 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18459,"prepare.queue_time_us":372670,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":12706,"raft.queue_time_us":217998,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":15450,"thread_start_us":991216,"threads_started":3,"wal-append.queue_time_us":595258}
I20260709 12:11:15.733747 21207 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:15.778219 21486 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.778824 17366 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.779683 21207 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.764585 21341 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:15.764829 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 79379.5us
I20260709 12:11:15.683389 21317 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:11:15.725587 21173 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.730445 21448 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.768376 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:15.777619 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 52025.4us
I20260709 12:11:15.779613 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 720) took 1229 ms. Trace:
I20260709 12:11:15.779914 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:15.792241 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:15.792908 17360 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:15.792158 17333 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:15.784004 17313 debug-util.cc:398] Leaking SignalData structure 0x7b08004071e0 after lost signal to thread 17465
W20260709 12:11:15.794713 17313 debug-util.cc:398] Leaking SignalData structure 0x7b0800407260 after lost signal to thread 17466
I20260709 12:11:15.784389 17365 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.792109 17359 raft_consensus.cc:2410] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:11:15.796000 17313 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdac0 after lost signal to thread 18039
I20260709 12:11:15.739509 21472 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.796305 21374 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.796880 21374 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:15.796347 17313 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3640 after lost signal to thread 18040
W20260709 12:11:15.798079 17313 debug-util.cc:398] Leaking SignalData structure 0x7b0800394d60 after lost signal to thread 21012
W20260709 12:11:15.799827 17313 debug-util.cc:398] Leaking SignalData structure 0x7b080036ddc0 after lost signal to thread 21249
I20260709 12:11:15.792408 17441 rpcz_store.cc:276] 0709 12:11:14.549955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.550091 (+   136us) service_pool.cc:224] Handling call
0709 12:11:14.550458 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.550678 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:14.879435 (+328757us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.712620 (+833185us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.760325 (+ 47705us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.779302 (+ 18977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.779362 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:15.779411 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.779470 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.779560 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81265,"prepare.queue_time_us":23031,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":117,"raft.queue_time_us":224050,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":7668,"thread_start_us":1132582,"threads_started":4,"wal-append.queue_time_us":593055}
W20260709 12:11:15.807003 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.776969 21476 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.765035 21351 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.761904 21457 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:15.807111 17313 debug-util.cc:398] Leaking SignalData structure 0x7b0800361cc0 after lost signal to thread 21304
I20260709 12:11:15.809530 17333 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:15.770159 21471 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.815430 17333 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:15.789412 21487 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:15.798481 21463 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.820413 17333 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:15.822956 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:15.799835 21354 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.811631 21443 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.808736 21173 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:15.824076 21342 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:15.770679 21478 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.830217 21491 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:11:15.832811 21478 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:15.832602 21487 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:15.833490 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.835101 21487 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:15.836028 21374 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.834964 21316 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:15.837213 21351 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:15.838393 17407 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:15.812978 21486 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.841305 21173 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.843556 21173 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:15.830044 21342 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:15.844521 21342 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.829366 21482 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.845131 21482 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.847433 21482 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:15.848923 21450 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:15.849308 21384 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.849695 21384 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:15.843792 17333 leader_election.cc:400] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13.
I20260709 12:11:15.850421 17333 leader_election.cc:403] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:15.851670 17333 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:15.852649 21490 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.853060 21490 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.853399 21490 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.856261 21446 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13.
I20260709 12:11:15.856993 21446 raft_consensus.cc:2764] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:15.819162 21341 raft_consensus.cc:2764] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:15.860134 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:15.864990 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 844) took 1624 ms. Trace:
I20260709 12:11:15.865435 18009 rpcz_store.cc:276] 0709 12:11:14.240650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.780869 (+540219us) service_pool.cc:224] Handling call
0709 12:11:14.781193 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.882065 (+100872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.864713 (+982648us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b5400102a54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:15.864918 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228539648}
I20260709 12:11:15.866084 21475 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.866655 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 879) took 2044 ms. Trace:
I20260709 12:11:15.860796 21463 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.859784 17255 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:15.867300 21317 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:15.867949 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1843) took 1187 ms. Trace:
I20260709 12:11:15.828166 21484 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.872625 18010 rpcz_store.cc:276] 0709 12:11:13.821873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.823318 (+  1445us) service_pool.cc:224] Handling call
0709 12:11:13.836351 (+ 13033us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:13.975850 (+139499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.866360 (+1890510us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003ccb54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:15.866589 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319282560}
I20260709 12:11:15.874754 17436 rpcz_store.cc:276] 0709 12:11:14.680932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.735222 (+ 54290us) service_pool.cc:224] Handling call
0709 12:11:15.867712 (+1132490us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b5400271854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:15.867852 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118497024}
I20260709 12:11:15.875205 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:15.876135 21443 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:15.880080 21368 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:15.880684 21368 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:15.850519 21384 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.881855 21349 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:15.881570 21368 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.882299 21349 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:15.883247 21349 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.884245 21349 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.882377 21384 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.885277 17333 leader_election.cc:400] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11.
W20260709 12:11:15.893573 21492 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.006s
I20260709 12:11:15.895434 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.905566 17441 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:15.906026 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.861745 21316 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.910233 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:15.910914 17434 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.899760 17404 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:15.900507 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:15.901211 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:15.897784 17440 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:15.909221 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:15.909474 17433 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:15.912792 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:15.914395 21482 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:15.911183 21478 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:11:15.914857 21482 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.915320 21482 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.915464 17441 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.915859 21222 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:15.898262 21475 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:15.813206 21476 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.916448 21222 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.918150 17362 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
W20260709 12:11:15.922487 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.926422 17437 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:15.928200 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.863260 21351 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:11:15.928768 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.918265 21317 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:15.921684 21486 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.840622 21472 consensus_queue.cc:1059] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:11:15.930167 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:15.932173 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:15.935519 17440 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.934330 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.875121 21450 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:15.941318 21450 raft_consensus.cc:3055] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:15.941733 21450 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:15.942605 21450 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:15.943869 21450 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.930029 21443 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:15.937640 21463 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:15.937393 21317 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:15.938997 21485 raft_consensus.cc:3055] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:15.936379 17433 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 6: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:15.946041 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.949313 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1699) took 2627 ms. Trace:
I20260709 12:11:15.951227 21451 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:15.954747 17333 connection.cc:256] RPC call timeout handler was delayed by -1.002240491000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 12:11:15.952664 21459 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:15.954720 21415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.012s	sys 0.011s
W20260709 12:11:15.955986 21415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.013s	sys 0.011s
I20260709 12:11:15.956816 21451 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:15.957248 21459 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:15.954203 17438 rpcz_store.cc:276] 0709 12:11:13.322042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.322518 (+   476us) service_pool.cc:224] Handling call
0709 12:11:13.322881 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.516342 (+1193461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.949053 (+1432711us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001469d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:15.949247 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2742092160}
I20260709 12:11:15.958514 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:15.958695 21365 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:15.959710 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:15.958086 17333 leader_election.cc:336] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.551s (SENT)
I20260709 12:11:15.960742 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:15.961792 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:15.961975 17333 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.608s (SENT) [suppressed 53 similar messages]
I20260709 12:11:15.953783 17439 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:15.963141 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.963598 17439 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:15.964272 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.954496 17441 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:15.972788 21430 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.950729 21476 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:15.975144 21457 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:15.960527 21485 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:15.960886 21443 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:15.988236 17440 raft_consensus.cc:2410] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:15.968641 21349 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.967923 21222 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:15.993014 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:15.998893 17440 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:16.000612 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:16.003916 21349 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.004355 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:16.005456 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.006855 17440 raft_consensus.cc:2410] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:16.006804 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:16.008841 17333 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:16.023840 17333 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:16.025866 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:16.001988 21490 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.008639 21451 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.028644 21490 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.030375 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:16.030591 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.031478 17440 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:16.008904 21349 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.029280 21484 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.039374 17358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a03a1e696734298850b94830af8a727"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:16.040021 17358 raft_consensus.cc:606] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:16.040369 17358 raft_consensus.cc:614] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:16.041072 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.041225 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.041532 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.041805 17365 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:16.045475 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:16.046792 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:16.047415 17440 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.049953 17364 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:16.050168 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.024757 21230 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.048558 21490 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:16.061164 21279 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:16.067611 21490 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:16.068089 21490 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.068178 21279 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:16.068768 21279 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:16.070278 21173 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.070878 21173 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:16.073315 21173 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:16.069793 21279 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.074308 21443 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.075187 21279 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:16.075852 21490 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.062044 21457 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:16.089577 17440 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:16.082377 17358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:16.050523 21484 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.049157 21437 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:16.073616 21342 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:16.092875 21497 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 12:11:16.082692 21173 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.099730 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.095012 21499 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
I20260709 12:11:16.100730 17358 raft_consensus.cc:606] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:16.038091 21482 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:16.103546 17358 raft_consensus.cc:614] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:16.096094 21460 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.076936 21457 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.081875 21485 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:16.112604 21222 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.099743 21437 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.105002 21173 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.140527 21490 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.134681 21485 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.134523 21388 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.147850 21388 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.137082 21222 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.116843 21460 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:16.151444 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.157931 21457 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.151759 21437 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.172415 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 732) took 1050 ms. Trace:
I20260709 12:11:16.172863 17432 rpcz_store.cc:276] 0709 12:11:15.122072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.124948 (+  2876us) service_pool.cc:224] Handling call
0709 12:11:15.125228 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.501246 (+376018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.172149 (+670903us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b540036ea54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:16.172345 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858889088}
I20260709 12:11:16.174750 21342 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:16.175658 21341 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:16.176071 21341 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:16.176877 21341 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.177856 21341 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.185407 21173 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.187359 21173 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.188060 17406 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:16.187872 21173 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:16.188849 21437 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:16.189293 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:16.190251 21437 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:16.190237 21173 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:16.198372 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:16.199340 18010 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:16.199822 21442 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:16.202316 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.200860 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:16.203868 18015 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:11:16.204375 18009 raft_consensus.cc:2376] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11. Re-sending same reply.
I20260709 12:11:16.205482 21361 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.206348 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.206073 21361 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.208415 21361 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:16.206575 21442 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.224663 17432 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:16.225019 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:16.226440 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:16.226716 17333 leader_election.cc:336] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 1.830s (SENT)
I20260709 12:11:16.227285 17333 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:16.224555 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:16.228875 17441 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.230123 17358 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:16.201365 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.234524 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.234875 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.235440 17432 raft_consensus.cc:2393] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:16.235479 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.236006 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.237464 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.237841 17436 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:16.238459 17440 raft_consensus.cc:2410] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:16.141892 21474 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.240681 21341 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:16.241264 21341 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:16.242918 21460 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.243885 21341 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:16.257072 21380 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.258284 17290 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:16.258924 17291 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:16.259567 17286 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:16.260301 17365 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:16.263754 17287 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:16.236624 17435 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
I20260709 12:11:16.266083 17365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:16.266748 17365 raft_consensus.cc:606] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:16.267088 17365 raft_consensus.cc:614] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:16.267493 21482 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:16.271775 17365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:16.272665 17365 raft_consensus.cc:606] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:11:16.273115 17365 raft_consensus.cc:614] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:16.276238 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.274705 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.277453 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.279888 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.282043 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.283277 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:16.284149 18012 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:16.288379 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.289232 17435 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
W20260709 12:11:16.293813 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 104588us
I20260709 12:11:16.299419 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.282891 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.302443 17365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:16.303061 17365 raft_consensus.cc:606] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:16.309370 21471 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:16.312644 21506 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:11:16.273991 21442 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:16.315687 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.316175 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.317893 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.287303 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:16.318840 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.319468 21341 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:16.319684 17366 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:16.320784 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:16.321043 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.300212 17435 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
W20260709 12:11:16.237569 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.324951 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.325786 21341 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:16.329665 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.330482 17367 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:16.331387 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.331609 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:16.332329 17359 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:16.325666 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.334055 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.335017 17366 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:16.336351 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:16.340574 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.330745 17358 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:16.346154 17360 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.347148 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.348021 17364 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:16.348347 17360 raft_consensus.cc:1240] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:16.348872 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.349365 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.344726 21342 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:16.347218 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.350553 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.350747 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.351179 17360 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:16.351450 17362 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:16.352078 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.352459 17362 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:16.352869 17360 raft_consensus.cc:2410] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:16.353894 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:16.349496 17364 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:16.355165 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.358011 21474 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.346215 17404 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:16.277724 21475 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:11:16.361747 17359 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 4.
W20260709 12:11:16.360436 21499 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
W20260709 12:11:16.375342 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 95543.6us
W20260709 12:11:16.379314 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.362556 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:16.391144 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.392377 21342 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:16.393510 21342 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.368386 17255 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:16.398907 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:16.403494 17433 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:16.408481 17439 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:11:16.410720 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.411263 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.412115 17367 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:16.412467 17404 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:16.150053 21388 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.416270 17367 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:16.444201 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 76498.3us
I20260709 12:11:16.448242 18012 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:16.449561 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 73180.1us
I20260709 12:11:16.430572 17439 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:11:16.451140 17439 pending_rounds.cc:85] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 8
I20260709 12:11:16.451449 17439 pending_rounds.cc:107] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:11:16.451740 17439 raft_consensus.cc:2889] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:16.453708 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 85407.8us
W20260709 12:11:16.407833 21253 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.024s	sys 0.060s
I20260709 12:11:16.455245 17255 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:16.484352 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.512882 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:16.413982 21456 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:16.424737 17433 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:16.497457 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.509215 17287 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: [5.7-7.9]
W20260709 12:11:16.512857 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 57671.9us
I20260709 12:11:16.540138 17285 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:16.541308 17255 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:16.513928 17407 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:16.514744 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.477533 18009 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.544006 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:16.441776 17441 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:16.542373 17255 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:16.494720 21349 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.475706 21449 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:16.423527 21380 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:16.515352 21253 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.030s	sys 0.068s
I20260709 12:11:16.414580 21316 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 12:11:16.507455 21368 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.549595 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:16.550376 21388 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.475591 17190 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.456737 21279 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 12:11:16.539934 21460 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.515544 21361 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:11:16.453914 21365 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:16.591790 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.538930 21317 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:16.407832 21351 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:16.467312 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.579965 21480 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.551908 21482 raft_consensus.cc:2764] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:11:16.648854 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.624588 17436 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:16.512377 21393 consensus_queue.cc:1059] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:11:16.475288 21486 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
W20260709 12:11:16.632066 17189 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55932 (request call id 328) took 18426 ms (client timeout 15000 ms). Trace:
I20260709 12:11:16.639614 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.560793 21426 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:11:16.704321 21384 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.791s	user 0.014s	sys 0.000s
I20260709 12:11:16.704839 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:16.646833 21317 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.705991 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.633220 21460 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.708986 21460 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:16.706749 17189 rpcz_store.cc:269] 0709 12:10:58.253437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.314618 (+ 61181us) service_pool.cc:224] Handling call
0709 12:11:16.627640 (+18313022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:07.725697 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:07.734706 (+  9009us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:07.734769 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:11:07.734789 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:07.736184 (+  1395us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:07.736292 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:07.736328 (+    36us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:07.737542 (+  1214us) tablet.cc:701] Row locks acquired
0709 12:11:07.737589 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:11:07.737768 (+   179us) write_op.cc:270] Start()
0709 12:11:07.737929 (+   161us) write_op.cc:276] Timestamp: P: 1783599067737701 usec, L: 0
0709 12:11:07.737947 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:11:07.833393 (+ 95446us) log.cc:844] Serialized 6050 byte log entry
0709 12:11:08.196703 (+363310us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b18000e2ba0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2b455 00007f1225a98190 00007f1225a91ae7 00007f1225a90dd9 00007f1225a9b930
0709 12:11:08.307141 (+110438us) op_driver.cc:464] REPLICATION: finished
0709 12:11:08.476915 (+169774us) write_op.cc:301] APPLY: starting
0709 12:11:08.477034 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:08.477357 (+   323us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:08.477399 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:08.504163 (+ 26764us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:08.504536 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:11:08.504582 (+    46us) write_op.cc:312] APPLY: finished
0709 12:11:08.505011 (+   429us) log.cc:844] Serialized 107 byte log entry
0709 12:11:08.505872 (+   861us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:08.506081 (+   209us) write_op.cc:454] Released schema lock
0709 12:11:08.506186 (+   105us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:08.506605 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:08.506633 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1663587,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":164342,"apply.run_cpu_time_us":5540,"apply.run_wall_time_us":34807,"num_ops":15,"prepare.queue_time_us":175895,"prepare.run_cpu_time_us":44002,"prepare.run_wall_time_us":271636,"raft.queue_time_us":296688,"raft.run_cpu_time_us":66744,"raft.run_wall_time_us":117288,"replication_time_us":569019,"spinlock_wait_cycles":44784000,"thread_start_us":417418,"threads_started":4,"wal-append.queue_time_us":145967,"wal-append.run_cpu_time_us":28300,"wal-append.run_wall_time_us":1526852}]]}
I20260709 12:11:16.630739 21368 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:16.711037 17291 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:16.701892 17290 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:16.712101 21368 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:16.712792 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:16.642022 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.645272 18010 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
W20260709 12:11:16.654232 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.592876 21222 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.454761 21476 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.476351 21173 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.623716 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:16.702783 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.720017 17286 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:16.632162 17190 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 5 to 7, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 7 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.578955 21449 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.630586 21388 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.737190 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.704275 21426 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.563838 21349 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.641270 21351 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:16.647295 21505 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:16.633011 21437 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.713963 17283 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:16.557480 21456 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:16.797169 17363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.008s	sys 0.017s
I20260709 12:11:16.628048 21428 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 12:11:16.718866 21446 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:16.739770 21388 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.647610 21365 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:16.739717 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 119052us
I20260709 12:11:16.737255 21449 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:16.784132 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.795650 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.739585 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.808099 21437 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.817283 21437 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.746286 21426 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:16.823588 17438 raft_consensus.cc:2410] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:11:16.825590 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.817159 21365 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:16.739627 17190 catalog_manager.cc:5697] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 2 to 3, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65), VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66), VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67), VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 5 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:16.719285 21476 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.826973 21476 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.796892 21482 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.827905 17190 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 4 to 8, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 8 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:16.805718 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.830438 17289 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:16.831450 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:16.832038 17289 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.624078 21380 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.798260 21351 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.834151 17190 catalog_manager.cc:5697] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 7, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 7 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.836246 21380 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.738988 21173 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.828401 21482 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.813966 21341 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:16.840137 21482 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.840674 21456 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:16.838456 21173 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:16.849999 21476 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:16.856033 21476 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:16.852456 17289 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:16.860426 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.861686 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:16.860749 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:16.864802 17289 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.812314 21446 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:16.867539 21446 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:16.783281 21511 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 12:11:16.825953 21485 consensus_meta.cc:287] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.683s	user 0.001s	sys 0.005s
I20260709 12:11:16.878420 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:16.880481 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:16.881358 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:16.872869 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.799357 17363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.008s	sys 0.017s
I20260709 12:11:16.904953 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:16.968644 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.036284 17289 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:17.056315 17291 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:11:17.078264 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.156337 17286 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:11:17.155773 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.015s	sys 0.011s
W20260709 12:11:17.159319 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.015s	sys 0.011s
I20260709 12:11:17.010824 21443 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.151677 21450 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.057732 21380 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.055147 21456 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:17.010295 21173 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:17.151667 21357 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:17.173311 17285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.002s	sys 0.025s
I20260709 12:11:17.155329 21485 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.173512 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:17.174490 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.173625 17285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.002s	sys 0.025s
W20260709 12:11:17.204005 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.166191 21443 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:17.267684 17291 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:17.271946 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.173074 17981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.003s	sys 0.023s
W20260709 12:11:17.273363 17981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.003s	sys 0.024s
W20260709 12:11:17.172930 21463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.003s	sys 0.023s
W20260709 12:11:17.263702 21460 consensus_meta.cc:287] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.554s	user 0.002s	sys 0.007s
W20260709 12:11:17.281682 21463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.003s	sys 0.023s
I20260709 12:11:17.176182 21456 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.172817 21450 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.174302 21380 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.330513 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:17.276758 21341 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:17.340174 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:17.279299 21342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.018s	sys 0.019s
I20260709 12:11:17.261936 21357 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.332005 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:17.343907 17981 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:17.332815 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:17.333216 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.022s	sys 0.035s
W20260709 12:11:17.345352 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.023s	sys 0.035s
I20260709 12:11:17.262466 21485 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.345547 18012 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:17.344228 21357 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:17.346906 21357 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.347407 21357 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.347414 21485 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:17.348491 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 792894us
I20260709 12:11:17.349499 21357 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:17.344937 18009 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.361394 21357 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.363312 21357 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.369484 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:17.261369 21173 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.374714 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:17.375424 18013 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:17.375950 17405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.012s	sys 0.020s
W20260709 12:11:17.376260 17405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.012s	sys 0.020s
I20260709 12:11:17.289324 21460 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:17.385368 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.374552 21342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.020s	sys 0.019s
W20260709 12:11:17.396381 17407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.024s	sys 0.055s
W20260709 12:11:17.397861 17407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.025s	sys 0.055s
W20260709 12:11:17.407809 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.373018 21341 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.411912 18009 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:17.404961 18013 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:17.404954 21485 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:17.415550 21393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.045s	sys 0.023s
I20260709 12:11:17.416534 21279 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.467278 21279 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:17.467772 21279 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:17.419414 21516 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 12:11:17.456763 21393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.046s	sys 0.023s
I20260709 12:11:17.465380 21380 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.483285 21341 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.428387 21485 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.535126 21460 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:17.534444 21449 consensus_meta.cc:287] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.000s
I20260709 12:11:17.535487 21443 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:17.536396 21450 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.538697 21449 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:17.547467 21449 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:17.557152 21485 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:17.590837 17255 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.012s	sys 0.018s
W20260709 12:11:17.591850 17255 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.012s	sys 0.018s
W20260709 12:11:17.592391 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 1.03317e+06us
W20260709 12:11:17.598191 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.600291 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.600559 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.601174 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.601183 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.602577 17284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.010s	sys 0.011s
W20260709 12:11:17.603134 17284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.010s	sys 0.011s
I20260709 12:11:17.604158 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:17.602945 17283 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:17.606185 17287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.011s	sys 0.026s
I20260709 12:11:17.269140 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:17.607503 17333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.041s	sys 0.069s
W20260709 12:11:17.608018 17333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.041s	sys 0.069s
I20260709 12:11:17.608273 17291 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:17.612663 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:17.607052 17287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.011s	sys 0.027s
W20260709 12:11:17.615743 17978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.007s	sys 0.008s
W20260709 12:11:17.616168 17978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.008s	sys 0.008s
I20260709 12:11:17.616715 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:17.621459 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:17.617923 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.621711 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:17.622944 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:17.623674 17362 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.623342 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:17.623034 17435 raft_consensus.cc:2410] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:11:17.614073 17367 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
W20260709 12:11:17.607882 17331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.004s	sys 0.024s
I20260709 12:11:17.630716 17366 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:17.630800 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:17.631904 17364 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.632867 21173 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.634207 17290 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:17.634675 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 740) took 1592 ms. Trace:
W20260709 12:11:17.635103 21351 consensus_meta.cc:287] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.800s	user 0.005s	sys 0.005s
I20260709 12:11:17.635802 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:17.638128 17331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.004s	sys 0.024s
W20260709 12:11:17.608580 17288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.017s	sys 0.018s
W20260709 12:11:17.642722 17288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.017s	sys 0.018s
I20260709 12:11:17.614283 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:17.641969 21341 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:17.641083 21357 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:17.651804 17359 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
W20260709 12:11:17.652709 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 49091.4us
I20260709 12:11:17.655961 21351 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.658247 17435 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:17.659561 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:17.660719 17439 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
W20260709 12:11:17.637624 18008 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.006s	sys 0.009s
I20260709 12:11:17.663446 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:17.635216 17363 rpcz_store.cc:276] 0709 12:11:16.042568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.043739 (+  1171us) service_pool.cc:224] Handling call
0709 12:11:16.044028 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.044344 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.044368 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.044803 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.264272 (+219469us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b180045b260. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:16.886682 (+622410us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:16.886731 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.886810 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.633898 (+747088us) raft_consensus.cc:1685] finished
0709 12:11:17.633946 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.634456 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":288,"raft.queue_time_us":770,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8867,"spinlock_wait_cycles":17331456,"thread_start_us":622185,"threads_started":1,"wal-append.queue_time_us":1273706}
I20260709 12:11:17.668438 21223 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.670683 21223 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:17.671540 18008 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.006s	sys 0.010s
I20260709 12:11:17.669287 17367 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:17.674988 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:17.674872 21341 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.681540 17441 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:17.689509 21341 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:17.682878 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.690037 21223 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.684348 21351 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.685715 21207 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:17.683784 17358 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:17.692363 21393 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.695231 21207 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.695393 21393 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.697763 21393 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.695461 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:17.699527 21351 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.690902 21173 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:17.700716 21173 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:17.701267 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.702837 21342 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.703110 21173 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.703666 21342 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:17.705559 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:17.706331 21342 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:17.706995 21342 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.707394 21380 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:17.707947 21380 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.707788 21342 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:17.708341 21380 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:17.693080 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44341.1us
I20260709 12:11:17.697751 21207 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.710477 21207 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.711079 21207 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:17.713459 21207 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:17.706518 17358 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:17.703171 17435 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:17.733170 17362 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:17.719853 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:17.721154 21341 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:17.722780 21223 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.723948 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:17.717257 21351 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:17.719779 21388 consensus_meta.cc:287] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.866s	user 0.007s	sys 0.010s
I20260709 12:11:17.710951 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:17.714038 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:17.877719 21380 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:17.878659 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 164898us
I20260709 12:11:17.880132 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:17.716440 21342 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:17.734977 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:17.882196 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:17.735211 21426 consensus_meta.cc:287] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.917s	user 0.008s	sys 0.003s
I20260709 12:11:17.738790 17333 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:17.734400 21207 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.754845 21463 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.754573 21449 consensus_queue.cc:1059] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:17.754827 21460 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:17.756057 21450 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.766244 21472 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:17.882756 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:17.772236 21279 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.777281 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:17.783630 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:17.789502 21485 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:17.793921 17407 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.714s (SENT)
W20260709 12:11:17.797821 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.811775 21518 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.815852 21519 consensus_queue.cc:1059] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:17.820542 21525 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:17.863991 17364 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:17.876423 17366 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:17.882970 17358 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
W20260709 12:11:17.883673 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 145050us
I20260709 12:11:17.896126 21485 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:17.957352 17190 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.045s	user 0.013s	sys 0.001s
I20260709 12:11:17.958264 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:17.959132 17439 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:11:17.883869 21207 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:17.964327 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:17.963243 17190 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.014s	sys 0.001s
I20260709 12:11:17.966404 17358 raft_consensus.cc:2410] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:17.894518 21341 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:17.964077 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 253401us
I20260709 12:11:17.884871 21450 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:17.974319 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:17.884209 21463 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.960855 21342 raft_consensus.cc:2804] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:17.969108 17255 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:17.977826 17361 raft_consensus.cc:2410] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:17.897697 21388 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.979188 17362 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.986183 17364 raft_consensus.cc:2410] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 12 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:11:17.987780 17292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.017s	sys 0.012s
I20260709 12:11:17.979269 21173 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:18.000252 17292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.017s	sys 0.013s
I20260709 12:11:17.984416 21380 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:17.990574 21342 raft_consensus.cc:697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:17.995656 17285 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.005s	sys 0.030s
I20260709 12:11:18.003871 21450 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:18.005034 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.009186 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.006178 17363 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:17.883527 21426 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:17.885314 21472 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:18.012737 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 226807us
I20260709 12:11:18.010147 21393 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.969676 21518 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:17.979285 21525 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:18.019708 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 50783.5us
I20260709 12:11:17.991000 21223 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:18.038636 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.005050 21430 raft_consensus.cc:3055] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:18.041889 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 162028us
I20260709 12:11:18.046680 17363 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:11:18.039186 17255 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:18.048382 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:18.012144 21533 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:18.051402 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.007s	sys 0.019s
I20260709 12:11:18.047160 17363 pending_rounds.cc:85] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 9
I20260709 12:11:18.060273 21526 raft_consensus.cc:3055] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:18.060817 21526 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:18.061313 17365 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:18.061801 17332 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.009s	sys 0.024s
I20260709 12:11:18.062171 21532 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.062536 21529 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:18.073578 17332 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.010s	sys 0.024s
W20260709 12:11:18.051120 17981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.013s	sys 0.012s
I20260709 12:11:18.063098 21527 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:18.064087 21517 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.673s	user 0.004s	sys 0.012s
W20260709 12:11:18.064740 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.008s	sys 0.020s
I20260709 12:11:18.044222 21430 raft_consensus.cc:740] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:18.061575 17406 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.008s	sys 0.019s
I20260709 12:11:18.066411 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1826) took 1409 ms. Trace:
I20260709 12:11:18.066787 21426 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:18.067682 17365 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.067823 21351 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.069972 21472 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.067619 17360 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
W20260709 12:11:18.070966 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 277209us
I20260709 12:11:18.057207 17363 pending_rounds.cc:107] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 12.10
W20260709 12:11:18.075899 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 60737.5us
I20260709 12:11:18.060173 21460 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:18.083415 17406 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.009s	sys 0.019s
I20260709 12:11:18.083675 17363 raft_consensus.cc:2889] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.060053 21341 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.081463 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1825) took 1424 ms. Trace:
I20260709 12:11:18.081965 21450 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:18.081700 21526 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.079036 17286 rpcz_store.cc:276] 0709 12:11:16.656717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.262597 (+605880us) service_pool.cc:224] Handling call
0709 12:11:17.262996 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.264391 (+  1395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.264419 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.276038 (+ 11619us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.970829 (+694791us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:17.987220 (+ 16391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.996488 (+  9268us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.064713 (+ 68225us) raft_consensus.cc:1685] finished
0709 12:11:18.064732 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.066177 (+  1445us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":972,"raft.queue_time_us":157635,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"thread_start_us":257998,"threads_started":1,"wal-append.queue_time_us":383937}
I20260709 12:11:18.060101 21530 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.093134 21529 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.094079 21530 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.094660 21530 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.088645 21525 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:18.095798 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 749407us
W20260709 12:11:18.084887 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.083942 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 63547.1us
I20260709 12:11:18.099269 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2660) took 1511 ms. Trace:
W20260709 12:11:18.085608 17981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.014s	sys 0.013s
I20260709 12:11:18.099733 17287 rpcz_store.cc:276] 0709 12:11:16.587597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.587737 (+   140us) service_pool.cc:224] Handling call
0709 12:11:16.588132 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:17.642579 (+1054447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.642623 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:17.643900 (+  1277us) log.cc:844] Serialized 52 byte log entry
0709 12:11:17.989992 (+346092us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.047982 (+ 57990us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.051585 (+  3603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.064635 (+ 13050us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.098885 (+ 34250us) raft_consensus.cc:1685] finished
0709 12:11:18.098908 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.099171 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122372,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":4286,"thread_start_us":1425494,"threads_started":3,"wal-append.queue_time_us":398953}
I20260709 12:11:18.087242 21460 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.102623 21460 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.091974 21490 consensus_queue.cc:1059] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:11:18.093585 17286 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.099888 17255 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:18.102237 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.083112 17360 pending_rounds.cc:85] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 9
I20260709 12:11:18.108366 17360 pending_rounds.cc:107] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:18.108700 17360 raft_consensus.cc:2889] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:18.085949 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 736517us
I20260709 12:11:18.110077 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1830) took 1371 ms. Trace:
W20260709 12:11:18.102936 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 759137us
I20260709 12:11:18.110586 17286 rpcz_store.cc:276] 0709 12:11:16.736555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.092681 (+1356126us) service_pool.cc:224] Handling call
0709 12:11:18.093299 (+   618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.107635 (+ 14336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.107849 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:18.111838 21279 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395)
I20260709 12:11:18.112172 21207 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:18.117538 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:18.119468 21488 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.120036 21488 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:18.120451 21488 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.086886 17289 rpcz_store.cc:276] 0709 12:11:16.656488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.175960 (+519472us) service_pool.cc:224] Handling call
0709 12:11:17.263658 (+ 87698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.264130 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.264162 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.264664 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.012912 (+748248us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.018064 (+  5152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.026747 (+  8683us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.072806 (+ 46059us) raft_consensus.cc:1685] finished
0709 12:11:18.072827 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.081270 (+  8443us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156657,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":119,"thread_start_us":360841,"threads_started":1,"wal-append.queue_time_us":775490}
I20260709 12:11:18.122534 17289 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.124341 21426 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.124933 21426 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:18.106953 21449 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.125710 21449 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:18.122455 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 826658us
I20260709 12:11:18.132537 17362 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
W20260709 12:11:18.128562 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 53690us
W20260709 12:11:18.135012 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 52302.7us
I20260709 12:11:18.125360 21426 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.124354 21388 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.145485 21415 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:18.146030 21415 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:18.149221 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2656) took 1651 ms. Trace:
W20260709 12:11:18.149904 17407 leader_election.cc:336] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.803s (SENT)
I20260709 12:11:18.141185 21521 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:18.151496 21545 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:11:18.149775 21380 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:18.156028 21380 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:18.156694 21430 consensus_queue.cc:260] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.154374 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1827) took 1497 ms. Trace:
I20260709 12:11:18.158164 21223 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.159262 21354 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:18.159926 21423 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:18.162452 21540 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:18.157754 17291 rpcz_store.cc:276] 0709 12:11:16.656942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.624569 (+967627us) service_pool.cc:224] Handling call
0709 12:11:17.625234 (+   665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.660401 (+ 35167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.660443 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.661245 (+   802us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.976446 (+315201us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:17.976485 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.976570 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.154145 (+177575us) raft_consensus.cc:1685] finished
0709 12:11:18.154167 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.154312 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78240,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":214,"thread_start_us":314672,"threads_started":1,"wal-append.queue_time_us":438945}
I20260709 12:11:18.165979 21463 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.166807 21342 consensus_queue.cc:237] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.167644 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 888) took 1964 ms. Trace:
I20260709 12:11:18.168010 18008 rpcz_store.cc:276] 0709 12:11:16.203563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.280144 (+ 76581us) service_pool.cc:224] Handling call
0709 12:11:16.280496 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.374840 (+ 94344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.374879 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.392054 (+ 17175us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.805800 (+413746us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:17.673052 (+867252us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.673519 (+   467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.673681 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.063123 (+389442us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:18.167249 (+104126us) raft_consensus.cc:1685] finished
0709 12:11:18.167344 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.167514 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93889,"prepare.queue_time_us":746663,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":131045,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":308,"spinlock_wait_cycles":14076160,"thread_start_us":1247867,"threads_started":2,"wal-append.queue_time_us":932519}
I20260709 12:11:18.171242 21518 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.172063 21485 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.172845 21526 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:18.149675 17292 rpcz_store.cc:276] 0709 12:11:16.497376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.501305 (+  3929us) service_pool.cc:224] Handling call
0709 12:11:16.550499 (+ 49194us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:16.550912 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.550938 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:16.551562 (+   624us) log.cc:844] Serialized 78 byte log entry
0709 12:11:17.262766 (+711204us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18003d7e00. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:18.056000 (+793234us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:18.134736 (+ 78736us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.148141 (+ 13405us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.148548 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.148703 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.148924 (+   221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.148990 (+    66us) raft_consensus.cc:1685] finished
0709 12:11:18.149003 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.149154 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14349,"prepare.queue_time_us":35878,"raft.queue_time_us":8683,"raft.run_cpu_time_us":539,"raft.run_wall_time_us":29954,"spinlock_wait_cycles":5741952,"thread_start_us":744280,"threads_started":1,"wal-append.queue_time_us":1507379}
I20260709 12:11:18.141363 21532 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.188860 21532 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.190312 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.195824 17362 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:18.190155 17980 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:18.191442 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.243031 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.190232 17363 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:18.175522 17407 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:18.190503 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:18.244266 17365 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:18.199101 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 55918.3us
I20260709 12:11:18.264004 21443 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.264717 21443 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.266834 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.267531 17366 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:18.268419 21529 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:18.270349 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 127103us
I20260709 12:11:18.272636 17404 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:18.274802 21524 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:18.278309 21450 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:18.279062 21450 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:18.280114 21450 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.282358 21557 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:18.282872 21557 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:18.283959 21557 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.285526 21557 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.288074 21523 raft_consensus.cc:3055] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:18.288571 21523 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:18.174487 21490 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
I20260709 12:11:18.298588 17258 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:18.388736 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.399034 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.149641 21317 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.193648 21521 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:18.391467 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 61046.9us
I20260709 12:11:18.409668 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:18.147374 21415 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.277680 21524 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
W20260709 12:11:18.399986 21545 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:11:18.472800 21524 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:18.473346 21524 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:18.474462 21524 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.475894 21524 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:18.479954 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.489883 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.494937 21564 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:11:18.408555 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1837) took 1130 ms. Trace:
W20260709 12:11:18.416837 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 222022us
I20260709 12:11:18.417316 21540 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:18.418061 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 268188us
I20260709 12:11:18.406199 21532 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:11:18.423133 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.428176 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2661) took 1838 ms. Trace:
I20260709 12:11:18.429929 21488 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:18.446599 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 47679.9us
W20260709 12:11:18.507462 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.451269 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 52297.1us
I20260709 12:11:18.458824 21521 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.464035 21449 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.464999 21463 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.466148 21443 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.289678 21523 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.467087 21415 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.400468 21430 raft_consensus.cc:3060] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.509840 17362 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:18.511642 21488 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.504643 17288 rpcz_store.cc:276] 0709 12:11:16.589275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.589409 (+   134us) service_pool.cc:224] Handling call
0709 12:11:16.589749 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.643479 (+1053730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.643538 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.644228 (+   690us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.009758 (+365530us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:18.009829 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.010489 (+   660us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.427805 (+417316us) raft_consensus.cc:1685] finished
0709 12:11:18.427830 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.428072 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115166,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":1417336,"threads_started":2,"wal-append.queue_time_us":482354}
I20260709 12:11:18.515242 17365 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:18.524219 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.504822 21540 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:18.525138 17365 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:11:18.530774 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.504457 17286 rpcz_store.cc:276] 0709 12:11:17.266160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.112234 (+846074us) service_pool.cc:224] Handling call
0709 12:11:18.122742 (+ 10508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.123158 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.123184 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.123857 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.392769 (+268912us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:18.392805 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.392875 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.396026 (+  3151us) raft_consensus.cc:1685] finished
0709 12:11:18.396049 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.396231 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":253507,"threads_started":1,"wal-append.queue_time_us":262968}
I20260709 12:11:18.540518 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:18.543962 17258 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:18.544409 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.531531 21540 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.545553 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:18.550195 21423 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:18.554282 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.540081 21388 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.559247 21361 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 12:11:18.562870 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 372917us
I20260709 12:11:18.567401 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:18.570575 17435 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:18.563644 21523 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.556272 21463 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.580524 21349 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:18.582715 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.583016 21518 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.588171 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:18.570225 21568 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:11:18.590816 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.596558 21380 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:18.576821 17439 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
W20260709 12:11:18.605443 17407 leader_election.cc:336] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 2.032s (SENT)
I20260709 12:11:18.575347 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:18.582935 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:18.581560 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:18.610383 17407 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:18.611338 17333 leader_election.cc:336] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.608s (SENT)
I20260709 12:11:18.613094 17434 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:18.608408 21566 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.617993 21566 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.618721 21456 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.620483 21566 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:18.621624 17436 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
W20260709 12:11:18.624662 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 107772us
W20260709 12:11:18.613417 21460 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.506s	user 0.002s	sys 0.009s
I20260709 12:11:18.628213 21522 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:18.620483 17290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2667) took 1966 ms (client timeout 1701 ms). Trace:
I20260709 12:11:18.629154 21343 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.633526 21351 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.608175 21518 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.624379 21463 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.641676 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:18.644026 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 87437.7us
I20260709 12:11:18.644692 21173 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:18.646414 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:18.647254 17438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1719) took 2698 ms (client timeout 1995 ms). Trace:
W20260709 12:11:18.654930 17290 rpcz_store.cc:269] 0709 12:11:16.654134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.712530 (+ 58396us) service_pool.cc:224] Handling call
0709 12:11:18.620228 (+1907698us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54002ad5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:18.620397 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053642496}
I20260709 12:11:18.666821 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2659) took 2081 ms. Trace:
I20260709 12:11:18.650134 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:18.627857 21530 consensus_meta.cc:287] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.004s
W20260709 12:11:18.665117 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 65400us
I20260709 12:11:18.646489 21468 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:18.666841 17438 rpcz_store.cc:269] 0709 12:11:15.948679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.959470 (+ 10791us) service_pool.cc:224] Handling call
0709 12:11:18.646843 (+2687373us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b5400162454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:18.647043 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984799488}
W20260709 12:11:18.675160 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 96915.3us
I20260709 12:11:18.685730 17436 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:11:18.689991 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 63176.7us
I20260709 12:11:18.668390 21173 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.694137 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.657610 21460 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.684484 21468 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:18.667532 21426 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:18.699724 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.698896 21281 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:18.704368 21281 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.704789 21281 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:18.706000 21527 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:18.706537 21527 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.706655 21460 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:18.704972 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 58692.8us
I20260709 12:11:18.708560 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:18.710533 21460 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.710978 21460 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:18.711345 21460 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.712635 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:18.714892 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:18.715226 21531 raft_consensus.cc:3055] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:18.715626 21531 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:18.717026 21393 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:18.716702 21531 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.717618 21393 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:18.718770 21393 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:18.723104 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.724083 17255 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:18.725087 17255 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:18.725806 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2670) took 2070 ms. Trace:
I20260709 12:11:18.725821 21430 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.726364 21456 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.726758 21430 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.727388 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:18.727430 21430 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.726792 21456 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:18.728621 21456 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.717711 21281 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.730597 21568 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:18.731118 21568 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:18.699067 21566 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.733078 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:18.733739 17359 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:18.732122 21568 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.738950 21281 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:18.667771 17285 rpcz_store.cc:276] 0709 12:11:16.585807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.585952 (+   145us) service_pool.cc:224] Handling call
0709 12:11:16.586360 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.178297 (+591937us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:18.022363 (+844066us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.142763 (+120400us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.515627 (+372864us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.515873 (+   246us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.518499 (+  2626us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.530985 (+ 12486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.539494 (+  8509us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.661279 (+121785us) raft_consensus.cc:1685] finished
0709 12:11:18.661298 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.666738 (+  5440us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":856085,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":10263,"raft.queue_time_us":130465,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":15310,"thread_start_us":1395683,"threads_started":3,"wal-append.queue_time_us":334278}
I20260709 12:11:18.699155 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:18.697525 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:18.701458 17436 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:11:18.747443 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.697191 21522 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:18.750947 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 54832.5us
I20260709 12:11:18.742581 17283 rpcz_store.cc:276] 0709 12:11:16.654950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.880658 (+225708us) service_pool.cc:224] Handling call
0709 12:11:16.881002 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.605482 (+724480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.725524 (+1120042us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b540007b054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:18.725747 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658825088}
I20260709 12:11:18.717851 21531 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.753310 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:18.753916 21522 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.754294 21532 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:18.755860 21526 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.001s
I20260709 12:11:18.696166 21351 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.772931 21351 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:18.757053 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 70891.7us
I20260709 12:11:18.757135 21365 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.763314 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.765590 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.763281 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:18.768332 17359 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
I20260709 12:11:18.688181 21530 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.767710 21532 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:18.767026 21561 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:11:18.777185 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:18.784015 17436 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:18.727571 21426 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:18.778074 17358 raft_consensus.cc:2393] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:18.776070 17366 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.784691 17255 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:18.781520 21532 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.801898 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:18.802767 17436 raft_consensus.cc:2410] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:18.793246 21533 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:18.800870 21366 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:11:18.805020 17333 leader_election.cc:336] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.720s (SENT)
I20260709 12:11:18.788549 21540 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.803771 21426 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.817428 21533 raft_consensus.cc:697] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:18.822263 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:18.823938 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:18.825577 21526 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.826290 17283 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:18.820921 21357 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:18.833082 21463 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:18.825176 21388 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.834300 21426 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.835191 17981 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:18.836150 21534 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:18.836577 21534 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:18.837186 21534 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.822286 21533 consensus_queue.cc:237] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.835243 21442 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:11:18.846359 21456 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.847289 21518 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.848110 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:18.836689 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:18.866240 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.812373 21468 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.872149 21522 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:18.836799 21426 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.891250 17366 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:18.894309 21468 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.900507 17255 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:18.902424 21415 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.903113 21415 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.903296 21173 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.905526 21415 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:18.905930 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.906692 17367 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:18.910203 21485 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.911142 17438 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:18.911791 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:18.910864 21485 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.912377 17433 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.912317 17255 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:18.913264 21393 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.913628 21393 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.913991 21393 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.911594 21426 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:18.916039 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.916612 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.920508 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.915778 21426 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:18.921442 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.833145 21540 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:18.923382 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 118391us
I20260709 12:11:18.925761 21230 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.926352 21230 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.926873 21485 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.926729 21426 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.869750 21527 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.930910 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:18.905584 21173 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:18.935984 17333 leader_election.cc:336] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.800s (SENT)
I20260709 12:11:18.938201 17358 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:18.938901 21534 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.939385 21460 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.923765 17363 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:18.935878 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:18.940954 21532 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:18.905454 21526 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.943688 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:18.943970 21530 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:18.944408 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:18.944798 17286 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.945112 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:18.964166 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:18.964790 17362 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.946902 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.966329 17365 raft_consensus.cc:2393] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 5: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:18.948794 17433 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:18.921433 17404 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:18.951733 21527 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:18.925999 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.934247 21415 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:18.955852 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:18.908179 21430 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:18.962412 17333 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:18.945818 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:18.967507 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 46168.3us
W20260709 12:11:18.971702 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 135117us
W20260709 12:11:18.972174 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.968570 17361 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:18.980739 21342 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.981031 21430 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:18.981943 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:18.982409 17286 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.983412 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:18.984143 17283 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:18.984246 21534 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:18.986356 21532 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:18.970559 21415 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.987223 21415 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.989892 17285 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:18.970297 21485 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:18.994490 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 58750.7us
I20260709 12:11:18.997398 17362 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:18.974354 21531 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.000023 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:19.009825 21230 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:19.010063 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:19.011574 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:19.012260 21351 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:19.013217 21456 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.013792 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:19.014710 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.015355 21366 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.015946 21365 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:19.016265 21366 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:19.016541 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:19.017885 21366 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:19.017656 21365 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:19.018301 21442 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:19.021478 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.023265 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.023891 21523 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:19.024281 21351 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.024858 21351 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.025288 21351 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.020270 21568 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:19.023788 21559 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.317s	user 0.006s	sys 0.002s
I20260709 12:11:19.027925 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:18.998579 21485 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.024348 21523 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.053743 17441 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:19.054171 17436 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:19.035808 21568 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:19.055150 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2663) took 2416 ms. Trace:
W20260709 12:11:19.056957 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.056264 21568 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:19.058281 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.060493 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:19.061488 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 125559us
I20260709 12:11:19.055562 17284 rpcz_store.cc:276] 0709 12:11:16.638864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.643423 (+  4559us) service_pool.cc:224] Handling call
0709 12:11:16.647551 (+  4128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.604202 (+956651us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:17.975689 (+371487us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.110276 (+134587us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.194006 (+ 83730us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.194279 (+   273us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:18.246756 (+ 52477us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.247001 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.395621 (+148620us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.705583 (+309962us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b48003000d8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:11:18.706544 (+   961us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b180037cea0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e3f3 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
0709 12:11:19.006412 (+299868us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:19.054913 (+ 48501us) raft_consensus.cc:1685] finished
0709 12:11:19.054932 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.055076 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15372,"prepare.queue_time_us":483833,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":4443,"raft.queue_time_us":77786,"raft.run_cpu_time_us":11174,"raft.run_wall_time_us":449899,"spinlock_wait_cycles":210247168,"thread_start_us":1440595,"threads_started":3,"wal-append.queue_time_us":206742}
I20260709 12:11:19.063694 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:19.064348 17363 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.016170 21393 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.035542 21485 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.073980 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.078142 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:19.073539 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:19.079038 17436 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:19.081565 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.044767 21523 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.089990 21460 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.090708 17441 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:11:19.073642 21534 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:19.097460 17285 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
W20260709 12:11:19.121306 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.094568 21366 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.100267 21449 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:19.201797 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 52473.4us
I20260709 12:11:19.208273 17284 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.209757 21557 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:19.210497 21557 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.216153 17434 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 12:11:19.222005 21571 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.072s	user 0.001s	sys 0.007s
I20260709 12:11:19.132532 21365 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:11:19.224165 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.226809 17441 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
W20260709 12:11:19.224987 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 146998us
I20260709 12:11:19.231575 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:19.158026 21366 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:19.237821 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.239605 17333 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.240729 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.240955 17363 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:19.241883 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:19.136196 21534 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.246124 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.247216 17333 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.250684 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:19.246129 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:19.255792 17438 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:19.258343 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.294620 17363 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:19.294579 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:19.302383 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.294327 18008 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:19.301592 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:19.286254 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 50574us
I20260709 12:11:19.304937 17362 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.305557 17436 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:19.307159 17438 raft_consensus.cc:2468] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:19.293188 17255 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:19.296535 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:19.298601 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:19.314529 17286 raft_consensus.cc:2368] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11.
W20260709 12:11:19.313347 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 84059.1us
W20260709 12:11:19.282092 21591 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:11:19.281641 21594 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:19.275791 21342 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:19.302850 21349 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.267514 21532 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.298833 21534 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:19.258625 21230 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.318148 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:19.296031 21557 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.321640 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:19.299568 21393 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.284425 21426 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:19.352533 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.319026 21456 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:19.318279 21449 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:11:19.349380 21342 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:19.394167 17362 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:19.350419 21349 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.396513 17255 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:19.353094 21532 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:19.370234 21230 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:19.405303 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 90346.9us
W20260709 12:11:19.406697 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.412454 17980 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:19.413384 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.398252 21342 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.419245 17362 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:19.400195 21349 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.421481 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.422124 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:19.416512 21590 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:11:19.428646 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.412918 21521 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:19.429852 21521 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:19.430131 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.428654 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.432036 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:19.399019 21456 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:19.433631 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.404772 21532 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.410653 21230 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.444084 17980 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:19.430480 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.445919 18014 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:19.457468 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.458478 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.458701 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.459676 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.461074 21521 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.459743 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:19.469095 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.448307 18011 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:19.485621 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:19.441237 21526 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.488231 21534 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:19.465571 21598 log.cc:927] Time spent T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:11:19.488901 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.492116 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.492615 18012 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:19.493057 17436 raft_consensus.cc:2410] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:19.489571 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.489521 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.443583 21361 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:19.494263 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.495838 17435 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
W20260709 12:11:19.491674 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 231551us
I20260709 12:11:19.429792 21485 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:19.441237 21530 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:11:19.491231 21596 log.cc:927] Time spent T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:11:19.497283 17438 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:19.449018 21343 consensus_queue.cc:1059] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:19.491539 21534 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.507650 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.501718 21365 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.514457 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.515362 21456 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.520216 21230 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:19.522818 21485 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:19.530653 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.530859 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.532410 21343 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.534943 21530 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.535305 21558 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.536891 17362 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:19.536186 21534 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.537529 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.510447 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.542454 18015 raft_consensus.cc:2393] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:19.598143 18011 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:11:19.568344 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.541615 21281 consensus_queue.cc:1059] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:19.563432 21523 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.543435 21542 consensus_queue.cc:1059] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 12:11:19.577461 21415 consensus_meta.cc:287] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 12:11:19.605991 21415 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.607257 18012 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:19.608210 21415 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:19.608989 17434 raft_consensus.cc:2368] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
W20260709 12:11:19.575878 21351 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.000s
I20260709 12:11:19.609652 21351 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.593467 21530 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:19.572968 21568 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.612269 21568 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:19.612732 21281 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.613174 21281 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:19.614032 21281 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.614499 21568 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:19.592262 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.615002 21281 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.616648 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.618494 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.619585 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.620608 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.621649 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.622633 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.611775 21534 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.623214 18013 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:19.623991 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.624680 18013 raft_consensus.cc:2410] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:19.578954 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:19.588862 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.537356 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:19.629082 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 91833.7us
I20260709 12:11:19.630131 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.564465 21343 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:19.594265 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.563215 21609 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.595604 21526 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:19.632195 21609 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.632616 21609 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.633250 21523 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.633550 21349 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:19.635857 21349 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:19.636312 21366 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:19.637362 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.638144 17436 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:19.640012 21522 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.640672 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.640818 21342 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.641294 17441 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:19.642943 18015 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:19.650786 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:19.651539 21593 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.409s	user 0.006s	sys 0.009s
I20260709 12:11:19.651525 18015 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:19.653196 21609 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.603833 21558 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.653512 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:19.603669 18008 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:19.654156 21558 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:19.655148 18014 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:19.655089 21558 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.656287 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:19.656476 21558 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.656920 17365 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.632493 21343 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.659292 21343 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.662417 21365 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.666044 17365 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:19.666595 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.667266 18014 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:19.669107 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:19.674490 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:19.675176 17366 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.675356 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:19.677871 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:19.678648 17361 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:19.662665 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.688113 18012 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:19.690332 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:19.690274 18011 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:19.697839 17434 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:19.691272 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:19.702001 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:19.703238 17366 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:19.697928 17404 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.704653 17980 leader_election.cc:400] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11.
I20260709 12:11:19.705098 17980 leader_election.cc:403] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:11:19.705173 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.581614 21532 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:19.705744 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 105636us
I20260709 12:11:19.708741 17433 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:11:19.706516 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 198930us
I20260709 12:11:19.711061 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:19.712040 17435 raft_consensus.cc:2410] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:19.714190 17363 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.718555 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.718918 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:19.719745 17438 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:19.611879 21351 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.640022 21534 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:19.642966 21342 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.721900 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:19.736447 17434 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:19.723788 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:19.690285 21468 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:19.611901 21530 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:19.732398 17367 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:19.724756 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.723148 21527 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:19.723227 21522 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:19.715853 21415 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:19.728763 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.719455 18014 raft_consensus.cc:2376] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12. Re-sending same reply.
I20260709 12:11:19.737505 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:19.744689 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:19.750828 17288 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.750948 17438 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.721938 21526 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:19.761042 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.767082 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.767940 18012 raft_consensus.cc:2410] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:11:19.748008 21527 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.800645 21527 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:19.755970 21450 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:19.806540 21450 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:19.807493 21450 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.811229 21442 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:19.813081 21534 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.813496 21534 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:19.814500 21534 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.745913 21468 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.817348 21468 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.750447 21523 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:11:19.766431 21351 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.754590 21530 consensus_queue.cc:1059] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 12:11:19.819680 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 55914.6us
I20260709 12:11:19.831997 17407 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:19.836392 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:19.837328 18011 raft_consensus.cc:2410] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:11:19.772403 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:19.773279 21609 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.773672 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.775058 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.830677 21449 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.775803 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.776350 18009 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:19.843866 21449 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:19.776547 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.774971 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.777761 21281 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:19.778534 21423 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:19.844491 17186 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:19.845953 18015 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:19.779523 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.779873 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:19.798550 21532 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:19.845067 17190 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60632 (request call id 220) took 28339 ms (client timeout 15000 ms). Trace:
I20260709 12:11:19.799979 21230 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:19.773597 21526 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:19.844889 18010 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 14: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:19.845340 21423 consensus_queue.cc:1243] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer e860f7e876b74ec589f447737822a4f6 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:19.864099 21526 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:19.851624 17438 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:19.852418 17288 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:19.867370 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:19.847505 18007 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:19.847455 18006 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:19.869534 21557 raft_consensus.cc:2764] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:19.855842 17434 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 5.
W20260709 12:11:19.848616 17190 rpcz_store.cc:269] 0709 12:10:51.506040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.510469 (+  4429us) service_pool.cc:224] Handling call
0709 12:10:51.671347 (+160878us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b54000762d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a85090 00007f1225b23f3a 00007f122b8d9e9c 00007f122b9d804e 00007f1229e992a4 00007f1229e99232 00007f1229e99161 00007f1229e990dc 00007f1229e98392 00007f1223e5648c 00007f1223e558c6
0709 12:11:19.844860 (+28173513us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:18.064782 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:18.121035 (+ 56253us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:18.121102 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:11:18.121134 (+    32us) tablet.cc:662] Decoding operations
0709 12:11:18.121989 (+   855us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:18.122124 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:18.122165 (+    41us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:11:18.122857 (+   692us) tablet.cc:701] Row locks acquired
0709 12:11:18.122919 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:11:18.123142 (+   223us) write_op.cc:270] Start()
0709 12:11:18.123320 (+   178us) write_op.cc:276] Timestamp: P: 1783599078123075 usec, L: 0
0709 12:11:18.123355 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:11:18.258129 (+134774us) log.cc:844] Serialized 2128 byte log entry
0709 12:11:18.769351 (+511222us) op_driver.cc:464] REPLICATION: finished
0709 12:11:18.898257 (+128906us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f1222a110ac 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f1229551ef0
0709 12:11:19.016757 (+118500us) write_op.cc:301] APPLY: starting
0709 12:11:19.016864 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:19.051436 (+ 34572us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:19.051483 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:19.090622 (+ 39139us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:19.090927 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:11:19.091001 (+    74us) write_op.cc:312] APPLY: finished
0709 12:11:19.109025 (+ 18024us) log.cc:844] Serialized 57 byte log entry
0709 12:11:19.151299 (+ 42274us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:19.201000 (+ 49701us) write_op.cc:454] Released schema lock
0709 12:11:19.220016 (+ 19016us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:19.279972 (+ 59956us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:19.309743 (+ 29771us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1850442,"reported_tablets":37,"spinlock_wait_cycles":16152448,"child_traces":[["op",{"apply.queue_time_us":247084,"apply.run_cpu_time_us":22536,"apply.run_wall_time_us":218689,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18801,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":1,"lbm_read_time_us":4600,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":7,"num_ops":5,"prepare.queue_time_us":1161583,"prepare.run_cpu_time_us":72121,"prepare.run_wall_time_us":513964,"raft.queue_time_us":181299,"raft.run_cpu_time_us":11765,"raft.run_wall_time_us":198135,"replication_time_us":645759,"spinlock_wait_cycles":15268096,"thread_start_us":1659412,"threads_started":4,"wal-append.queue_time_us":306687}]]}
I20260709 12:11:19.867722 17360 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:19.876149 17407 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:19.879576 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.883695 21426 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:19.830037 21351 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:19.888692 21351 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:19.844902 21449 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:19.759089 21522 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:19.909060 21522 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:19.910534 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.911412 18012 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:19.918011 17186 catalog_manager.cc:5697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:19.923053 17186 catalog_manager.cc:5697] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 1 to 3, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:19.925760 17186 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 9 to 11, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 11 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:19.933025 21527 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:19.937642 21449 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:19.940778 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 44704.7us
W20260709 12:11:19.948638 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 265453us
W20260709 12:11:19.962352 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.962865 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.974515 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:19.976871 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:19.981871 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:19.947661 21351 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.986198 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:19.988072 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:19.988750 18006 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.995977 17186 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:19.998993 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 287979us
I20260709 12:11:20.030740 17285 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:20.035496 18014 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:20.036907 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:20.038286 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:20.041006 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:20.044580 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46363.9us
I20260709 12:11:20.044847 17363 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:20.046244 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:20.048422 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 214353us
W20260709 12:11:20.048702 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 268296us
I20260709 12:11:20.050231 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:20.053220 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:20.054801 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.047808 21468 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:20.059659 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:20.060669 21524 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:20.061072 21524 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.061432 21524 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.067296 21621 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:20.067961 21621 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:20.068130 21527 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:20.068962 21621 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:20.073624 17981 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:20.078120 21361 raft_consensus.cc:2804] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:20.078795 21361 raft_consensus.cc:697] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:20.079798 21361 consensus_queue.cc:237] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:20.083352 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:20.084062 17363 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.088930 18009 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
W20260709 12:11:20.099488 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.099865 18010 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:20.106873 18006 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
W20260709 12:11:20.112051 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 61887.3us
I20260709 12:11:20.047405 21609 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.116705 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.115522 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.119475 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.120522 17291 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:20.120121 17292 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:20.101012 21463 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.122736 17186 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 6 to 8, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 8 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:20.127907 17407 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:20.130533 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.085085 21524 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:20.135519 17284 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:20.136658 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.141995 17363 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:20.149902 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:20.168793 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:20.171876 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 44062.9us
I20260709 12:11:20.121757 21609 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:20.173746 17407 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:20.179627 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.218273 17186 catalog_manager.cc:5697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:20.168609 21393 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:20.131510 21351 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:20.170342 21557 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:20.258916 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.241003 18013 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:20.269078 17186 catalog_manager.cc:5697] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 3 to 8, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 8 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:20.231611 21415 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11.
I20260709 12:11:20.273319 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.271217 17186 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:20.273908 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.282394 21524 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:20.279953 17186 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 8 to 11, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 11 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:20.292554 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 246185us
W20260709 12:11:20.295258 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.294915 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:20.262333 21393 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:20.299892 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.300117 18007 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:20.269778 21603 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:20.299957 17363 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.293412 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:20.311618 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 202122us
I20260709 12:11:20.314062 17981 leader_election.cc:400] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
I20260709 12:11:20.314407 17981 leader_election.cc:403] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.317883 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.318352 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.263911 21450 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:20.261147 21351 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:20.319836 21366 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.326454 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.327481 17292 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:20.313066 21603 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:20.354360 17186 catalog_manager.cc:5697] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:20.356153 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 182474us
I20260709 12:11:20.355096 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.362509 17363 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:20.364154 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.364423 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:20.365051 17284 raft_consensus.cc:2410] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:20.363029 17186 catalog_manager.cc:5697] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:11:20.365957 17406 leader_election.cc:336] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.506s (SENT)
I20260709 12:11:20.366688 17406 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:20.366079 17186 catalog_manager.cc:5697] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 4 to 5, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 5 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:20.353214 21603 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.351276 21456 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.371954 17434 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:20.349613 21634 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:20.352874 21623 raft_consensus.cc:2764] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:20.377146 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:20.378021 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:20.382826 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:20.385614 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:20.389158 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 95767.9us
I20260709 12:11:20.391208 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.391705 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.390584 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.392608 17285 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.391068 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:20.396739 17288 raft_consensus.cc:2376] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8. Re-sending same reply.
I20260709 12:11:20.397042 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:20.398289 17284 raft_consensus.cc:2393] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:20.398458 17437 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.399471 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:20.400101 17438 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.401698 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:20.402395 17434 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.403076 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.404021 17291 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:20.405066 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.408617 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.413235 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:20.415470 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.409770 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.409297 17292 raft_consensus.cc:2376] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8. Re-sending same reply.
I20260709 12:11:20.425053 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.394302 21463 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.378720 21540 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:20.401662 21450 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:20.417402 17287 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:11:20.432018 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:20.436759 17363 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:20.440784 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 76951.4us
I20260709 12:11:20.370131 21357 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:11:20.435843 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.448164 17365 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:20.448784 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.449487 17286 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 6.
I20260709 12:11:20.439549 17433 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:20.450624 17433 pending_rounds.cc:85] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 5
I20260709 12:11:20.450874 17433 pending_rounds.cc:107] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:20.451090 17433 raft_consensus.cc:2889] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.441406 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:20.451869 17362 raft_consensus.cc:2368] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
I20260709 12:11:20.447153 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:20.403093 21609 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:20.454618 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:20.455555 17366 raft_consensus.cc:2368] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11.
I20260709 12:11:20.456631 17438 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:20.370625 21393 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:20.422134 21615 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:20.384477 21456 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:20.460431 21632 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:11:20.463577 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.465332 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:20.465844 21631 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:11:20.466813 21622 log.cc:927] Time spent T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 12:11:20.467325 21633 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 12:11:20.468881 21626 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:11:20.430250 21643 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.466029 17432 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.481703 17981 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:20.482774 17436 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:20.476095 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:20.477540 17362 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:20.486312 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:20.478256 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:20.479056 17437 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
W20260709 12:11:20.466749 21638 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:11:20.474803 21620 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 12:11:20.465361 21644 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:11:20.519074 17406 leader_election.cc:336] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.658s (SENT)
I20260709 12:11:20.504998 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:20.522922 17362 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.509758 17434 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:20.411022 21634 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:20.460886 21526 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:20.495107 17333 connection.cc:256] RPC call timeout handler was delayed by -1.3610647850000532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 12:11:20.569027 17333 connection.cc:256] RPC call timeout handler was delayed by -1.285464784999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 12:11:20.569396 17333 connection.cc:256] RPC call timeout handler was delayed by -1.2206647850000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
I20260709 12:11:20.437472 21463 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:20.561535 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 107868us
I20260709 12:11:20.587491 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:20.499420 21449 consensus_meta.cc:287] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:11:20.566231 17406 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:20.566581 17437 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:20.567003 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.594262 17284 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:20.481305 21534 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:20.575392 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 149161us
I20260709 12:11:20.598897 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:20.589972 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:20.497496 21615 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:20.601619 18010 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
W20260709 12:11:20.604315 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.615325 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:20.616689 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:20.617332 18009 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.618011 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:20.618682 18015 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:20.619400 17362 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:20.623869 17333 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:20.628598 17437 raft_consensus.cc:1275] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:11:20.631074 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:20.636803 21351 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:20.629374 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.611959 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:20.592002 21643 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.639786 17284 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:20.658615 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:20.663877 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.665712 17333 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:20.689975 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.692412 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1929) took 1018 ms. Trace:
I20260709 12:11:20.693640 18009 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:20.692904 17364 rpcz_store.cc:276] 0709 12:11:19.673549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.673683 (+   134us) service_pool.cc:224] Handling call
0709 12:11:19.674049 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.674463 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.674492 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.675047 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.992250 (+317203us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:19.992294 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.992370 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.692150 (+699780us) raft_consensus.cc:1685] finished
0709 12:11:20.692176 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.692335 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26185,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":9453,"thread_start_us":316730,"threads_started":1,"wal-append.queue_time_us":494118}
I20260709 12:11:20.696698 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.697695 17286 raft_consensus.cc:2410] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:20.693122 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:20.700964 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 89106.1us
I20260709 12:11:20.588364 21526 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:20.656810 21609 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.657276 21532 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.733144 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.742384 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.739565 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:20.740221 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 221156us
I20260709 12:11:20.774142 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.737071 21423 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:20.794888 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:20.859019 17433 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.816079 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.715772 21609 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:20.844738 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.729884 21623 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 12:11:20.846187 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 156532us
I20260709 12:11:20.819073 17284 raft_consensus.cc:2376] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8. Re-sending same reply.
I20260709 12:11:20.869998 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:20.870168 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 168040us
W20260709 12:11:20.768386 21642 log.cc:927] Time spent T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 12:11:20.851294 17436 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:20.852252 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:20.855475 17435 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:20.764108 21639 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:20.859918 17292 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:20.691227 21643 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:20.693580 21624 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:11:20.871016 17978 leader_election.cc:400] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
I20260709 12:11:20.871330 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:20.876376 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.758435 21540 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 12:11:20.877846 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:20.868104 21609 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.885787 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:20.887115 17441 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.880421 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:20.888950 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.891129 17292 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.902948 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:20.903133 17439 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 13: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:20.761612 21357 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 12:11:20.902480 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.917976 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:20.918944 17284 raft_consensus.cc:2410] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:20.871948 21450 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:20.920035 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.927129 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:20.929898 17436 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:11:20.902479 21648 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 12:11:20.933884 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.933948 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:20.935374 21643 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:20.919873 21639 raft_consensus.cc:697] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:20.936950 21639 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:20.938586 21357 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:20.940775 17285 consensus_meta.cc:287] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.000s
I20260709 12:11:20.941416 21650 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.946158 17284 raft_consensus.cc:2393] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:20.948789 17285 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:20.954488 17288 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:20.955621 17291 raft_consensus.cc:1275] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:20.956668 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:20.957130 17433 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:20.899116 21456 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:20.935835 21655 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:20.929647 21635 raft_consensus.cc:2764] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:20.971791 17284 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.973026 17285 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:20.977804 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:20.981568 17284 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:20.867396 21615 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:20.988988 21619 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:11:20.990324 21634 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:20.991595 21668 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:20.997987 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.963297 21532 raft_consensus.cc:2764] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:11:21.002759 21603 consensus_meta.cc:287] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.000s
I20260709 12:11:21.003490 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 884) took 1041 ms. Trace:
I20260709 12:11:21.003865 18007 rpcz_store.cc:276] 0709 12:11:19.962010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.962630 (+   620us) service_pool.cc:224] Handling call
0709 12:11:21.003272 (+1040642us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400101dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:21.003398 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771858176}
I20260709 12:11:21.004832 21603 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.008147 21603 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:21.010186 17284 raft_consensus.cc:3055] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:21.010697 17284 raft_consensus.cc:740] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:21.011718 17284 consensus_queue.cc:260] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.012797 17284 raft_consensus.cc:3060] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.022459 21526 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:20.979997 21463 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:21.027817 17435 pending_rounds.cc:85] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 8
I20260709 12:11:21.028280 17435 pending_rounds.cc:107] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:21.028528 17435 raft_consensus.cc:2889] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:21.033002 17432 consensus_meta.cc:287] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.001s
I20260709 12:11:20.948539 21357 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:21.040225 17432 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
W20260709 12:11:21.051528 17406 leader_election.cc:336] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.701s (SENT)
I20260709 12:11:21.052846 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:20.925931 17286 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:21.056352 17441 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
W20260709 12:11:21.057534 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 166896us
I20260709 12:11:21.062952 17434 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.065857 17333 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:21.010628 21657 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:11:21.105077 18007 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:21.106900 17284 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:11:21.158969 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 93175.1us
W20260709 12:11:21.065054 21366 consensus_meta.cc:287] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.004s
W20260709 12:11:21.180588 17186 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.017s
W20260709 12:11:21.181121 17186 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.000s	sys 0.017s
W20260709 12:11:21.210281 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.214382 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:21.218889 17366 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.220525 18009 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
W20260709 12:11:21.222977 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 171474us
I20260709 12:11:21.166909 21540 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.223743 17406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.878s (SENT) [suppressed 39 similar messages]
I20260709 12:11:21.189919 21366 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8.
W20260709 12:11:21.230756 17406 leader_election.cc:336] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.734s (SENT)
I20260709 12:11:21.235841 17406 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:21.220014 21635 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:21.216387 21532 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:21.216169 21463 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:21.239873 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 336974us
W20260709 12:11:21.242452 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.243325 17406 leader_election.cc:336] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.955s (SENT)
I20260709 12:11:21.244889 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:21.227128 21621 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.251242 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:21.160161 21450 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.241022 21456 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.256538 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:21.257254 17432 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:21.244002 21522 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.270710 18006 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
W20260709 12:11:21.273267 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.276722 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:21.277418 17432 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
W20260709 12:11:21.279446 17406 leader_election.cc:336] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.155s (SENT)
I20260709 12:11:21.279874 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:21.248636 21621 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:21.235140 21540 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.303911 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:21.246943 21463 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:21.314154 21658 log.cc:927] Time spent T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:11:21.286873 21661 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:21.287797 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 46102.5us
I20260709 12:11:21.246644 21532 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:21.332463 21651 log.cc:927] Time spent T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.770s	user 0.002s	sys 0.001s
I20260709 12:11:21.293520 21456 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.334549 21540 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:21.274456 21670 raft_consensus.cc:2764] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:11:21.285416 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:21.337626 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:21.334599 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:21.394440 17434 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:21.309789 21621 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.339558 21683 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.305015 21357 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:21.342396 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 62955.1us
I20260709 12:11:21.401726 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:21.403046 17406 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:21.344193 21463 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:21.275527 21635 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:21.405378 21635 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.349504 21609 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.355229 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:21.359620 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:21.359763 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:21.361585 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:21.362427 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:21.363682 17407 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:21.366865 17332 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.507s (SENT)
I20260709 12:11:21.368875 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:21.439363 18014 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:21.439397 18012 raft_consensus.cc:2376] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12. Re-sending same reply.
I20260709 12:11:21.317332 21669 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.378765 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:21.381927 21534 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:21.383363 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:21.383766 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:21.384291 17364 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.384858 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:21.386252 17292 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:21.397663 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:21.444324 17434 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:21.449129 17361 raft_consensus.cc:2368] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11.
I20260709 12:11:21.449476 17432 raft_consensus.cc:1240] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.412873 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:21.446848 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 68182.2us
W20260709 12:11:21.449236 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 51635.8us
I20260709 12:11:21.450495 17978 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:21.445989 17439 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.450794 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:21.447616 17440 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:21.438684 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:21.453722 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:21.455814 21670 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.460063 21670 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.460530 21670 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.460924 17440 raft_consensus.cc:1275] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:21.460079 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:21.462445 21667 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.462724 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:21.464118 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:21.464707 18015 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.464602 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:21.466599 21522 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.469249 17433 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:21.463099 17333 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:21.459444 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:21.468107 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:21.485541 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 121917us
I20260709 12:11:21.487622 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:21.488499 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 75714.1us
I20260709 12:11:21.460013 21665 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.454667 21650 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.410048 21342 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:11:21.498478 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:21.487093 21365 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.484772 21683 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:21.508805 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 141965us
I20260709 12:11:21.488016 21634 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.489996 21623 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.496083 21667 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:21.490285 21534 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:21.531566 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.392915 21661 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.595826 18015 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:21.529263 21634 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:21.537092 21534 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.597595 18014 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 12:11:21.599604 21609 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:21.598134 21650 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:21.595641 21173 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:21.597193 21463 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:21.611889 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 117544us
I20260709 12:11:21.616330 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:21.616684 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.603065 21534 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.613114 21663 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:21.597527 21627 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.612432 21646 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:21.613651 21659 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.160s
I20260709 12:11:21.603787 21668 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.542043 21683 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.606208 21634 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:21.630643 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 293072us
W20260709 12:11:21.717156 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 100905us
I20260709 12:11:21.622468 21636 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:21.718019 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 86547.2us
I20260709 12:11:21.718061 17406 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:21.614691 21666 consensus_queue.cc:1059] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.231s
W20260709 12:11:21.730734 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 210045us
W20260709 12:11:21.731491 17332 leader_election.cc:336] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.574s (SENT)
I20260709 12:11:21.731861 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:21.734735 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.625612 21667 consensus_queue.cc:1048] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
W20260709 12:11:21.728051 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 265379us
I20260709 12:11:21.626231 21627 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.720980 21675 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.780335 17978 leader_election.cc:400] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11.
I20260709 12:11:21.728521 21173 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:11:21.628295 21646 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:21.817042 21646 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:21.785377 21365 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:11:21.769289 21666 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.789726 21661 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:21.629568 21668 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.827579 21668 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:21.790972 21685 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:11:21.791676 21708 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:21.829005 21708 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.831524 21708 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:21.792546 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:21.832553 21173 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.833367 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:21.834318 21173 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.834860 21173 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:21.794131 21683 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:21.796602 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 923) took 1209 ms. Trace:
I20260709 12:11:21.799223 18008 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:21.835767 21173 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.801628 21456 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:21.836335 18006 rpcz_store.cc:276] 0709 12:11:20.587099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.587224 (+   125us) service_pool.cc:224] Handling call
0709 12:11:21.796398 (+1209174us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400573fd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:21.796521 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503243008}
I20260709 12:11:21.806918 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:21.838500 18014 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:21.807941 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 777) took 1336 ms. Trace:
I20260709 12:11:21.839259 17366 rpcz_store.cc:276] 0709 12:11:20.471939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.483856 (+ 11917us) service_pool.cc:224] Handling call
0709 12:11:20.513916 (+ 30060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.219393 (+705477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.807709 (+588316us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400030054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:21.807877 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620806016}
I20260709 12:11:21.809525 21670 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:21.753335 21532 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:21.812489 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:21.841140 18015 raft_consensus.cc:2376] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8. Re-sending same reply.
I20260709 12:11:21.842192 21670 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:21.814054 21627 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:21.843017 21621 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.836499 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:21.801247 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:21.845314 21456 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:21.845889 21456 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:21.846873 21456 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.847788 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:21.853904 21688 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:21.856897 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:21.858090 21634 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.860591 21688 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.861084 21688 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:21.861480 21688 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.864277 21349 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.864789 21349 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:21.865651 21349 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:21.867261 21349 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.872121 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:21.872853 17283 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 6.
I20260709 12:11:21.900236 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:21.901051 17283 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:21.903172 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:21.907279 17980 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:11:21.907502 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 176047us
I20260709 12:11:21.908018 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:21.847688 21621 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:21.910924 17332 leader_election.cc:336] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.725s (SENT)
I20260709 12:11:21.918877 17332 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:21.901978 21540 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:21.926950 21634 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:21.933777 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:21.936723 21688 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.944762 21668 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:21.950750 17332 leader_election.cc:336] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.828s (SENT)
I20260709 12:11:21.879678 21534 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:21.951817 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 94987.2us
I20260709 12:11:21.953078 17438 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.954993 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:21.955904 21532 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.956542 21532 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:21.951273 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:21.958851 21666 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:21.959156 17332 leader_election.cc:336] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.957s (SENT)
W20260709 12:11:21.960071 17332 leader_election.cc:336] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.961s (SENT)
I20260709 12:11:21.960238 21688 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:21.960577 21699 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.961516 21646 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:21.962065 21646 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:21.962456 21534 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:21.964257 21646 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:21.967916 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:21.968618 18009 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:21.949569 21621 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.971946 18006 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:21.972565 17289 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:21.973078 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.975852 18011 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:21.976634 17332 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:22.028471 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 51886.8us
I20260709 12:11:22.029906 17332 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:22.057622 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 97331.4us
I20260709 12:11:21.949826 21668 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:22.090746 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.068127 21670 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.117374 21670 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:22.068228 21706 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:11:22.150243 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 120391us
W20260709 12:11:22.156752 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 68958.8us
I20260709 12:11:22.166939 17332 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:22.058877 21666 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:22.157429 17438 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:22.088150 21668 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.173583 17332 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:22.175160 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:22.177649 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:22.102789 21699 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:22.179211 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:22.180469 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:22.160655 21670 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.160866 21647 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:22.160388 21615 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.175550 21349 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.181324 21688 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.182461 21426 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.187816 21456 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.187216 21342 raft_consensus.cc:3055] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.188117 21393 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.190743 21621 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.188544 21647 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:22.185784 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:22.176832 21666 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:22.217183 21463 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:22.221309 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.209429 21532 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:22.208917 21342 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:22.231870 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:22.223390 21456 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.224646 21463 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.242972 21527 consensus_queue.cc:1048] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:22.242560 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:22.245347 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:22.195969 21699 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:22.247257 17361 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
W20260709 12:11:22.248698 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 74687us
I20260709 12:11:22.242209 21426 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:22.253357 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.253679 17366 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:22.255774 21710 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:11:22.261058 21668 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:22.261574 21527 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.262357 21527 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:22.254558 21647 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:22.246208 21456 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:22.263590 21527 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:22.264657 21456 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:22.244141 21688 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:11:22.267532 21426 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:22.268538 21426 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:22.271138 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:22.281157 21526 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:22.281733 21526 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.282183 21526 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:22.284011 21702 log.cc:927] Time spent T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.515s	user 0.010s	sys 0.008s
I20260709 12:11:22.274343 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:22.288868 21688 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:22.289412 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 769) took 1289 ms. Trace:
I20260709 12:11:22.236280 21393 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:22.289816 17435 rpcz_store.cc:276] 0709 12:11:21.000039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.027169 (+ 27130us) service_pool.cc:224] Handling call
0709 12:11:21.027589 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:21.029749 (+  2160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.029783 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:21.038727 (+  8944us) log.cc:844] Serialized 52 byte log entry
0709 12:11:21.380187 (+341460us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:21.380423 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.380501 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.287553 (+907052us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b1800085900. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e3f3 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
0709 12:11:22.289059 (+  1506us) raft_consensus.cc:1685] finished
0709 12:11:22.289086 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.289324 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4153,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":25385,"spinlock_wait_cycles":103688448,"thread_start_us":95774,"threads_started":1,"wal-append.queue_time_us":223315}
I20260709 12:11:22.294138 17365 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:22.295608 17361 raft_consensus.cc:1275] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:11:22.297290 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.300545 21534 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.310614 21645 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.295321 21621 consensus_queue.cc:1059] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:11:22.354117 21645 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:22.328961 21670 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:22.312176 21342 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:22.354799 21534 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:22.426566 21699 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:22.427156 21361 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:22.427655 21361 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:22.428683 21361 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:22.429816 21361 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.433130 21534 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:22.433435 21670 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:22.376241 21342 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.447926 21666 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:22.469813 21668 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:22.476027 21463 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:22.480351 21526 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:22.501807 21645 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:22.496186 21463 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:22.509197 21526 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:22.635684 21650 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:22.982523 18007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.016s	sys 0.019s
W20260709 12:11:22.982959 18007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.016s	sys 0.019s
I20260709 12:11:23.009804 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 930) took 1623 ms. Trace:
I20260709 12:11:23.010320 18006 rpcz_store.cc:276] 0709 12:11:21.386393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.837686 (+451293us) service_pool.cc:224] Handling call
0709 12:11:21.837984 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.972328 (+134344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.009484 (+1037156us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540061a154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:23.009722 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307632000}
I20260709 12:11:23.020218 21532 raft_consensus.cc:3055] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:23.020754 21532 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:23.021588 21532 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:23.022882 21532 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.037022 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 823) took 1165 ms. Trace:
I20260709 12:11:23.037524 17289 rpcz_store.cc:276] 0709 12:11:21.871433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.873965 (+  2532us) service_pool.cc:224] Handling call
0709 12:11:21.899688 (+ 25723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.972851 (+ 73163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.036732 (+1063881us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54002003d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:23.036935 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167275392}
I20260709 12:11:23.039117 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:23.044128 21357 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.054883 21646 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.055528 21646 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:23.058074 21646 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:23.070976 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.077692 18013 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:23.079643 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:23.080876 17367 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
W20260709 12:11:23.089143 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.098789 21646 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.099396 21646 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.102653 21646 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:23.105466 17367 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:11:23.109422 17438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1897) took 2295 ms (client timeout 1868 ms). Trace:
W20260709 12:11:23.110159 17438 rpcz_store.cc:269] 0709 12:11:20.813690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.851984 (+ 38294us) service_pool.cc:224] Handling call
0709 12:11:23.109103 (+2257119us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400115154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:23.109305 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479124736}
I20260709 12:11:23.112149 17367 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:23.112370 17432 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:23.120793 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:23.121364 17366 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.022s	sys 0.038s
W20260709 12:11:23.121850 17366 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.022s	sys 0.039s
I20260709 12:11:23.122316 21727 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.122756 21727 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:23.123096 21727 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.129534 21646 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.130180 21646 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:23.131338 17361 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:23.133237 21646 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:23.142809 18013 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 924) took 1783 ms (client timeout 2195 ms). Trace:
W20260709 12:11:23.143265 18013 rpcz_store.cc:269] 0709 12:11:21.359065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.359356 (+   291us) service_pool.cc:224] Handling call
0709 12:11:23.142008 (+1782652us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003ccb54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:23.142733 (+   725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3754408704}
I20260709 12:11:23.140090 21725 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:11:23.144850 21726 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.145239 21726 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:23.145906 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 825) took 1273 ms. Trace:
I20260709 12:11:23.146049 21726 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:23.147382 21726 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.146544 17287 rpcz_store.cc:276] 0709 12:11:21.871971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.872513 (+   542us) service_pool.cc:224] Handling call
0709 12:11:21.872832 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.873171 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.873198 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.873643 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.236600 (+362957us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:22.236640 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.236707 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:23.145621 (+908914us) raft_consensus.cc:1685] finished
0709 12:11:23.145644 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.145822 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19309,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6384,"thread_start_us":362581,"threads_started":1,"wal-append.queue_time_us":437370}
I20260709 12:11:23.150053 21725 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:23.157460 17255 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:23.158489 21729 consensus_queue.cc:1048] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:23.158854 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:23.160058 21729 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:23.160655 21729 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:23.161105 21729 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.160126 21727 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:23.175076 21730 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.161360 21726 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:11:23.190088 21726 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:23.191581 21726 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:23.192907 21726 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:23.193465 21726 consensus_queue.cc:1243] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer aaafaad0810b4e95983d2d73ec814346 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:23.181443 21730 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.194847 21730 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.195716 21727 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:23.196075 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.196705 17290 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:23.197003 21730 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:23.197618 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.198081 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.198278 17283 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:23.201071 17290 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.202466 17287 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:23.204296 21646 consensus_queue.cc:1048] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:23.208503 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.209666 17289 raft_consensus.cc:2393] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:23.211186 21661 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:23.211921 21732 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.212085 21661 raft_consensus.cc:3055] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:23.212232 21731 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:23.212596 21732 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:23.213970 21661 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:23.215554 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:23.215777 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.216954 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:23.217525 17285 raft_consensus.cc:2393] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:23.216398 17283 raft_consensus.cc:2376] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7. Re-sending same reply.
I20260709 12:11:23.218762 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.219367 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:23.219995 17288 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.220533 21732 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:23.221174 21647 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.221676 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.222355 21661 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.223927 17289 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:23.217922 21731 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.227068 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 928) took 1841 ms. Trace:
I20260709 12:11:23.227854 21731 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:23.230962 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.231863 17292 raft_consensus.cc:2410] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:23.232447 21668 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.233479 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 52744.8us
I20260709 12:11:23.234233 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.235725 17366 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:23.236002 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:23.236274 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.236595 17285 raft_consensus.cc:2376] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7. Re-sending same reply.
I20260709 12:11:23.237213 17288 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:23.237886 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:23.238448 17285 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:23.238801 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.238961 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.240207 21627 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:23.233043 21668 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.240756 21627 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.227504 18007 rpcz_store.cc:276] 0709 12:11:21.385886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.481621 (+ 95735us) service_pool.cc:224] Handling call
0709 12:11:21.481997 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:21.767050 (+285053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.767082 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:21.784613 (+ 17531us) log.cc:844] Serialized 52 byte log entry
0709 12:11:22.983334 (+1198721us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:22.984289 (+   955us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.226540 (+242251us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.226741 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.226811 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:23.226869 (+    58us) raft_consensus.cc:1685] finished
0709 12:11:23.226881 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.227005 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245940,"prepare.queue_time_us":2913,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":266190,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":9633,"thread_start_us":1384143,"threads_started":3,"wal-append.queue_time_us":570657}
I20260709 12:11:23.242962 21627 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:23.240121 21558 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.247684 17285 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:23.247090 21668 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:23.243100 21661 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.251876 21357 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.252418 21357 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.254268 21361 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.254827 21361 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.255600 21542 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.256085 21542 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.256875 21361 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:23.258083 21542 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:23.255338 21343 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.258898 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:23.259495 17292 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:23.260571 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.260955 18013 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:23.261039 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.247758 17283 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:23.262400 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.263630 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.264724 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:23.265596 17363 raft_consensus.cc:2410] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:11:23.262475 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:23.267179 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.258560 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 775) took 1897 ms. Trace:
W20260709 12:11:23.267948 17333 connection.cc:256] RPC call timeout handler was delayed by -1.0968963830000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
I20260709 12:11:23.268770 17285 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
W20260709 12:11:23.269742 17333 connection.cc:256] RPC call timeout handler was delayed by -1.0968963830000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 12:11:23.272794 17333 connection.cc:256] RPC call timeout handler was delayed by -1.0113963830001467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 12:11:23.273172 17333 connection.cc:256] RPC call timeout handler was delayed by -1.0104963830001452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:11:23.274578 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.274969 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.268689 17432 rpcz_store.cc:276] 0709 12:11:21.361226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.450259 (+ 89033us) service_pool.cc:224] Handling call
0709 12:11:23.112191 (+1661932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.113636 (+  1445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.258358 (+144722us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400115150. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:23.258504 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3821356288}
I20260709 12:11:23.267167 18007 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:23.280931 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:23.281792 18011 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 9: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:23.286681 18007 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:23.289624 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:23.289739 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.290645 18006 raft_consensus.cc:2410] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:23.291733 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:23.294317 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:23.294562 18012 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:23.295012 17361 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:23.296039 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:23.296707 17361 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:23.299607 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:23.305998 17255 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:23.308318 17292 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:23.298419 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:23.310431 17360 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.311414 17361 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:23.311713 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:23.248092 21366 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:11:23.284863 21668 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:23.289640 21342 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:23.349418 21733 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.248136 21558 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.350347 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:23.351703 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:23.368283 21733 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.368732 21729 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.350734 21366 consensus_queue.cc:1243] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:23.278491 21343 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.369396 18012 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:23.376521 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:23.290943 21730 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:11:23.384569 18007 raft_consensus.cc:2410] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:11:23.385718 18011 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.353519 21357 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:23.391417 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:23.374855 21532 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:23.399709 18012 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:23.397882 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 91970.3us
I20260709 12:11:23.379168 21733 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.401252 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:23.404040 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:23.404264 21727 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.404726 21727 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:23.405081 21727 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.405308 21731 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.406847 18013 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:23.408479 17358 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:23.410295 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.411118 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.412442 21729 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:23.412537 21343 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:23.414425 21558 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:23.387718 21737 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.414937 17364 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.011s	sys 0.050s
I20260709 12:11:23.416018 17285 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:23.416254 21731 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:23.416054 21730 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:23.386945 21646 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.357288 21668 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.375099 21342 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.422520 18011 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:23.423229 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:23.424499 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:23.412544 21727 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.432925 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:23.443554 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 91912.6us
W20260709 12:11:23.447126 17364 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.012s	sys 0.051s
I20260709 12:11:23.462112 17332 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:23.428162 21731 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.420238 21532 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.421921 21646 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.480027 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.482826 17290 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:11:23.489014 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.428407 21732 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:11:23.429626 21730 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:11:23.483436 17285 pending_rounds.cc:85] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 5
W20260709 12:11:23.511404 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49410.7us
I20260709 12:11:23.511808 17285 pending_rounds.cc:107] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:11:23.512091 17285 raft_consensus.cc:2889] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:23.421823 21737 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.514283 21737 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:23.515975 21737 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:23.527422 18010 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:23.474732 21742 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:23.555181 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 1.6874e+06us
I20260709 12:11:23.557621 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:23.558318 17358 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:23.554276 17332 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:23.563556 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:23.566584 17358 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:11:23.676231 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.484443 21738 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
W20260709 12:11:23.677402 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.560940 21752 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:23.510221 21731 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 12:11:23.712291 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.710815 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 1946) took 1420 ms. Trace:
I20260709 12:11:23.570828 21746 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.111s
I20260709 12:11:23.726764 17364 rpcz_store.cc:276] 0709 12:11:22.290125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.291396 (+  1271us) service_pool.cc:224] Handling call
0709 12:11:22.291716 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.291930 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:23.452211 (+1160281us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.709307 (+257096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:23.710480 (+  1173us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:23.710539 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.710615 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.710748 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1662,"prepare.queue_time_us":203432,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":1322706,"threads_started":2,"wal-append.queue_time_us":134331}
I20260709 12:11:23.725032 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:23.675894 21742 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:23.724462 21741 log.cc:927] Time spent T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 12:11:23.755887 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 324644us
I20260709 12:11:23.756659 17358 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:23.763298 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:23.763554 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 196275us
I20260709 12:11:23.722500 21342 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:23.710093 21754 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.755460 21742 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:23.786958 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.791867 17360 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:23.792690 17364 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.795193 17286 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:23.796486 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:23.767061 21668 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:23.762318 21748 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:23.777871 21423 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:23.790972 21743 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:23.784025 21627 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:23.791035 21645 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.809929 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 46843.7us
I20260709 12:11:23.808449 21627 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.813284 21627 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:23.814779 21744 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:11:23.818558 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 2.10035e+06us
I20260709 12:11:23.819224 21646 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:23.819404 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:23.820706 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:23.820559 21645 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:23.822480 21740 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:11:23.822882 21645 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:23.823876 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:23.824302 21739 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:11:23.824945 21742 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.803552 21748 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.826381 21748 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.798784 21754 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:23.807320 21423 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.827792 21754 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:23.847648 17333 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:23.826023 21742 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.849124 21727 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:23.809180 21342 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:23.829743 21749 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:23.868971 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:23.869760 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 406874us
I20260709 12:11:23.872558 21752 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:23.990952 21749 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:23.991446 21752 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:23.995184 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:23.996313 21750 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:23.996820 21750 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:23.997030 17365 pending_rounds.cc:85] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:11:23.997356 17365 pending_rounds.cc:107] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:23.997579 17365 raft_consensus.cc:2889] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:23.998466 21750 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:23.998982 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:23.999570 17367 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.817976 21733 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:23.869225 21756 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.886444 17359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3673757d03f243668794c10285c7d1ff"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
W20260709 12:11:23.887533 21745 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:11:23.870312 21746 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.867540 21762 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.913616 21747 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
W20260709 12:11:23.928542 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.896601 21725 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:23.929606 21765 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.960429 21532 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:23.968142 21748 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:11:23.979331 21751 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
W20260709 12:11:23.989399 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 120524us
I20260709 12:11:24.013511 17333 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:23.989723 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.990410 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:24.005950 17359 raft_consensus.cc:606] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:23.988106 21342 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.010392 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:24.014587 17363 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.020092 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:24.006368 21733 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.006592 21646 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.018875 17361 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:24.027253 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:24.028003 17363 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:24.038522 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:24.040910 17255 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:24.048646 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37206 (request call id 33) took 1004 ms. Trace:
I20260709 12:11:24.054423 17367 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:24.053874 17359 rpcz_store.cc:276] 0709 12:11:23.033609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.886230 (+852621us) service_pool.cc:224] Handling call
0709 12:11:24.037644 (+151414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.038597 21646 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:24.039992 21532 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.046424 21763 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:24.012889 21725 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.061951 21763 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:24.062357 21763 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:24.063284 21763 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.064591 21763 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.064983 21748 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.066967 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:24.068006 21733 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.069180 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:24.069623 17363 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.070709 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:24.071421 17284 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.048542 21771 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.049160 21729 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.009372 21746 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.040150 21742 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:11:24.009490 21762 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.059204 21756 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:24.058002 21726 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:24.068508 21733 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:24.060227 21646 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.083437 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.013207 21765 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.087338 21765 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.087437 21343 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.088055 21343 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.089102 21729 raft_consensus.cc:697] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:24.089609 21746 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.090255 21729 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.091595 21342 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.092103 17358 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:24.092270 21771 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:24.093573 21762 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.093307 21771 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.099617 17284 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:24.100458 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:24.100633 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:24.103129 17363 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:24.072014 21532 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:24.104174 17332 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:24.111968 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:24.112668 17292 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:24.112859 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:24.113871 21762 raft_consensus.cc:2804] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:24.114405 21762 raft_consensus.cc:697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:24.115399 21762 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:24.121603 17332 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:24.077284 21756 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:24.129616 21697 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.127357 21756 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:24.104590 21726 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.129226 21733 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.128108 21342 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:24.140084 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 101675us
I20260709 12:11:24.145432 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.127420 21749 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:24.142261 21697 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.152513 21697 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:24.154978 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:24.154784 21532 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.156016 21763 raft_consensus.cc:993] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:24.156205 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.156647 21763 raft_consensus.cc:1081] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:24.157514 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.142331 21342 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:24.158490 17362 raft_consensus.cc:2410] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:24.154657 21785 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.159283 17363 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:24.160859 17285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3673757d03f243668794c10285c7d1ff"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:11:24.165918 17285 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:24.166308 17285 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.168821 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.176863 21726 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.179378 21423 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.164633 21342 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.183462 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:24.186841 17360 raft_consensus.cc:2410] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:24.176106 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.174733 17285 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.192019 21725 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.195963 21759 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:24.196447 21759 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:24.197330 21759 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.170984 21785 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.198767 17288 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:24.213096 21646 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.227201 17285 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:24.217133 17407 connection.cc:256] RPC call timeout handler was delayed by -1.3332722819998253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 12:11:24.227763 17407 connection.cc:256] RPC call timeout handler was delayed by -1.2865729139998621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 12:11:24.262603 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:24.263268 18006 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.265195 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:24.268416 17432 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:24.265924 17438 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.270243 18008 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEARNER]: Advancing to term 13
I20260709 12:11:24.283911 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.284863 17365 raft_consensus.cc:2410] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:24.285004 21785 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:24.271333 21759 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.288383 21343 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.291114 17360 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:11:24.291883 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.300127 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.300815 17366 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:24.305270 18006 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:24.306430 17366 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:24.285967 17365 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:24.310839 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.313252 17362 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:24.311949 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:24.314160 17439 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:24.316532 17438 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:24.320519 21485 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.321178 21485 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:24.323096 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.325367 21522 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.326233 21522 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.326949 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1885) took 1043 ms. Trace:
I20260709 12:11:24.327733 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:24.328470 21463 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.329159 21463 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:24.329656 21463 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.331413 21733 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.331974 21733 raft_consensus.cc:697] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:24.332703 21733 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.262197 21756 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.327349 17283 rpcz_store.cc:276] 0709 12:11:23.283201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.289796 (+  6595us) service_pool.cc:224] Handling call
0709 12:11:23.290248 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.290615 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.290646 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:24.166778 (+876132us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b2c000fc478. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:11:24.167171 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.302797 (+135626us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.302837 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.302920 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.326632 (+ 23712us) raft_consensus.cc:1685] finished
0709 12:11:24.326653 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.326887 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":8598,"spinlock_wait_cycles":5624192,"thread_start_us":135237,"threads_started":1,"wal-append.queue_time_us":157537}
I20260709 12:11:24.336134 21650 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:24.336385 21756 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:24.337291 21652 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:24.338132 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:24.337918 21652 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.338732 17436 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.338904 21643 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.352802 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:24.357057 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.353964 17438 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:24.352097 17367 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.354063 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:24.385286 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.386061 17284 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:24.388562 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.350361 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.389390 17366 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:24.389839 17292 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:24.383842 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:24.332032 21463 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:24.393209 17437 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.395731 17255 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:24.391350 17980 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:24.399252 17436 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:24.401199 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.393041 21343 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.404661 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.396087 21749 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.421083 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:24.422223 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:24.407925 21757 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.422986 17433 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:24.423511 17441 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:24.424096 21646 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:24.424237 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:24.424491 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:24.408052 21558 consensus_queue.cc:1059] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:24.425582 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:24.426350 21558 raft_consensus.cc:3055] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:24.426728 21558 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:24.404556 21342 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.395244 21485 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:24.429078 21342 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.430023 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:24.427655 21558 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.433010 21558 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.413807 21652 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:24.407444 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.413280 17364 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:24.497390 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:24.501585 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:24.502310 17285 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:24.503034 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 91864.1us
W20260709 12:11:24.515784 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.543841 17437 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:24.400784 21361 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.356274 21729 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:11:24.546293 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.552103 17364 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:24.553196 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:24.546434 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.383148 21643 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:24.552213 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 728328us
I20260709 12:11:24.555423 17364 raft_consensus.cc:2410] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:24.554405 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:24.556914 17433 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.558421 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:24.559190 17441 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:24.572119 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:24.572873 17364 raft_consensus.cc:3055] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:24.573173 17364 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:24.595522 17440 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:24.574162 17364 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.606209 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.607287 17360 raft_consensus.cc:2410] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:24.610611 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.651079 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.653138 17367 raft_consensus.cc:2410] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:11:24.654203 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.654762 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.656697 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.658747 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:24.659225 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:24.569196 21361 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:24.659967 18006 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:24.660729 21361 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.661228 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:24.661959 18010 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:24.662992 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:24.664366 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:24.648846 17285 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:24.668807 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:24.650347 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 243616us
I20260709 12:11:24.677733 17433 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
W20260709 12:11:24.679764 21779 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:11:24.690411 17978 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:24.595173 21343 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.699679 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:24.652330 21646 consensus_queue.cc:1059] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:11:24.706027 17332 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:24.714529 18007 raft_consensus.cc:2410] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:24.597563 21650 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.716676 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:24.716871 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:24.713551 21737 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:24.684621 21749 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:24.729326 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:24.735909 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 47203us
I20260709 12:11:24.741711 17283 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:24.744978 17333 connection.cc:256] RPC call timeout handler was delayed by -1.3797920189999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
I20260709 12:11:24.720409 21697 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:24.751421 21771 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:24.753427 21798 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.753996 21798 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.754408 21798 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.764192 17291 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:24.765033 21761 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.765312 21797 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:11:24.766256 21794 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:11:24.771273 21643 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:24.723275 21757 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:24.745596 21737 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:24.785772 17333 connection.cc:256] RPC call timeout handler was delayed by -1.183434084000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260709 12:11:24.786827 21737 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:24.788205 17333 connection.cc:256] RPC call timeout handler was delayed by -1.0586359050000738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 12:11:24.780457 21761 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.780323 21423 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:11:24.779367 21697 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:11:24.797919 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 58876.4us
W20260709 12:11:24.797991 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 50470.9us
I20260709 12:11:24.801355 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:24.785297 21342 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:24.798035 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:24.808333 17980 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:24.811458 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:24.813552 21668 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.807626 21757 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.814005 21668 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.814433 21668 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.819886 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.820822 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:24.825138 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.826768 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:24.830341 21817 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:24.830730 21800 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.831192 21817 consensus_queue.cc:1243] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:24.839002 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:24.818554 21763 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:24.794705 21749 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.834311 21343 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.858012 21668 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.859414 21761 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.860293 21668 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:24.844691 21763 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.861114 21725 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:24.851217 21697 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:24.861109 21763 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.906517 21798 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.909176 21798 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.909874 21732 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:24.910517 21732 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:24.912736 21732 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:24.916121 21733 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:24.916710 21733 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.919154 21733 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:24.923899 17364 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:24.945772 18036 debug-util.cc:398] Leaking SignalData structure 0x7b080027b840 after lost signal to thread 16128
I20260709 12:11:24.950611 21665 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:24.951269 21665 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:24.953315 21665 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:24.953822 21665 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.954449 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:24.963692 17285 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.962862 18036 debug-util.cc:398] Leaking SignalData structure 0x7b0800247500 after lost signal to thread 17224
W20260709 12:11:24.966070 18036 debug-util.cc:398] Leaking SignalData structure 0x7b0800246f40 after lost signal to thread 17316
W20260709 12:11:24.966599 18036 debug-util.cc:398] Leaking SignalData structure 0x7b0800246f20 after lost signal to thread 17317
W20260709 12:11:24.967842 18036 debug-util.cc:398] Leaking SignalData structure 0x7b0800340ce0 after lost signal to thread 17391
W20260709 12:11:24.968214 18036 debug-util.cc:398] Leaking SignalData structure 0x7b080039cac0 after lost signal to thread 17392
W20260709 12:11:24.969444 18036 debug-util.cc:398] Leaking SignalData structure 0x7b08001480a0 after lost signal to thread 17465
W20260709 12:11:24.969806 18036 debug-util.cc:398] Leaking SignalData structure 0x7b0800334920 after lost signal to thread 17466
W20260709 12:11:24.971170 18036 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6d00 after lost signal to thread 18039
W20260709 12:11:25.006263 18036 debug-util.cc:398] Leaking SignalData structure 0x7b080037f700 after lost signal to thread 18040
I20260709 12:11:25.006582 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:25.007079 18036 debug-util.cc:398] Leaking SignalData structure 0x7b0800129ee0 after lost signal to thread 21639
I20260709 12:11:25.007843 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:24.984617 18012 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.984632 21831 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:24.990058 17284 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:25.022090 21652 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.021950 21831 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.034775 21763 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.037225 21763 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:25.002950 18013 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:25.004997 17285 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
W20260709 12:11:25.005702 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 208141us
I20260709 12:11:25.015825 21522 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.006047 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.014590 18015 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:25.010996 21450 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:25.016602 17439 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:25.015782 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 594712us
I20260709 12:11:25.020692 17436 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:24.994110 21731 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:25.023415 18014 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:25.025120 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.026815 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.015307 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.036952 21785 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:24.986215 17364 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:25.039609 17980 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:25.038537 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:25.014189 21640 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.044672 21757 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:25.046262 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.047030 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:25.045404 21522 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.047824 21757 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.049015 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:25.047885 21365 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.050199 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:25.050385 21365 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:25.050902 21762 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.051301 21365 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.051808 21785 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.051216 21757 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:25.053406 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.047529 21640 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.054690 21762 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.056419 21640 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:25.056605 21763 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.044036 18014 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:25.057075 21763 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:25.056265 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:25.058349 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.060982 18006 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:25.057796 18014 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.067523 21762 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.068532 18014 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.057714 21763 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.049860 21522 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:25.071343 17436 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:25.072938 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.077606 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:25.043601 21818 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.084362 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:25.085158 21750 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:25.086300 21727 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:25.092146 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.093585 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.095016 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.095877 17364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:25.096565 17364 raft_consensus.cc:606] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:11:25.096609 17292 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.097052 17364 raft_consensus.cc:614] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:25.098457 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.103374 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.104107 21646 consensus_queue.cc:1059] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:25.103531 17364 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:25.104671 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.105584 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.105225 18006 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.109195 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.110695 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.111399 17441 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:25.111785 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.112237 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.112494 17364 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:25.112851 17441 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:25.110787 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.115944 17255 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:25.117208 17437 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.112443 17436 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
I20260709 12:11:25.113933 17441 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:25.123696 18014 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:25.115059 17439 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:25.107126 21697 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.059059 21731 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.125993 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.053702 21755 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:25.001220 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 162242us
I20260709 12:11:25.047463 21831 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:25.109061 21769 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:11:25.134541 18006 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:25.139269 17437 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.119536 17441 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:25.125152 21727 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:11:25.143348 18007 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEARNER]: Advancing to term 14
I20260709 12:11:25.059660 21450 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.131948 21757 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:25.175595 17441 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:25.179167 17441 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.155918 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.159096 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.130544 21729 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:11:25.168428 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:25.169641 21755 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:25.169538 21812 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:25.196272 17364 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:25.204828 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.218814 17433 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
W20260709 12:11:25.220937 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.224311 17441 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:25.212131 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:25.227439 17437 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:25.230419 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.231392 18011 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.231784 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:25.231925 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.235519 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:25.236284 17367 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.242555 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.243498 17365 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:25.262002 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.262874 17437 raft_consensus.cc:2376] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14. Re-sending same reply.
I20260709 12:11:25.202428 21757 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:25.265785 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.271322 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.271849 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.272567 17364 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
W20260709 12:11:25.279531 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.271978 17437 raft_consensus.cc:2376] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10. Re-sending same reply.
I20260709 12:11:25.225731 21759 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:25.231822 21697 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:25.231276 21558 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.299295 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.305938 17437 raft_consensus.cc:2376] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9. Re-sending same reply.
I20260709 12:11:25.307447 17437 raft_consensus.cc:3055] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.307806 17437 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:25.301306 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.304071 17361 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:25.303931 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:25.316185 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.305334 21697 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.336665 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.308521 17437 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:25.338336 17437 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.297055 21785 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:25.334625 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.349318 17439 raft_consensus.cc:2410] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:25.311664 17367 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:25.334633 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.335268 17292 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:25.347740 17437 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:25.352160 21798 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.327332 21737 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.359628 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.366400 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.367185 17439 raft_consensus.cc:3055] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:25.367961 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.368685 17360 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:25.370602 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.367631 17439 raft_consensus.cc:740] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:25.373973 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 200649us
W20260709 12:11:25.354439 21839 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.210s	user 0.001s	sys 0.002s
I20260709 12:11:25.391093 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:25.313620 21759 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:25.349546 21697 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:25.397485 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.372452 17439 consensus_queue.cc:260] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:25.406900 17439 raft_consensus.cc:3060] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.402562 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.408530 17362 raft_consensus.cc:2393] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:25.401463 17363 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:25.370837 21785 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:25.400733 21361 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.406401 21558 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.430873 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 127026us
I20260709 12:11:25.431771 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:25.389725 21737 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.402050 21808 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:25.395790 21757 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:25.450677 21365 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.466950 17362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:25.467656 17362 raft_consensus.cc:606] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:25.468040 17362 raft_consensus.cc:614] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:25.465811 18007 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:25.487846 21737 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:25.488948 21844 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:11:25.451257 21450 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:25.503430 21762 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.503954 21762 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:25.504802 21762 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.508226 21761 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.508760 21761 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:25.433706 21361 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.436406 21558 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.509675 21761 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.519441 21785 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:25.520364 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.506052 21762 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:25.523036 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 967332us
I20260709 12:11:25.549484 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:25.535027 17437 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:25.536242 21641 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.456442 21731 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:25.537093 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 494491us
I20260709 12:11:25.553086 17407 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:25.537464 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.537794 21652 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:25.538213 17981 leader_election.cc:336] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 1.548s (SENT)
I20260709 12:11:25.538118 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:25.539683 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1768) took 1229 ms. Trace:
I20260709 12:11:25.500267 21759 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:25.556245 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:25.545811 17439 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:11:25.555089 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.558828 17437 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.557647 17407 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:25.558348 17439 pending_rounds.cc:85] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 8
I20260709 12:11:25.569128 17439 pending_rounds.cc:107] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:11:25.569486 17439 raft_consensus.cc:2889] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:25.560390 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 142894us
I20260709 12:11:25.569486 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.570585 17441 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 10: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:25.558111 17435 rpcz_store.cc:276] 0709 12:11:24.310529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.310653 (+   124us) service_pool.cc:224] Handling call
0709 12:11:24.310983 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.290432 (+979449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.290462 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.290942 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.476451 (+185509us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:25.499618 (+ 23167us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.539269 (+ 39651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.539406 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.539456 (+    50us) raft_consensus.cc:1685] finished
0709 12:11:25.539471 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.539623 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1243802,"prepare.queue_time_us":23190,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":742908,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":6396,"thread_start_us":453551,"threads_started":2,"wal-append.queue_time_us":219020}
I20260709 12:11:25.571409 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.571491 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.572558 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.576288 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.556418 21640 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:25.560176 21643 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.587613 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.577766 21761 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.578377 21485 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.580111 17441 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:25.569199 21812 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.556286 21641 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:25.592538 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 160800us
W20260709 12:11:25.582052 21763 consensus_meta.cc:287] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.004s
I20260709 12:11:25.596939 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.601073 17439 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:25.581020 21640 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:25.603256 17441 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.573037 21650 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:25.598733 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:25.607534 17437 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:25.575567 21652 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.579819 21365 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:25.596001 21485 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:25.678797 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 80155.7us
I20260709 12:11:25.594730 21840 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:25.679049 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 69283.9us
W20260709 12:11:25.672691 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47023.3us
W20260709 12:11:25.727504 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 169870us
I20260709 12:11:25.595779 21643 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:25.608777 17437 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.730801 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:25.608450 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.714601 21733 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:11:25.730289 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.617897 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1767) took 1346 ms. Trace:
I20260709 12:11:25.734498 18006 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:25.719923 21485 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.732816 17439 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:25.735205 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.736351 18007 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:25.736552 17255 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:25.606988 21640 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:25.719146 21755 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.748006 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:25.673588 21823 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.819s	user 0.000s	sys 0.005s
I20260709 12:11:25.748449 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.739471 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.748811 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:25.747676 17255 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:25.739488 21774 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.739759 21463 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:25.734592 17434 rpcz_store.cc:276] 0709 12:11:24.271652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.310221 (+ 38569us) service_pool.cc:224] Handling call
0709 12:11:24.313429 (+  3208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.327522 (+1014093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.327557 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.332230 (+  4673us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.547143 (+214913us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:25.547185 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.547256 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.617609 (+ 70353us) raft_consensus.cc:1685] finished
0709 12:11:25.617632 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.617816 (+   184us) inbound_call.cc:177] Queueing success response
0709 12:11:25.726703 (+108887us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4800160158. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
Metrics: {"mutex_wait_us":695034,"raft.queue_time_us":701944,"raft.run_cpu_time_us":3266,"raft.run_wall_time_us":708222,"spinlock_wait_cycles":6672768,"thread_start_us":466667,"threads_started":2,"wal-append.queue_time_us":236129}
I20260709 12:11:25.747596 17439 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:25.720996 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:25.683072 21831 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:25.736788 17435 raft_consensus.cc:2376] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13. Re-sending same reply.
I20260709 12:11:25.720469 21361 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:25.710599 21757 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:25.731273 21652 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:25.754163 21665 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:25.756486 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.736374 21840 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:25.757947 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:25.759992 21842 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.428s	user 0.001s	sys 0.002s
I20260709 12:11:25.749698 21774 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.749657 21868 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:25.762626 21760 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:25.763612 21450 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:25.765692 17285 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:25.733805 21697 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.675693 21522 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:11:25.757277 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.770337 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.602133 21763 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.772214 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.769543 21665 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.774086 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.781827 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.799003 17435 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:25.800032 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.783157 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:25.752342 21831 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.784386 21807 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:25.767753 21518 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:25.785964 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1766) took 1515 ms. Trace:
I20260709 12:11:25.786535 21641 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:25.787537 21485 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:25.767983 21818 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:25.789615 17434 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:25.791517 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:25.780754 21802 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:25.792572 21361 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:25.793498 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.795285 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:25.751921 21729 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.779873 21774 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.808560 21819 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.800720 17435 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
W20260709 12:11:25.859345 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 64146.6us
I20260709 12:11:25.860193 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.860913 21873 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.820047 21518 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:25.804840 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:25.862727 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 58014.1us
I20260709 12:11:25.863272 21485 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:25.863889 21807 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.864311 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:25.864624 21807 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:25.769009 21749 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:11:25.873076 21835 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.806550 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.859151 21640 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.874688 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.875821 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.876398 17437 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
W20260709 12:11:25.876819 21866 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:11:25.807824 18007 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 15: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:25.799338 21665 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:25.879498 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:25.863291 21763 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:25.871079 21558 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:25.887377 21840 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.891589 21841 raft_consensus.cc:3055] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:25.892063 21841 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:25.892913 21841 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.869781 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.895296 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.895656 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.895928 17435 raft_consensus.cc:2376] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10. Re-sending same reply.
I20260709 12:11:25.896775 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.897270 17435 raft_consensus.cc:2376] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8. Re-sending same reply.
I20260709 12:11:25.808336 17432 rpcz_store.cc:276] 0709 12:11:24.270526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.270657 (+   131us) service_pool.cc:224] Handling call
0709 12:11:24.271036 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:25.538507 (+1267471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.538537 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:25.539191 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 12:11:25.589842 (+ 50651us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:25.607035 (+ 17193us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.624474 (+ 17439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.624554 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.785719 (+161165us) raft_consensus.cc:1685] finished
0709 12:11:25.785740 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.785899 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1419275,"prepare.queue_time_us":16918,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":1320211,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":4035,"thread_start_us":50211,"threads_started":1,"wal-append.queue_time_us":176662}
I20260709 12:11:25.779529 21750 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:25.821144 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:25.824479 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.840026 21818 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:25.843093 21748 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.827080 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.843082 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:25.844322 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 468958us
I20260709 12:11:25.905659 17436 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:25.907024 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:25.845134 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 454090us
I20260709 12:11:25.832981 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1773) took 1445 ms. Trace:
I20260709 12:11:25.908314 17333 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:25.832319 21697 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:25.825611 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1904) took 1071 ms. Trace:
W20260709 12:11:25.841387 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.912810 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:25.913552 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.916211 17359 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:11:25.920297 17434 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
W20260709 12:11:25.848433 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 296774us
I20260709 12:11:25.806120 21831 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.860446 17407 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:25.868486 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:25.924803 17362 raft_consensus.cc:2410] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:25.870637 17358 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.871003 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.871742 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:25.925500 17367 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.926133 17365 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:25.931077 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.877038 21640 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:25.877143 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.898078 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.900902 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.900851 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:25.936735 17437 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:25.937727 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.861644 21873 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:25.905732 17433 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:25.907862 17438 rpcz_store.cc:276] 0709 12:11:24.387548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.387726 (+   178us) service_pool.cc:224] Handling call
0709 12:11:24.388121 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.015223 (+627102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.015260 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.022352 (+  7092us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.166591 (+144239us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:25.759375 (+592784us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:25.766004 (+  6629us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b1800407a40. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12256c34bc 00007f1222a1148b 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2b455 00007f12295133c7 00007f1225b259a7 00007f1225b350bf
0709 12:11:25.766159 (+   155us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.766355 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.766432 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.832742 (+ 66310us) raft_consensus.cc:1685] finished
0709 12:11:25.832764 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.832919 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1131444,"prepare.queue_time_us":100645,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":626538,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":2549,"spinlock_wait_cycles":90516480,"thread_start_us":222415,"threads_started":2,"wal-append.queue_time_us":228366}
I20260709 12:11:25.911638 17283 rpcz_store.cc:276] 0709 12:11:24.754044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.758249 (+  4205us) service_pool.cc:224] Handling call
0709 12:11:24.758842 (+   593us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:24.770854 (+ 12012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.770888 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:24.771505 (+   617us) log.cc:844] Serialized 52 byte log entry
0709 12:11:24.822904 (+ 51399us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:24.822945 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.823092 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.659733 (+836641us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:25.819608 (+159875us) raft_consensus.cc:1685] finished
0709 12:11:25.819629 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.825535 (+  5906us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14320,"raft.queue_time_us":20823,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3022,"spinlock_wait_cycles":39797632,"thread_start_us":50930,"threads_started":1,"wal-append.queue_time_us":79336}
I20260709 12:11:25.825402 21450 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:25.921145 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:25.920351 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:25.923087 21756 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:25.943593 21798 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.003s
I20260709 12:11:25.900662 21841 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.934196 17367 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:25.934543 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:25.797983 21643 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.938531 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:25.970533 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:25.939237 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 78859.9us
I20260709 12:11:25.940546 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:25.915104 21761 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.948283 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:25.948887 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.915961 21737 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:25.949760 17438 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.987789 17981 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:25.954015 17359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:25.944962 21641 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.940008 21697 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.928901 21807 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.932256 21763 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.931977 17436 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:25.915512 21748 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:25.973390 21365 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.974829 21361 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.977187 21765 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.980669 17407 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:25.946287 21450 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:25.988906 17359 raft_consensus.cc:606] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:25.962023 21640 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.999343 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:26.000192 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.018196 17438 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:25.990448 21761 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:26.028193 17406 connection.cc:256] RPC call timeout handler was delayed by -3.0051273660001243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:11:25.995609 21858 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:26.032601 21665 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:26.033562 21450 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:26.034998 21450 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.035526 21665 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:25.996690 21668 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:11:25.967705 21756 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:26.018275 21765 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:26.020900 21640 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:26.041627 21640 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.038196 21818 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:26.026422 21859 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.041559 17439 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:25.991987 21874 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.040135 17359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:26.050045 17359 raft_consensus.cc:606] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:26.050458 17359 raft_consensus.cc:614] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:25.968218 21798 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.048511 21761 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.029881 21641 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.032812 21748 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:26.082597 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:26.047957 21765 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.077827 17440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51598
I20260709 12:11:26.086527 17440 raft_consensus.cc:606] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Received request to transfer leadership
I20260709 12:11:26.086869 17440 raft_consensus.cc:614] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:26.153539 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 209311us
I20260709 12:11:26.015443 21807 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:26.084233 21756 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:26.075919 21796 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 12:11:26.187693 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 275792us
W20260709 12:11:26.197499 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.214478 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 284361us
I20260709 12:11:26.219508 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:26.220435 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 221154us
I20260709 12:11:26.227458 17981 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:26.243139 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 227005us
I20260709 12:11:26.248127 17359 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:26.248126 17981 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:26.254664 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:26.261545 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:26.265455 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:26.274942 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 354627us
I20260709 12:11:26.275944 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:26.255904 21812 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:26.296530 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:26.298328 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:26.301568 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:26.308311 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:26.270201 21365 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.273319 21813 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.321069 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:26.299129 21812 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.298409 21858 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.304450 21748 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:26.307204 21532 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.304656 21880 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.330318 21879 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.339241 21812 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.316108 21365 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:26.336798 21759 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.313946 21737 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:11:26.317924 21762 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:26.366657 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:26.368027 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.374512 21365 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.413934 17435 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:26.421995 17407 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:26.422941 21641 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:26.429117 21640 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:26.436723 21765 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:26.448330 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.369553 17333 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:26.370631 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:26.449422 18009 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 15: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:26.358042 21756 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:26.450333 21756 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:26.450780 21763 raft_consensus.cc:2764] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:11:26.451282 21756 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:26.449622 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 80155.2us
I20260709 12:11:26.452993 17333 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:26.355815 21748 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:26.360190 21880 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:26.360294 21532 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.332170 21802 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:26.448619 21518 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:26.453716 21763 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:26.454888 21763 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:26.455310 21880 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.455899 17333 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:26.456779 21646 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.457753 21763 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:26.458966 21759 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:26.459774 21748 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:26.464975 21765 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:26.437240 21774 consensus_meta.cc:287] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.006s
I20260709 12:11:26.471120 17291 raft_consensus.cc:1240] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:26.446832 21878 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.149s	user 0.005s	sys 0.000s
I20260709 12:11:26.447304 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.447674 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.505913 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.453578 17363 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:26.509529 21755 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:26.368321 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 95375.8us
I20260709 12:11:26.387151 21807 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:26.466475 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:26.470513 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.469844 17284 raft_consensus.cc:1217] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[6.5-9.6]   Dedup: 9.6->[]
I20260709 12:11:26.530385 17284 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: [6.5-9.6]
W20260709 12:11:26.474133 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.501431 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.503015 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.505127 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.454156 21532 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.461874 21365 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:26.507575 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:26.534801 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 68394.5us
I20260709 12:11:26.536525 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.441752 21831 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:26.542510 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.507483 21737 consensus_queue.cc:1243] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer e860f7e876b74ec589f447737822a4f6 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:26.507277 21806 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:26.556264 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:26.556790 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.559733 18008 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:26.454070 21761 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:26.537914 21646 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.566455 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:26.628810 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:26.697641 17289 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:26.640697 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:26.508180 21774 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:26.639835 21807 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:26.722478 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:26.786580 17288 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.780803 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:26.785086 18009 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:26.788722 17292 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.794055 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.795012 17287 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:26.803299 17292 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:26.803911 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.804878 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.805106 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:26.796900 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 477847us
I20260709 12:11:26.813510 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.815477 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:26.817926 17284 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:26.819155 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:26.789486 21879 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.858781 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:26.859670 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:26.798331 21894 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:26.868556 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 53137.9us
W20260709 12:11:26.891103 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.801121 21807 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.230955 21807 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:26.567603 21806 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:26.867910 21879 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.025753 21640 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:26.874152 21894 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:26.870992 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:26.825548 21802 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.123944 17288 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
W20260709 12:11:27.121867 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.128428 21761 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:26.873910 21819 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.175s
I20260709 12:11:26.822470 21732 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.158s
I20260709 12:11:27.325008 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.326610 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.327287 17441 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:26.872278 21796 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:27.134897 21532 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.001s
W20260709 12:11:27.156031 21748 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.000s
I20260709 12:11:26.870370 21905 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.564483 21882 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.487s
I20260709 12:11:27.231614 17286 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:27.298445 17436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.027s	sys 0.065s
I20260709 12:11:27.299751 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 817) took 1358 ms. Trace:
W20260709 12:11:27.338745 17436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.027s	sys 0.065s
W20260709 12:11:27.304080 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.338824 17439 rpcz_store.cc:276] 0709 12:11:25.868207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.895422 (+ 27215us) service_pool.cc:224] Handling call
0709 12:11:27.166747 (+1271325us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400115154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:27.226839 (+ 60092us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333614464}
I20260709 12:11:27.301614 21558 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.306396 21906 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:27.297153 21755 consensus_meta.cc:287] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.787s	user 0.014s	sys 0.002s
W20260709 12:11:27.301932 21902 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.429s	user 0.000s	sys 0.014s
W20260709 12:11:27.302314 21912 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.144s	user 0.003s	sys 0.003s
I20260709 12:11:27.336827 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.340838 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.368719 17441 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:27.312144 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1797) took 1093 ms. Trace:
I20260709 12:11:27.231050 21665 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.351292 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1795) took 1561 ms. Trace:
I20260709 12:11:27.314170 21737 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.379141 21813 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.379433 21737 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.379741 21813 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.381098 21342 consensus_queue.cc:1059] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:27.381830 21737 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.382392 21737 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:27.382769 21737 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:27.355016 21558 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.383656 21737 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.378750 17437 rpcz_store.cc:276] 0709 12:11:25.790421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.950413 (+159992us) service_pool.cc:224] Handling call
0709 12:11:26.005482 (+ 55069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.005779 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.005805 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:26.005845 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:26.005879 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.005934 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.351088 (+1345154us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b5400161050. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:27.351224 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":399,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5451,"spinlock_wait_cycles":125900544}
I20260709 12:11:27.355806 17433 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:27.387553 17433 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:27.388356 17433 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.389245 17433 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.369619 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:27.372330 21759 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:27.383248 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 886) took 1126 ms. Trace:
W20260709 12:11:27.385310 21909 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.598s	user 0.002s	sys 0.008s
I20260709 12:11:27.386013 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1800) took 1159 ms. Trace:
I20260709 12:11:27.398885 17438 rpcz_store.cc:276] 0709 12:11:26.226775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.228807 (+  2032us) service_pool.cc:224] Handling call
0709 12:11:26.229169 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.252046 (+ 22877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.252076 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.256575 (+  4499us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.431762 (+175187us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b4800160158. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:11:26.724215 (+292453us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:26.811102 (+ 86887us) log.cc:844] Serialized 14 byte log entry
0709 12:11:26.823162 (+ 12060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.823247 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.385663 (+562416us) raft_consensus.cc:1685] finished
0709 12:11:27.385769 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.385950 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":439858,"prepare.queue_time_us":591156,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":66853,"raft.run_cpu_time_us":2146,"raft.run_wall_time_us":188683,"spinlock_wait_cycles":19441024,"thread_start_us":387644,"threads_started":1,"wal-append.queue_time_us":1074598}
I20260709 12:11:27.401124 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:27.387082 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.390832 17289 rpcz_store.cc:276] 0709 12:11:26.256428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.256777 (+   349us) service_pool.cc:224] Handling call
0709 12:11:26.279045 (+ 22268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.791612 (+512567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.383016 (+591404us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b540020eed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:27.383186 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962123520}
I20260709 12:11:27.338449 21831 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.404577 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 821) took 1037 ms. Trace:
I20260709 12:11:27.339080 21365 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.369220 17440 rpcz_store.cc:276] 0709 12:11:26.219190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.219320 (+   130us) service_pool.cc:224] Handling call
0709 12:11:26.219614 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.224112 (+  4498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.224145 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.254287 (+ 30142us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.395833 (+141546us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:26.533731 (+137898us) log.cc:844] Serialized 14 byte log entry
0709 12:11:26.534269 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.534340 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.311857 (+777517us) raft_consensus.cc:1685] finished
0709 12:11:27.311882 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.312065 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163194,"prepare.queue_time_us":129832,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":4371,"raft.queue_time_us":20194,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":20838,"spinlock_wait_cycles":1280,"thread_start_us":116364,"threads_started":1,"wal-append.queue_time_us":869358}
I20260709 12:11:27.397271 17286 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:27.402607 17437 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
W20260709 12:11:27.357318 21840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.342s	user 0.000s	sys 0.036s
I20260709 12:11:27.339341 21532 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.405916 17441 rpcz_store.cc:276] 0709 12:11:26.367373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.403753 (+1036380us) service_pool.cc:224] Handling call
0709 12:11:27.404091 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.404265 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.404290 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:27.404329 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:27.404361 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.404413 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.404518 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:27.404358 17433 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:27.414800 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1786) took 1632 ms. Trace:
W20260709 12:11:27.411787 21840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.397s	user 0.000s	sys 0.037s
I20260709 12:11:27.340735 21748 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.336971 21796 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.415176 17433 rpcz_store.cc:276] 0709 12:11:25.782397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.949362 (+166965us) service_pool.cc:224] Handling call
0709 12:11:25.949633 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.355718 (+1406085us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54002b1220. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225a92dc0 00007f1225b1d1c0 00007f1225b1e231 00007f1225b1ad8f 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c
0709 12:11:27.414551 (+ 58833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.414745 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239628160}
I20260709 12:11:27.378767 21665 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.425488 17437 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:27.426016 17437 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:27.425490 17440 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:27.426882 17437 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.427945 17437 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.412642 21859 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.344360 21905 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:27.419422 21869 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:11:27.429394 21880 consensus_meta.cc:287] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.974s	user 0.002s	sys 0.018s
I20260709 12:11:27.443127 17438 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:27.447988 21859 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.451018 21880 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.406234 21759 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.360215 21906 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.453564 21880 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.459092 21748 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.461306 21879 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.447568 21646 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.463404 21646 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.465389 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 2008) took 1549 ms. Trace:
I20260709 12:11:27.465857 17365 rpcz_store.cc:276] 0709 12:11:25.915672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.947463 (+ 31791us) service_pool.cc:224] Handling call
0709 12:11:25.958883 (+ 11420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.255066 (+296183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.255099 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.267419 (+ 12320us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.561596 (+294177us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:26.561635 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.561702 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.379567 (+817865us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b2c0003b498. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1223dcb291 00007f1223de60ca 00007f1225b144ad 00007f1225b1bf8e 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:11:27.384739 (+  5172us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:27.465112 (+ 80373us) raft_consensus.cc:1685] finished
0709 12:11:27.465137 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.465314 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17728,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":146427136,"thread_start_us":527333,"threads_started":2,"wal-append.queue_time_us":318754}
I20260709 12:11:27.426599 21882 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.498657 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:27.514767 17367 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.509871 17437 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:27.531126 17366 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.541163 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:27.500013 21879 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.547457 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:27.556789 21812 consensus_meta.cc:287] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.167s	user 0.018s	sys 0.018s
I20260709 12:11:27.556965 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1803) took 1325 ms. Trace:
I20260709 12:11:27.557269 21812 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.557327 17438 rpcz_store.cc:276] 0709 12:11:26.231949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.406994 (+1175045us) service_pool.cc:224] Handling call
0709 12:11:27.407237 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.448734 (+ 41497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.556690 (+107956us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b540006d954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:27.556889 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81467136}
I20260709 12:11:27.559404 21859 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:27.561360 21906 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:27.563356 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:27.569120 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 254445us
I20260709 12:11:27.553395 21774 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.498533 21882 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.571142 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:27.554183 21879 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:27.581323 17978 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.66:35675 timed out after 1.829s (SENT) [suppressed 37 similar messages]
I20260709 12:11:27.581360 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.582868 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:27.583906 17366 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:27.584681 17363 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 12:11:27.586128 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.585569 17363 pending_rounds.cc:85] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 10
I20260709 12:11:27.586932 17363 pending_rounds.cc:107] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 12:11:27.587175 17363 raft_consensus.cc:2889] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.585309 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:27.578408 21796 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:27.588259 17367 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 14: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:27.574781 21748 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:27.591408 17364 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:27.591714 17364 pending_rounds.cc:85] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:11:27.591845 17364 pending_rounds.cc:107] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:27.591984 17364 raft_consensus.cc:2889] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.590359 17362 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:27.574167 21894 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.573436 21532 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.583835 21905 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.579243 21835 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:11:27.602581 21665 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:27.603336 21748 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:27.604307 21748 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.606933 17184 catalog_manager.cc:5697] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 7 to 11, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 11 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:27.609018 17184 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:27.573962 21923 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:11:27.610292 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:27.626799 21558 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:27.619094 21894 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.629439 21894 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:27.630578 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 472750us
W20260709 12:11:27.632158 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 761166us
I20260709 12:11:27.632956 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:27.619341 21646 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.634157 21802 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.635908 21808 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:27.636439 21808 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.639288 21774 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:27.639863 21774 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.631795 21894 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.639187 21879 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.646121 17284 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:27.647657 21774 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.647835 21765 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.641103 21760 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:27.650691 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 69401.1us
I20260709 12:11:27.658073 21808 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.658381 21906 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:27.655498 21760 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.660785 21906 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:27.641358 21737 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.640398 21904 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.656313 21905 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.661128 21760 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.680390 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:27.648355 21765 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.663576 21558 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:27.687604 21759 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.691303 21785 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.685161 21749 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:11:27.691902 21785 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.693356 21806 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.697952 21737 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.698649 21737 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.684711 21760 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:27.695904 21883 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.330s	user 0.009s	sys 0.004s
I20260709 12:11:27.700278 21342 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.706959 21342 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.700634 21785 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.709371 21342 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.680264 21904 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.715276 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.724852 17362 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 11: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:27.725606 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:27.726828 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 64732us
I20260709 12:11:27.717829 17367 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.718142 17363 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:27.731328 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:27.745095 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:27.748243 18011 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:27.750497 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:27.732810 21899 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:27.753997 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:27.754703 17283 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:27.759276 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:27.735659 21808 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:27.735983 21903 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.733692 21882 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.736285 21558 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.768638 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:27.741664 21668 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.767239 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:27.770416 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:27.768931 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.777323 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:27.780114 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:27.780779 18009 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:27.782850 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:27.756114 21737 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.757736 21899 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.770401 21802 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.798374 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:27.799296 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:27.804104 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:27.799880 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1947) took 1249 ms. Trace:
I20260709 12:11:27.800280 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.806492 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.801198 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1801) took 1571 ms. Trace:
I20260709 12:11:27.806684 17365 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:27.806445 17440 rpcz_store.cc:276] 0709 12:11:26.550584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.416946 (+866362us) service_pool.cc:224] Handling call
0709 12:11:27.417237 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.431004 (+ 13767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.799609 (+368605us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b54000ff354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:27.799792 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15390080}
W20260709 12:11:27.807668 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.809333 17440 pending_rounds.cc:85] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 4
I20260709 12:11:27.804827 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:27.809576 17434 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:27.809602 17440 pending_rounds.cc:107] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:27.811779 17440 raft_consensus.cc:2889] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.811360 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1802) took 1580 ms. Trace:
I20260709 12:11:27.807312 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.814543 17437 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:27.815295 17433 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:27.812388 17436 rpcz_store.cc:276] 0709 12:11:26.231200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.504158 (+272958us) service_pool.cc:224] Handling call
0709 12:11:26.504517 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.504761 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:26.678340 (+173579us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.811041 (+1132701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:27.811091 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:27.811140 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.811196 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.811308 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":495840,"prepare.queue_time_us":283581,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4748,"thread_start_us":790980,"threads_started":2,"wal-append.queue_time_us":706971}
I20260709 12:11:27.816418 17438 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:27.790681 21899 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.821578 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:27.822324 17433 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.825398 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:27.781035 21668 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.839408 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.770375 21808 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.839893 17362 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.840559 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:27.839335 18008 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.846022 17434 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.842499 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.847261 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.847754 21813 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:27.848402 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.849424 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.850533 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.842986 17433 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:27.852135 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.849992 17437 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:27.854920 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.855563 17359 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:27.856412 17434 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:27.852141 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.776799 21558 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.816229 21640 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.770543 21903 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.819100 21840 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:27.818744 21748 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:27.866721 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:27.892339 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.894486 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:27.895684 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.898257 17434 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 11: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:27.898540 17433 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:27.898245 17437 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.819329 21876 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:27.826988 21665 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:27.904851 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:27.905581 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 54468.3us
I20260709 12:11:27.907220 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:27.907841 17362 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:27.905562 17434 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.827170 21885 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
W20260709 12:11:27.940703 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 74052.9us
I20260709 12:11:27.939150 21931 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.927083 17434 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:27.943670 21931 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.944689 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.945850 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.860998 21342 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
W20260709 12:11:27.967021 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.957093 17437 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:27.904168 21748 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.896265 21765 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.810961 21802 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:27.971834 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 111149us
I20260709 12:11:27.973846 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:27.978909 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:27.959656 21760 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.970155 21748 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.959161 21931 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:27.903842 21640 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:11:27.938242 21665 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:27.921263 21840 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.995682 21665 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:27.996261 21665 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:27.996738 21802 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:27.997078 21934 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:11:27.990572 21932 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:27.991907 21903 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:27.996780 21665 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.001052 21906 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.003146 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:27.985227 21937 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 12:11:27.985038 21933 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:11:28.011022 21808 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.982846 21945 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:11:27.974531 21761 consensus_queue.cc:1059] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:28.011756 21640 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:27.928730 21876 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:27.984591 21904 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:27.987425 21760 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.013247 21668 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:28.013450 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:27.986666 21946 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:27.986327 21796 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:28.025079 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:28.025990 21903 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:28.028261 21558 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:28.031840 18014 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:28.019841 21944 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:28.028667 21899 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.023365 21808 raft_consensus.cc:3055] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:28.022668 21760 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.033680 21952 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.041966 21886 raft_consensus.cc:3055] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:28.042357 21886 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:28.043444 21946 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:28.043202 21886 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.043802 21876 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:28.030488 21796 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.008719 21906 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.040210 21944 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:28.053606 21812 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:28.054474 21796 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:28.055581 21748 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.059772 21944 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:28.045598 21946 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:28.062032 21906 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:28.044169 21947 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:11:28.031390 21668 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.040711 21808 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:28.064044 21668 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:28.064611 21668 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.064172 21808 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:28.065577 21808 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.044673 21886 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.066566 21952 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:28.082465 21952 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:28.091405 21947 consensus_queue.cc:1243] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer 868a5e341d0a41b4ac0927342c8cd598 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:28.097105 21899 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:28.097457 21946 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:28.130851 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 160749us
I20260709 12:11:27.619479 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:28.137643 17184 catalog_manager.cc:5697] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:28.140652 17186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55944 (request call id 312) took 18545 ms (client timeout 15000 ms). Trace:
W20260709 12:11:28.141372 17186 rpcz_store.cc:269] 0709 12:11:09.595068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.604896 (+  9828us) service_pool.cc:224] Handling call
0709 12:11:28.140306 (+18535410us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:21.336787 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:21.337368 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:21.337412 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:11:21.337430 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:21.338552 (+  1122us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:21.338613 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:21.341907 (+  3294us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:11:21.364130 (+ 22223us) tablet.cc:701] Row locks acquired
0709 12:11:21.364146 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:11:21.364307 (+   161us) write_op.cc:270] Start()
0709 12:11:21.364424 (+   117us) write_op.cc:276] Timestamp: P: 1783599081364257 usec, L: 0
0709 12:11:21.364439 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:11:21.372242 (+  7803us) log.cc:844] Serialized 5279 byte log entry
0709 12:11:22.278708 (+906466us) op_driver.cc:464] REPLICATION: finished
0709 12:11:22.475925 (+197217us) write_op.cc:301] APPLY: starting
0709 12:11:22.476044 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:22.483156 (+  7112us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:22.483288 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:22.507711 (+ 24423us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:22.508009 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:11:22.508058 (+    49us) write_op.cc:312] APPLY: finished
0709 12:11:22.508413 (+   355us) log.cc:844] Serialized 121 byte log entry
0709 12:11:22.509248 (+   835us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:22.509420 (+   172us) write_op.cc:454] Released schema lock
0709 12:11:22.509477 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:22.509916 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:22.509963 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":900077,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":191588,"apply.run_cpu_time_us":16734,"apply.run_wall_time_us":37231,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":723643,"prepare.run_cpu_time_us":19157,"prepare.run_wall_time_us":446073,"raft.queue_time_us":471660,"raft.run_cpu_time_us":3552,"raft.run_wall_time_us":71356,"replication_time_us":914110,"thread_start_us":1422678,"threads_started":4,"wal-append.queue_time_us":432158,"wal-append.run_cpu_time_us":100768,"wal-append.run_wall_time_us":1712819}]]}
I20260709 12:11:28.140933 17184 catalog_manager.cc:5697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 9, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 9 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:28.156654 17255 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:28.160566 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:28.155750 17184 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 11, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 11 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:28.175822 21967 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:28.176818 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:28.179704 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:28.182437 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 239453us
I20260709 12:11:28.183662 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:28.183982 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:28.194875 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:28.201257 21968 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:28.223214 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.057835 21748 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:28.069692 21840 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:28.073522 21940 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:11:28.336782 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1799) took 2111 ms. Trace:
I20260709 12:11:28.277648 21906 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:28.278936 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.280040 21749 consensus_queue.cc:1059] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:28.280558 21800 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.282979 21640 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:28.288437 21858 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:28.290995 18012 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:28.165704 17184 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 9 to 12, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 12 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:11:28.324012 17438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.017s	sys 0.001s
I20260709 12:11:28.328827 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:28.330313 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:28.331383 21946 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.332881 21732 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:28.333526 21818 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:28.333889 21665 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:28.343786 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:28.277819 21727 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:28.357481 18008 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:28.358207 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:28.362397 21906 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.363987 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:28.372153 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.372843 18010 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:28.373768 21732 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.355683 21640 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:28.394575 21800 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.373238 17184 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 11, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 11 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:28.396978 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.411127 21761 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:28.412417 21761 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:28.388000 21757 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.392441 21732 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:28.415097 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.428133 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:28.437300 21640 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.439415 21640 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.807114 17435 rpcz_store.cc:276] 0709 12:11:26.230176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.416038 (+185862us) service_pool.cc:224] Handling call
0709 12:11:26.416424 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.416805 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.416836 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.417383 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.558387 (+141004us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:27.103472 (+545085us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.800608 (+697136us) spinlock_profiling.cc:243] Waited 6.56 ms on lock 0x7b180005b8a0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f1222a30a40 00007f1222a2b4e4 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:11:27.800806 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.800884 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.800926 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:27.800998 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.801132 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180359,"prepare.queue_time_us":376167,"prepare.run_cpu_time_us":10281,"prepare.run_wall_time_us":206934,"raft.queue_time_us":682990,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"spinlock_wait_cycles":15091968,"thread_start_us":510250,"threads_started":2,"wal-append.queue_time_us":1000684}
I20260709 12:11:28.441211 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:28.441377 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.442297 18009 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:28.443457 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.444098 18009 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:28.444607 21906 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:28.445039 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.445264 21904 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:28.445750 21904 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:28.447256 21904 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.449199 21904 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.450224 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:28.451254 18013 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:28.452327 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:28.455195 21970 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.455765 21800 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:28.457036 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 400455us
I20260709 12:11:28.458187 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:28.458518 17434 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:28.460772 17434 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:28.462505 21665 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.434827 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:28.466243 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 73970.6us
I20260709 12:11:28.475440 21668 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:28.479391 21957 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.430s	user 0.002s	sys 0.003s
I20260709 12:11:28.480214 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.481668 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:28.445931 18009 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:28.487195 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.488615 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.487087 17184 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 8, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 8 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:28.491701 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.493956 21774 raft_consensus.cc:3055] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:28.494450 21774 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:28.495785 21774 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:28.497435 21774 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.498572 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:28.502075 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.491677 17184 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 12, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 12 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:28.506580 18012 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:28.508291 18007 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:11:28.489856 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.501960 21818 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:28.513999 21818 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.516535 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:28.517771 21756 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.510842 21342 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:28.519122 18006 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:28.418030 21858 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.519132 21342 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.523128 21858 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:28.525549 21819 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:28.337311 17432 rpcz_store.cc:276] 0709 12:11:26.224934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.225066 (+   132us) service_pool.cc:224] Handling call
0709 12:11:26.225421 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.225790 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.225818 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.246764 (+ 20946us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.648332 (+1401568us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b1800121360. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:27.748932 (+100600us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:27.760747 (+ 11815us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.819342 (+ 58595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.819436 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.074688 (+255252us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b1800121360. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e3f3 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
0709 12:11:28.260879 (+186191us) raft_consensus.cc:1685] finished
0709 12:11:28.263372 (+  2493us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.336512 (+ 73140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84390,"prepare.queue_time_us":12553,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":149309,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":39643,"spinlock_wait_cycles":18024960,"thread_start_us":100430,"threads_started":1,"wal-append.queue_time_us":1522824}
I20260709 12:11:28.526387 21819 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:28.442092 17435 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:28.545419 21757 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:11:28.507277 21668 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:28.558314 21802 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:28.561676 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.563715 21819 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:28.558074 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:28.553076 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.561049 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:28.523579 21342 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:28.602890 21733 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:28.603438 21733 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:28.604566 21733 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:28.607350 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 49371.9us
I20260709 12:11:28.608225 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:28.609225 21975 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:28.609947 21975 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:28.605245 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1954) took 1970 ms. Trace:
W20260709 12:11:28.617878 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 74421.4us
I20260709 12:11:28.605928 21733 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.611028 21975 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:28.632200 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:28.633816 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:28.634004 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:28.654122 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 196106us
W20260709 12:11:28.640043 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.671299 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:28.638639 21808 consensus_meta.cc:287] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.005s
I20260709 12:11:28.616922 21967 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.649412 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:28.618573 17441 rpcz_store.cc:276] 0709 12:11:26.634619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.414593 (+779974us) service_pool.cc:224] Handling call
0709 12:11:27.414908 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.886787 (+471879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.886817 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.887849 (+  1032us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.291208 (+403359us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4800160158. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:11:28.416072 (+124864us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:28.426910 (+ 10838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.536181 (+109271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.604802 (+ 68621us) raft_consensus.cc:1685] finished
0709 12:11:28.604821 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.605060 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467466,"raft.queue_time_us":412157,"raft.run_cpu_time_us":3218,"raft.run_wall_time_us":451032,"spinlock_wait_cycles":40662400,"thread_start_us":480643,"threads_started":2,"wal-append.queue_time_us":714709}
I20260709 12:11:28.639304 21970 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:28.634334 21968 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.635330 21962 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:28.680894 21976 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:28.694356 18006 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:28.694437 21640 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.696951 21342 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.697556 21876 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:28.697746 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 63922.2us
W20260709 12:11:28.704222 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.706327 21756 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:28.706692 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:28.707314 21748 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:28.732612 21732 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:28.738178 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.752081 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:28.753291 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:28.758930 21760 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.714s	user 0.004s	sys 0.015s
I20260709 12:11:28.695587 21970 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.778963 17438 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.765185 21342 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.786762 17435 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:28.787235 17435 pending_rounds.cc:85] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 7
I20260709 12:11:28.794842 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:28.797834 17292 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 16: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:28.779399 21976 raft_consensus.cc:697] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:28.800287 17434 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 14: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:28.765232 21876 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.796671 21342 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:28.803365 17435 pending_rounds.cc:107] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:28.809108 17435 raft_consensus.cc:2889] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.782995 21760 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.825714 21761 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:28.828589 21757 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:28.830719 21812 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:28.838709 21976 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.853749 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:28.854436 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 86922.9us
W20260709 12:11:28.855332 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 65435.4us
I20260709 12:11:28.855582 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:28.854905 17291 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:28.858412 21640 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.857785 17406 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:28.859763 21640 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.859570 17184 catalog_manager.cc:5697] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 7, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 7 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:28.862785 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:28.867856 17438 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:28.803082 21818 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.898780 21956 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:11:28.918804 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:28.919675 17438 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
W20260709 12:11:28.934652 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 72062.9us
I20260709 12:11:28.886241 21812 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.940958 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:28.891669 21962 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:11:28.944480 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:28.950030 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:28.957235 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:28.958046 17358 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:28.958551 21956 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:28.953682 21640 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.954280 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:28.925028 21970 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:28.950348 21732 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:28.969929 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:28.972903 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:28.962339 21978 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:11:28.972643 21749 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.976974 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:28.967705 21876 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:28.982786 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 276174us
W20260709 12:11:28.990795 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 276910us
I20260709 12:11:28.991528 17361 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.993005 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:28.993980 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 54320.6us
W20260709 12:11:28.980379 21813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.015s
I20260709 12:11:28.979286 21749 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:28.996891 21813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.016s	sys 0.015s
I20260709 12:11:29.003212 17358 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:11:29.006944 17255 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:28.995720 21760 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:29.008879 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.010704 17332 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.018748 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:28.999459 21749 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.018064 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.030484 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.028847 21973 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:29.034706 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.028914 21977 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:29.035068 21973 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.049695 17441 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 7: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:29.037354 21970 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:29.050665 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:28.997997 17184 catalog_manager.cc:5697] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 2 to 9, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 9 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:29.055413 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.065186 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.052117 21973 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.049280 21977 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:29.063899 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 820) took 2763 ms. Trace:
I20260709 12:11:29.052289 21962 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.100057 17360 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:29.100891 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:29.101649 17362 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
W20260709 12:11:29.095805 21990 log.cc:927] Time spent T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 12:11:29.109902 17438 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:29.091306 17439 rpcz_store.cc:276] 0709 12:11:26.272388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.406773 (+1134385us) service_pool.cc:224] Handling call
0709 12:11:27.407123 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.868294 (+461171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.868330 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.900446 (+ 32116us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.002156 (+101710us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4800160158. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:11:28.476689 (+474533us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:28.477270 (+   581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.478087 (+   817us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.032239 (+554152us) raft_consensus.cc:1685] finished
0709 12:11:29.032259 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.035804 (+  3545us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":404233,"raft.queue_time_us":411940,"raft.run_cpu_time_us":2811,"raft.run_wall_time_us":175590,"spinlock_wait_cycles":35898752,"thread_start_us":509431,"threads_started":2,"wal-append.queue_time_us":780061}
I20260709 12:11:29.116451 21977 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.119398 17358 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:29.121526 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.127220 17366 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:29.142009 17441 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.114122 21970 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:29.108776 21812 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:29.144855 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 153916us
W20260709 12:11:29.144521 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 136170us
I20260709 12:11:29.113062 21876 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:29.139216 21756 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:29.123477 21732 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:29.148663 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 138076us
I20260709 12:11:29.159307 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.148603 21665 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.158995 21997 raft_consensus.cc:2764] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:11:29.149905 21876 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.174513 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.175983 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.176652 21996 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.171216 21946 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.191543 17981 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.192030 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:29.195628 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.169685 21967 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:11:29.203325 21876 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:29.205546 21818 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:29.206664 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 119437us
I20260709 12:11:29.193279 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.186033 22001 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:29.177901 21732 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.179173 21970 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.210280 21998 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.215631 17404 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.217290 22006 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.217835 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:29.218530 17436 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:29.223405 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 64988.8us
I20260709 12:11:29.225035 17981 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:29.226286 21668 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:29.226578 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 54911.6us
I20260709 12:11:29.226786 22001 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.228173 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.229035 22001 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:29.229662 17332 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.230445 22001 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:29.230798 21813 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:29.231554 21903 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:29.232132 22005 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:29.208724 21996 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.187463 21665 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.235805 21732 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:29.236824 17238 auto_rebalancer.cc:893] Removing replace marker failed: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:11:29.237381 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.238201 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.238754 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.239171 17283 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:29.239863 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.241289 21756 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.217537 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.241994 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.242888 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.241346 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.250461 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:29.281409 18014 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.251288 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1808) took 1354 ms. Trace:
I20260709 12:11:29.249984 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:29.252954 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:29.254844 17184 catalog_manager.cc:5697] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:29.263777 17361 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
W20260709 12:11:29.264714 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 49181.6us
I20260709 12:11:29.282279 18011 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:29.302325 17255 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:29.304045 17436 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
W20260709 12:11:29.307605 17238 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:11:29.307878 22002 raft_consensus.cc:2764] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:29.310030 21748 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:29.310552 21748 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:29.308044 17238 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:11:29.305685 22001 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.287912 21876 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:29.288487 21756 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.316661 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:29.306847 22000 log.cc:927] Time spent T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.106s	user 0.003s	sys 0.000s
I20260709 12:11:29.299050 21903 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:29.321194 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.321839 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.325443 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:29.325796 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 116705us
I20260709 12:11:29.327987 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.320274 21732 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:29.334411 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.338805 17289 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:29.339151 21732 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:29.346216 21732 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.339725 21748 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:29.365556 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 135973us
I20260709 12:11:29.371865 17184 catalog_manager.cc:5697] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 8, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 8 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:29.374647 21970 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:29.375794 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.376472 17292 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:29.379123 21665 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:29.379769 21903 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.381690 17292 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:29.382845 21996 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:29.381075 18011 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:11:29.384089 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.333909 21946 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:11:29.387888 22005 consensus_queue.cc:1059] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:29.388850 17332 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.380841 17406 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.390519 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.389271 22005 raft_consensus.cc:3055] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:29.392409 22005 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:29.392726 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.393385 17436 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:29.394505 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.389999 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.393589 22005 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.400061 17441 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:29.405553 18014 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:29.406960 17439 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:29.407639 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:29.411036 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.420565 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:29.420773 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 104890us
I20260709 12:11:29.421434 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:29.426963 17288 raft_consensus.cc:2410] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:29.406445 22008 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.426216 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.428905 21970 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:29.433240 21727 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:29.435273 17434 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:29.401162 21973 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.436630 21727 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.438793 21973 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:29.441354 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.373811 17184 catalog_manager.cc:5697] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:29.406713 21998 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.435663 17981 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.426501 21813 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:29.425871 22014 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.424502 22012 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:29.425369 21956 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:29.446813 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 113612us
I20260709 12:11:29.460556 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:29.443063 17184 catalog_manager.cc:5697] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 7 to 11, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 11 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:29.465103 21973 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.465559 21973 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:29.465971 21973 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.467013 21748 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:29.470624 21997 raft_consensus.cc:1064] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:11:29.471490 21858 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:29.473681 21997 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.474211 22012 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.281908 17433 rpcz_store.cc:276] 0709 12:11:27.897787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.899704 (+  1917us) service_pool.cc:224] Handling call
0709 12:11:27.900077 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:28.304458 (+404381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.311152 (+  6694us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:28.575446 (+264294us) log.cc:844] Serialized 52 byte log entry
0709 12:11:28.936846 (+361400us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.956703 (+ 19857us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.968981 (+ 12278us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.970149 (+  1168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.973467 (+  3318us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.250914 (+277447us) raft_consensus.cc:1685] finished
0709 12:11:29.250935 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.251106 (+   171us) inbound_call.cc:177] Queueing success response
0709 12:11:29.254023 (+  2917us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b180044d100. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e3f3 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
Metrics: {"mutex_wait_us":23648,"prepare.queue_time_us":21273,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":107152,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":5451,"spinlock_wait_cycles":5430272,"thread_start_us":675707,"threads_started":2,"wal-append.queue_time_us":390503}
I20260709 12:11:29.476584 22012 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:29.483346 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.485307 17366 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:29.486464 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.488289 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.490696 17404 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.490222 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:29.492106 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.446521 21968 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.499761 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.470484 21956 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.459415 21813 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:29.523669 22012 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:29.524175 21813 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:29.506146 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 47149.8us
I20260709 12:11:29.507550 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.464129 22008 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.491030 21996 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:11:29.511505 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.514357 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:29.460237 22005 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:29.515293 22001 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:29.521292 22006 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.536958 22008 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:29.522382 21946 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:11:29.523221 21992 log.cc:927] Time spent T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.486s	user 0.000s	sys 0.003s
I20260709 12:11:29.539759 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1813) took 1598 ms. Trace:
I20260709 12:11:29.532897 18014 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:29.540508 21946 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.526652 21962 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:29.541493 21962 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:29.541872 21962 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.556649 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:29.545468 17440 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
W20260709 12:11:29.643607 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 113841us
I20260709 12:11:29.578730 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.621424 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:29.541971 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.546356 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.544001 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.545939 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.566248 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:29.542459 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.572827 17434 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:29.548110 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.649533 17358 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:29.580780 17438 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:29.524358 21807 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:29.543735 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.444645 21749 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.644994 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.554842 17978 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:29.646984 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 90432.4us
W20260709 12:11:29.576741 22007 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.374s	user 0.001s	sys 0.001s
I20260709 12:11:29.651451 17439 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
W20260709 12:11:29.545838 22004 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.349s	user 0.002s	sys 0.000s
I20260709 12:11:29.555564 22001 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:29.608404 21858 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:29.642880 17440 pending_rounds.cc:85] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 11
I20260709 12:11:29.586226 21423 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:11:29.546386 21342 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.610708 21665 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.673588 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 129645us
I20260709 12:11:29.571910 21956 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:29.588411 21727 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:29.677510 17406 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.683459 21423 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:29.684278 21423 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:29.584820 21973 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.684613 21423 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:29.685607 21423 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.686133 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.686563 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:29.686944 21423 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.687604 21956 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.688406 22003 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:29.689050 22003 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:29.661689 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.622184 21732 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:11:29.616915 21813 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:29.698439 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 53560.3us
I20260709 12:11:29.674384 17440 pending_rounds.cc:107] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:11:29.546133 21996 consensus_queue.cc:1243] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:29.687031 21946 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.678125 17290 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:29.691042 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:29.540126 17437 rpcz_store.cc:276] 0709 12:11:27.941168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.019360 (+ 78192us) service_pool.cc:224] Handling call
0709 12:11:28.397746 (+378386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:28.424049 (+ 26303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.424084 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:28.654298 (+230214us) log.cc:844] Serialized 52 byte log entry
0709 12:11:28.951461 (+297163us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:28.951504 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.951579 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.522667 (+571088us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:29.539377 (+ 16710us) raft_consensus.cc:1685] finished
0709 12:11:29.539399 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.539608 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":456,"raft.queue_time_us":21208,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":40094,"spinlock_wait_cycles":4527872,"thread_start_us":292711,"threads_started":1,"wal-append.queue_time_us":382534}
I20260709 12:11:29.653875 21807 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:29.660790 21967 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:29.676303 21342 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:29.678428 21998 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.703016 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.680115 21876 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.704221 17332 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.686300 21973 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:29.709098 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:29.720036 17441 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.701469 17440 raft_consensus.cc:2889] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.722554 21967 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.724776 21967 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:29.726428 21998 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:29.728979 17332 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.730067 17332 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.734695 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.736471 21998 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.736963 22017 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:29.737434 21956 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.737547 22017 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:29.738674 22017 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.739310 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.740298 21876 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.741020 21876 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:29.742621 21807 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.744969 21807 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.745231 17363 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:29.745608 17363 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:29.749691 22001 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.710451 21977 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:11:29.713361 21971 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:11:29.736410 21970 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.755075 21886 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:29.755330 21970 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.756178 21886 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:29.756546 21886 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:29.757359 21886 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.769338 21886 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.689953 22003 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.743216 21749 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:29.760968 17363 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.762410 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:29.762984 22005 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.693742 21665 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:29.765897 22002 consensus_queue.cc:1059] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:29.794030 22006 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:11:29.764605 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.797652 21956 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.797922 21998 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.743809 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.798254 21956 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.799563 21876 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.799973 21876 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:29.800318 21876 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.800788 21956 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:29.802218 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.802498 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 58891us
I20260709 12:11:29.798053 17363 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.804024 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.805303 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.806740 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.807461 17362 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:29.808583 17404 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:29.768750 21342 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:29.754508 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 199880us
I20260709 12:11:29.811153 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.812494 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.813480 22015 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.814235 22015 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.757663 21970 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:29.736752 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.794279 22005 raft_consensus.cc:3055] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:29.818315 22005 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:29.819279 22005 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.820843 22005 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.797727 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.707742 21756 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:29.845053 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 156894us
W20260709 12:11:29.849865 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 146848us
I20260709 12:11:29.854663 17255 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.785286 17441 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
W20260709 12:11:29.857409 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 59755.7us
I20260709 12:11:29.860294 18011 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:29.861171 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:29.862709 18012 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:29.832801 21996 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.731901 21968 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 12:11:29.868021 17255 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:29.834143 21640 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.875973 17360 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:29.876574 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.845623 21956 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:29.879667 21956 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:29.880331 21956 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:29.882839 21956 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:29.883883 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.885000 17362 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:29.849676 22012 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:29.908353 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.909111 17440 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:29.910465 17283 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:29.912107 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:29.915438 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:29.915874 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47944.1us
I20260709 12:11:29.920931 17283 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:29.922744 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.923230 21977 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.924372 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.925061 17291 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:29.925890 17255 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.926743 17333 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:29.923257 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.928035 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:29.930929 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.931638 17364 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:29.932032 17284 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:29.916182 17289 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:29.932700 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.922914 17287 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:29.931494 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:29.934976 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:29.935173 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:29.936583 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:29.936841 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:29.940124 21997 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:29.940677 21997 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:29.941242 21997 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.946944 17292 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:29.931957 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:29.953557 17363 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:29.886533 21970 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.972504 17289 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:29.970263 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:29.974838 17365 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:29.907719 22012 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.977594 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:29.932365 21998 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:29.973464 21748 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:11:29.968976 21996 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:29.967623 21732 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:29.989858 17366 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:29.998446 21813 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:30.003824 21999 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:30.005939 22003 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.009601 21342 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.026455 22035 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:29.982322 22012 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.979893 21807 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:29.986698 21967 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:30.041065 21996 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:29.997956 21876 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:30.065392 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 128926us
I20260709 12:11:30.042759 21807 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.069439 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:30.072845 18012 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 7.
W20260709 12:11:30.075870 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 89446.9us
I20260709 12:11:30.077404 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.077566 18014 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:30.082024 18006 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:30.082867 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:30.080463 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:30.064841 21967 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:30.085880 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:30.089174 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:30.089241 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:30.039019 22003 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.090425 18010 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:30.095281 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:30.075260 21807 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:30.096308 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.097071 18008 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:30.102593 17407 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:30.104413 22028 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
I20260709 12:11:30.105484 22008 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:30.085888 21962 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.107703 17437 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.050381 22035 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.108788 21962 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:30.102694 21996 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.111300 21876 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:30.105911 22008 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.117619 22008 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.117905 22003 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:30.107836 22032 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:11:30.122128 22002 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.109915 21967 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.109805 22035 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:30.144160 17434 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:30.091144 21975 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:30.164906 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 65894.9us
I20260709 12:11:30.167279 17332 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.168593 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.171824 17406 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.172534 22008 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.175570 21956 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.176304 21956 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.178076 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.097998 21999 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:30.173306 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:30.098984 21756 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:30.187690 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 85950.4us
I20260709 12:11:30.190675 17406 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.194887 21970 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:30.194624 22039 consensus_queue.cc:1059] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:30.100313 21973 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:11:30.204046 22001 consensus_queue.cc:1059] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:11:30.187389 21998 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.204401 21886 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.211668 21886 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.206681 22039 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:30.214790 22039 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:30.215199 21886 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:30.214927 22038 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:11:30.218060 22039 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.219226 22001 raft_consensus.cc:3055] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.221117 21976 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:30.222541 22026 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:30.223220 21975 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:30.197185 22035 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:30.254587 22035 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.255069 22035 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:30.199980 21956 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:11:30.260056 21999 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.226027 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:30.242431 22012 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.196739 21946 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:30.235813 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:30.268057 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.210517 21998 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:30.269201 21998 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.242259 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:30.268749 18008 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:30.276019 18011 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:30.278448 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:30.278934 17288 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:30.281764 18013 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:30.247565 22031 log.cc:927] Time spent T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
W20260709 12:11:30.236083 22029 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.296s	user 0.000s	sys 0.003s
I20260709 12:11:30.284740 22012 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:30.263315 21997 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.200135 21962 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.266091 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.266459 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:30.266922 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:30.295433 17361 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.267386 21665 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:30.234644 22001 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:30.293488 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:30.294546 17366 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:30.301136 18006 raft_consensus.cc:2410] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:30.301200 17365 raft_consensus.cc:2393] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:11:30.302023 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 76058.4us
I20260709 12:11:30.309317 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:30.309928 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:30.241922 21976 consensus_queue.cc:1243] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer aaafaad0810b4e95983d2d73ec814346 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:30.313441 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.315416 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.291504 21756 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.320735 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.322969 17434 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:11:30.323189 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 127569us
I20260709 12:11:30.328337 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:30.329198 17284 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.336114 17434 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:30.337997 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:30.350800 22043 log.cc:927] Time spent T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:30.351286 17437 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:30.354135 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:30.356820 21423 consensus_queue.cc:1059] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:30.357983 21423 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:30.358222 22027 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:11:30.358668 21812 raft_consensus.cc:3055] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:30.359150 21812 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:30.360087 21812 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.361528 21812 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.358363 22015 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:11:30.363704 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.364464 17362 raft_consensus.cc:2393] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 16: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:30.365258 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:30.365309 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.366092 21997 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:30.366524 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:30.367020 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.367686 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:30.310256 22006 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.368103 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.368702 17359 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:30.364583 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:30.366477 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.374534 17364 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:11:30.374904 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 54283.4us
W20260709 12:11:30.376021 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 176880us
W20260709 12:11:30.376711 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.380131 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.377300 17981 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.427613 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:30.427989 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 50791us
I20260709 12:11:30.434424 22008 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:30.390364 21423 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:30.435742 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:30.436805 21755 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:30.332748 21727 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.462991 21748 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:30.440598 22002 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:30.474467 21748 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:30.474720 22002 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.474924 21748 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.383409 21756 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.474269 21727 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.479496 21756 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:30.480240 21727 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:30.481446 17362 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 13: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:30.446269 17361 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:11:30.454870 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 74828.6us
I20260709 12:11:30.350857 22039 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.436630 22045 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:30.464649 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 73763.2us
I20260709 12:11:30.383190 22006 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.467664 17288 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:30.463866 17435 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:30.468426 18008 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.468549 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:30.462713 18013 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:11:30.471498 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 176869us
I20260709 12:11:30.472278 22055 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:30.473196 21423 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.483212 17366 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.361399 21807 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.455484 21761 raft_consensus.cc:3055] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:30.493863 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 277670us
I20260709 12:11:30.391669 22015 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:11:30.499511 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.504733 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.508575 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.500690 21761 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:30.497227 22006 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.509835 21956 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:11:30.551738 17364 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.552588 17286 raft_consensus.cc:2368] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9.
I20260709 12:11:30.556701 17284 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:30.561700 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.562733 17361 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 12:11:30.569453 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 64798.8us
I20260709 12:11:30.570391 17404 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:30.569736 18008 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:30.505015 22045 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:30.576283 17404 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:30.549852 21999 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:30.554869 21997 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.583352 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.593504 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:30.548281 21761 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.603155 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:30.603969 17436 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:30.590667 22059 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:30.606170 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:30.611490 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:30.612140 17362 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.580946 21962 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.612159 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:30.613610 17437 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:30.575461 21748 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.598927 21732 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.616931 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.626652 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:30.601157 21956 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:30.635031 21807 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:30.635351 22047 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:11:30.616094 21962 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:30.622520 21761 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.643224 21998 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.584674 22046 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.305s
I20260709 12:11:30.645385 22002 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.647354 17361 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:30.665949 21998 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:30.654690 17362 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:30.662570 22002 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:30.663259 17358 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.676646 18008 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.676338 22045 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.677057 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:30.679169 21756 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:30.679489 17406 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.680768 17406 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.666091 22012 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:30.682258 22012 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:30.682407 22008 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:30.682927 22008 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:30.683406 22059 raft_consensus.cc:2804] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:30.683907 22059 raft_consensus.cc:697] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:30.683175 22012 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.647716 21962 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.636855 21997 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.702344 21997 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.702809 21997 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.703660 22001 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.704844 22001 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.706723 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:30.639173 21956 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:30.708498 17440 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:30.709546 22014 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:30.722934 22014 raft_consensus.cc:3055] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.723366 22014 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:30.724212 22014 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:30.690682 22063 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:30.708510 21956 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.732163 22008 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.658825 21748 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:30.695035 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:30.695919 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:30.715035 22059 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:30.716113 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 59946.2us
W20260709 12:11:30.719736 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 220402us
I20260709 12:11:30.720976 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.688403 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:30.740749 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:30.741338 17433 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.741784 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:30.691248 22012 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.744577 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:30.713500 22035 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.739313 17437 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:30.738039 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:30.767854 17406 leader_election.cc:400] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9.
I20260709 12:11:30.768307 17406 leader_election.cc:403] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:30.771576 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:30.772950 17289 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.773984 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:30.774623 17290 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.750393 21748 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.778810 17362 raft_consensus.cc:1217] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-10.6]   Dedup: 6.4->[8.5-10.6]
W20260709 12:11:30.780431 22065 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 12:11:30.779295 17362 pending_rounds.cc:85] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 4
I20260709 12:11:30.781911 17362 pending_rounds.cc:107] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:30.778605 21748 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.782219 17434 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:30.782176 17362 raft_consensus.cc:2889] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:30.787456 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 49497.6us
I20260709 12:11:30.785765 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.725612 22014 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.868759 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 83078.4us
I20260709 12:11:30.809998 17432 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:30.810259 18012 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:30.870963 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.799463 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:30.817142 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46015.1us
I20260709 12:11:30.871016 17407 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:30.821171 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.824213 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.869016 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 52764.3us
I20260709 12:11:30.874302 17439 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.825058 21665 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:30.874735 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.876595 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.878026 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:30.778728 22064 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.003s
I20260709 12:11:30.882771 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:30.878047 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:30.884599 17360 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.885473 17434 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:30.887163 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:30.895599 21999 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:30.777922 21755 consensus_queue.cc:1059] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:11:30.897169 21640 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:30.873773 21886 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:30.901957 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 181039us
I20260709 12:11:30.907343 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.868305 21812 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.869220 21423 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.782239 21876 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 12:11:30.876065 22035 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:30.906774 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:30.911574 17290 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:30.879029 22046 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:30.884155 21998 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:30.940150 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 69237.9us
I20260709 12:11:30.943428 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:30.815122 21996 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 12:11:30.949642 17366 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:30.909248 21886 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.883797 22005 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:11:30.910915 22041 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:30.883680 21665 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:30.968957 17439 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:30.978642 21665 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:30.940150 21977 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.917181 21423 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:30.940384 21668 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.986027 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:30.996495 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.956110 22037 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.965334 21886 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:31.038918 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:30.988344 21858 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.988703 21977 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:30.954982 22002 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
W20260709 12:11:31.051123 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.044270 21813 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:31.059608 22039 consensus_meta.cc:287] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.004s
I20260709 12:11:31.060310 17363 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:31.079034 17360 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:31.081267 17433 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:31.087595 21946 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9.
I20260709 12:11:31.033710 22003 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.121615 21807 raft_consensus.cc:3055] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.122150 21807 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:31.123090 21807 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:31.124221 21807 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.048533 21977 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.050372 21732 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.142297 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 201043us
I20260709 12:11:31.144690 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:31.138672 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 152001us
I20260709 12:11:31.178336 17359 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:31.048686 21858 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.183633 17360 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.153254 22035 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.201577 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 240570us
I20260709 12:11:31.148732 21640 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:31.207191 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 330641us
I20260709 12:11:31.208343 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:31.195941 21748 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.144062 21732 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.180630 22041 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 12:11:31.251281 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 64902.3us
I20260709 12:11:31.256372 21968 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:31.257011 21968 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:31.278766 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:31.289762 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:31.291237 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:31.291600 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:31.292104 17360 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.244318 22046 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.242470 21956 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:31.298273 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:31.206043 22035 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.257896 21968 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:31.320652 17290 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.321074 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:31.329547 17287 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:31.334417 17360 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:31.337543 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:31.301626 22083 log.cc:927] Time spent T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:31.262208 21748 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:11:31.345677 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:31.351416 22040 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.355204 22057 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 12:11:31.356237 22057 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:31.356592 22057 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:31.356716 21962 consensus_meta.cc:287] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.001s
W20260709 12:11:31.357197 21761 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.000s
W20260709 12:11:31.358040 22080 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:11:31.321110 21999 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:31.358209 21423 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:31.361750 21997 consensus_meta.cc:287] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 12:11:31.359321 17284 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:31.367733 22078 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:11:31.375798 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:31.372287 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 75424.2us
W20260709 12:11:31.414209 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 78694.5us
I20260709 12:11:31.417057 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:31.417891 17363 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
W20260709 12:11:31.425717 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 240548us
I20260709 12:11:31.359766 21732 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.369092 22055 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:11:31.314685 22046 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:31.360101 21999 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.374536 22096 consensus_queue.cc:1059] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:11:31.357477 22057 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.357196 21962 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:31.483047 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 67670.9us
I20260709 12:11:31.389117 21997 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.496400 17367 raft_consensus.cc:2368] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14.
I20260709 12:11:31.497997 21999 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.498705 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:31.499505 17283 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:31.439419 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:31.496218 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:31.451529 17363 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:31.500228 21977 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:31.501613 22088 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.323s	user 0.002s	sys 0.000s
I20260709 12:11:31.502317 17284 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:31.504315 17332 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:31.504807 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:31.505292 21999 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.507004 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:31.429615 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:31.508635 22055 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:31.509021 22055 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.509377 22055 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:31.510666 22057 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:31.421598 21668 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.385253 21996 consensus_queue.cc:1059] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 12:11:31.512934 21342 raft_consensus.cc:3055] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:31.513392 21342 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:31.514315 21342 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:31.515408 21342 raft_consensus.cc:3060] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:31.469907 22048 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.010s	sys 0.035s
W20260709 12:11:31.518309 22048 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.013s	sys 0.040s
W20260709 12:11:31.443522 22006 consensus_meta.cc:287] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.874s	user 0.011s	sys 0.000s
I20260709 12:11:31.518986 22006 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.520448 17359 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.442013 21423 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.442497 22108 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:31.521693 21423 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.522389 22108 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.523960 21423 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:31.524768 22108 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.525920 17438 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.361009 22095 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 12:11:31.447719 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:31.505852 21999 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.536355 21999 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.501323 17433 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:31.543869 21858 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:31.545614 21886 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.546296 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:31.548022 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:31.548314 18010 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 16: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:11:31.549396 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 55454.2us
I20260709 12:11:31.548039 22017 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:31.551578 21886 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:31.410161 22040 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.552525 22040 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:31.555507 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.555501 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:31.557134 17366 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:31.495620 22046 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:31.535115 21962 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.505789 21997 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.410230 21640 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.559828 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:31.562753 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:31.570199 18015 raft_consensus.cc:2393] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:31.563388 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:31.563460 18010 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:31.573200 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:31.585606 17978 leader_election.cc:400] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14.
I20260709 12:11:31.590509 18010 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:11:31.591002 18010 pending_rounds.cc:85] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 9
W20260709 12:11:31.557024 22077 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:11:31.591230 18010 pending_rounds.cc:107] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:11:31.593237 18010 raft_consensus.cc:2889] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:31.584133 18013 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:31.592495 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:31.591190 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:31.596839 17333 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:31.596925 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 149312us
I20260709 12:11:31.559551 22099 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.599291 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:31.608112 21977 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.608143 21668 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.620407 21668 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.620859 21668 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.608268 21756 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.622429 21756 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:31.622902 21756 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.559299 22035 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.593499 22050 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.557507 22017 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:31.629590 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:31.630215 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:31.642335 17363 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:31.631855 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:31.632758 17435 raft_consensus.cc:1240] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.645735 17438 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:31.646804 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:31.647985 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:31.647789 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:31.648772 17284 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:31.646971 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:31.651714 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:31.652406 18011 raft_consensus.cc:2410] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 15 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:11:31.635385 21876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.019s	sys 0.004s
W20260709 12:11:31.686460 21876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.020s	sys 0.005s
I20260709 12:11:31.696102 22040 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:31.635464 22099 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.647667 22108 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.691671 22110 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.697219 22017 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.711558 21956 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:31.657186 18015 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:31.708513 17363 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:11:31.647781 21946 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:11:31.712102 21956 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:31.730713 17407 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:31.733664 22106 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:11:31.734844 22090 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:11:31.737737 22027 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:31.719699 22108 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:31.738719 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:31.709105 22110 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:31.719404 22039 raft_consensus.cc:2764] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:11:31.698670 22046 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:31.718688 21973 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:31.774075 21973 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.774890 22082 raft_consensus.cc:3055] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:31.775319 22082 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:31.776283 21973 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.768163 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:31.776165 22082 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.777031 17440 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.777410 22082 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.779124 22099 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:31.763842 22101 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.768671 22110 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.781265 22101 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.782251 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:31.747154 22059 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:31.732755 21997 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:31.787010 21997 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:31.789368 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:31.728127 21876 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:31.769866 22002 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:31.792492 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:31.800417 17440 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:31.801779 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:31.802361 17440 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:31.810209 17440 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:31.811685 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:31.816349 17433 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:31.822151 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:31.823750 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.826071 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:31.746567 21999 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:31.839161 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:31.812495 21342 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:31.812641 21886 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:31.814400 21756 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.818885 22041 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:32.005293 17359 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:32.005692 17358 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:31.853881 17332 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:32.013304 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.020054 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:31.810601 21876 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:32.067086 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 213327us
I20260709 12:11:31.833595 22099 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:31.764930 22027 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:31.842159 22039 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:32.075815 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.009299 21755 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.843554 22105 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:31.813730 22002 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.003654 21998 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:32.111212 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:32.013163 21976 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:32.120766 22117 log.cc:927] Time spent T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:32.121420 22119 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.066550 21997 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.079718 21996 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.136162 22098 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.136808 22098 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.137992 17290 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:32.138693 17358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:32.139070 22098 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.139524 17358 raft_consensus.cc:606] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:32.139914 17358 raft_consensus.cc:614] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:32.140038 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:32.118476 22001 consensus_meta.cc:287] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 1.413s	user 0.007s	sys 0.008s
W20260709 12:11:32.113793 22014 consensus_meta.cc:287] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.235s	user 0.012s	sys 0.000s
I20260709 12:11:32.082346 22044 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:32.015646 21342 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.106009 22095 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:32.015444 21886 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.156492 17363 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.159361 22101 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.169198 17361 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:32.083051 22099 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.125173 22105 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:32.142714 21996 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:32.170274 22055 consensus_meta.cc:287] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.660s	user 0.011s	sys 0.002s
I20260709 12:11:32.187366 18010 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:32.196313 17439 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:32.133646 21998 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.115166 21755 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.197139 22055 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.214529 22108 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:32.215600 21999 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.172586 22001 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:32.150391 21976 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.217667 17436 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:32.218588 22002 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:32.219218 22123 log.cc:927] Time spent T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 12:11:32.220036 22122 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:11:32.220791 21668 consensus_meta.cc:287] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.003s
I20260709 12:11:32.171010 22096 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:32.224855 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:32.225389 17366 consensus_meta.cc:287] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.002s
I20260709 12:11:32.226393 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:32.171185 21640 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:32.219900 21756 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.191082 21996 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.216715 21997 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.178809 22044 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.234880 21956 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:32.278944 17366 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:32.269917 22129 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.306463 17363 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:32.183650 22095 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.276521 22085 raft_consensus.cc:3055] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:32.322268 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:32.323338 17358 raft_consensus.cc:2410] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:32.303926 22039 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:32.316779 21999 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.280121 21668 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.317962 22085 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:32.338771 22039 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.278954 22001 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.291155 22096 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.348948 22107 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:11:32.349380 22103 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.350531 22055 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.351037 21976 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.341282 22037 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.313316 21997 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.334978 22105 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.359519 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:32.367991 17366 raft_consensus.cc:2393] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 14: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:32.345530 21423 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.370985 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:32.347214 22027 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.321537 22129 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.392599 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:32.393805 17366 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:32.392599 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:32.344657 21999 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.360950 21813 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:32.399240 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:32.403577 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:32.404340 17363 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:11:32.407881 17363 pending_rounds.cc:85] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:11:32.408155 17363 pending_rounds.cc:107] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:11:32.408382 17363 raft_consensus.cc:2889] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:32.408664 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.361438 22120 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:11:32.399225 21665 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.394727 21886 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:32.423508 21342 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.427135 21668 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:32.391021 21756 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.387610 21755 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.431839 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:32.436100 17366 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.396234 22081 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.427417 21997 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.363991 22103 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.382947 21423 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.439132 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.457264 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.429432 22099 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:32.453483 17364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:32.459323 17364 raft_consensus.cc:606] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:32.459715 17364 raft_consensus.cc:614] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:32.443612 22081 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.467890 22081 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.469693 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.436730 21665 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.471146 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:32.472111 21665 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:32.472470 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:32.473402 22082 consensus_meta.cc:287] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
I20260709 12:11:32.476372 22006 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.480361 22095 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:32.482540 17436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 1990) took 1788 ms (client timeout 1654 ms). Trace:
W20260709 12:11:32.482981 17436 rpcz_store.cc:269] 0709 12:11:30.693655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.695639 (+  1984us) service_pool.cc:224] Handling call
0709 12:11:32.482330 (+1786691us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54001a13d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:32.482449 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3292110592}
I20260709 12:11:32.397655 22085 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.435467 22139 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.488673 17366 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:32.441022 22096 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.366791 22037 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:32.498937 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.483394 22110 consensus_meta.cc:287] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.000s
W20260709 12:11:32.498508 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 58700.4us
I20260709 12:11:32.442528 21756 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.503592 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.504485 21756 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.504842 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:32.493453 22082 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.505985 22082 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.506789 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:32.507627 22017 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.508111 22082 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.508168 22017 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:32.509203 22017 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.511381 22050 raft_consensus.cc:3055] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.510629 21342 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 4 to 10, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:32.511847 22050 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:32.492847 21996 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.517544 21876 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:32.517936 21996 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.458688 21998 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.524145 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:32.537858 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:32.540742 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:32.541944 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:32.543051 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:32.543346 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:32.484123 22085 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.548765 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.498965 21956 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.558959 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:32.571444 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:32.495994 22044 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.547910 17432 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 4 to 10, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:32.538020 22120 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:32.538080 21999 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.576315 22141 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.496064 22139 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.595744 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:32.603098 17364 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 5.
I20260709 12:11:32.611063 21876 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:32.620604 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.512826 22050 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:32.609958 22142 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:11:32.545886 22110 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.611656 21876 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.586918 22120 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:32.724452 22144 log.cc:927] Time spent T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:11:32.734771 21876 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.721623 22003 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:32.735850 22044 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:32.736382 22044 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.735877 22003 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:32.739240 22003 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.662822 21956 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.751111 22139 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.753005 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:32.753758 17358 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
W20260709 12:11:32.816867 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.699189 22141 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.722012 22001 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:32.948988 17358 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:32.950800 22096 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.951431 22096 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.953727 22096 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:32.955751 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:32.956094 22145 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:11:32.956621 17358 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:32.855439 21968 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:32.957283 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 875) took 1326 ms. Trace:
I20260709 12:11:32.957406 21968 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.958310 21423 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.959846 22110 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:32.960711 22037 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.961341 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:32.970208 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.971132 17436 raft_consensus.cc:2410] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:32.971144 21755 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.973455 21968 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.973351 21755 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.975426 22120 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:32.975914 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.975560 21755 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:32.981737 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.880506 22141 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:32.982514 17433 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:32.957739 17440 rpcz_store.cc:276] 0709 12:11:31.631391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.025111 (+393720us) service_pool.cc:224] Handling call
0709 12:11:32.079879 (+ 54768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:32.328090 (+248211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:32.328126 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:32.328696 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:11:32.495763 (+167067us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:32.495804 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.495890 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.957019 (+461129us) raft_consensus.cc:1685] finished
0709 12:11:32.957050 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.957216 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18620,"raft.queue_time_us":62266,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7310,"thread_start_us":372158,"threads_started":2,"wal-append.queue_time_us":285017}
I20260709 12:11:32.866652 22139 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:32.990258 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:32.985055 22044 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.009603 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 1986) took 2317 ms. Trace:
I20260709 12:11:33.010784 17435 rpcz_store.cc:276] 0709 12:11:30.692319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.694195 (+  1876us) service_pool.cc:224] Handling call
0709 12:11:30.694559 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.643405 (+948846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.009315 (+1365910us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54000ca654. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:33.009523 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084082944}
I20260709 12:11:33.023141 17404 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:33.024109 22096 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:33.025298 22059 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.030162 17358 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:33.025599 22096 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:11:33.034477 17404 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.002035 22139 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.063992 22139 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.066350 22141 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.075536 22044 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:33.076062 22096 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:33.080844 22096 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.081432 22096 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:33.079569 17432 consensus_meta.cc:287] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 12:11:33.085630 22044 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.120784 21997 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.122167 22001 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.131410 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 97300.7us
I20260709 12:11:33.122614 22134 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.122467 22141 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.135851 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.138039 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.136575 22134 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.136365 22001 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.140558 22134 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.142230 22085 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.142663 22085 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.143043 22085 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.125819 22059 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:33.154484 17363 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:33.155035 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.155769 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:33.156363 17434 raft_consensus.cc:2376] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11. Re-sending same reply.
I20260709 12:11:33.148584 22139 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:33.156862 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.152032 22103 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.140998 22001 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.138149 22163 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:11:33.147898 22141 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.174751 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:33.175411 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.176039 22141 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.160718 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:33.175994 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.161317 22110 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.166424 21967 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:33.166612 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.176846 17286 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:33.166945 22048 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.159808 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.173002 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.177151 17292 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:33.177417 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.181569 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:33.182566 17359 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:33.183221 17284 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.183851 17432 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:33.137106 21997 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.181195 22048 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.187178 21997 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.187583 22048 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.180476 22110 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.189046 22103 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:33.189582 22103 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.190258 22110 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.182155 22001 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.190863 22044 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.191182 22001 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.193373 22001 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.180397 21967 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:33.190287 17980 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.622s (SENT) [suppressed 7 similar messages]
I20260709 12:11:33.158298 21640 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.196154 17287 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:33.201895 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.184422 22141 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:33.202139 21967 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.204300 22129 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.205124 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.205838 17437 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:33.210071 17437 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:33.213006 22085 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.214473 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.216852 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 2102) took 2441 ms. Trace:
I20260709 12:11:33.217343 17361 rpcz_store.cc:276] 0709 12:11:30.775197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.782541 (+  7344us) service_pool.cc:224] Handling call
0709 12:11:30.782800 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.175439 (+1392639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.216509 (+1041070us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400149bd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:33.216736 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3172233472}
W20260709 12:11:33.205466 17290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 957) took 1363 ms (client timeout 1622 ms). Trace:
I20260709 12:11:33.179054 22045 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 12:11:33.219403 17290 rpcz_store.cc:269] 0709 12:11:31.842282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.842391 (+   109us) service_pool.cc:224] Handling call
0709 12:11:33.205285 (+1362894us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001c0554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:33.205383 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269442816}
W20260709 12:11:33.224099 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.224977 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.232909 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:33.251468 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:33.251748 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.233101 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.264285 17284 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:33.191684 22103 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.254391 22141 raft_consensus.cc:697] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:33.314149 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.320171 17364 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:33.274398 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.200066 22110 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:33.273356 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:33.318648 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 62590.7us
I20260709 12:11:33.197063 22134 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.314708 22001 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.278882 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.182770 21946 consensus_queue.cc:1059] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 12:11:33.329438 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:33.255038 22035 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.331276 17359 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:33.332947 17363 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:33.316658 21876 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.335868 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:33.271978 21968 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.343271 22096 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.332015 22134 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.337366 21977 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.349332 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.349994 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.343745 21876 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.350718 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.331954 22159 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:11:33.348819 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.352262 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.330888 22110 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.225174 21997 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.346933 21757 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.348896 22096 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.323696 22059 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.351125 21876 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.258996 21967 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:33.231775 21640 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.320560 21999 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.350651 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:33.355840 21997 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.353540 22085 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.344703 17978 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:33.356750 21967 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.362735 22105 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.363152 22105 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.363530 22105 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.363420 22103 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:33.364215 22103 consensus_queue.cc:1243] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer aaafaad0810b4e95983d2d73ec814346 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:33.364837 22103 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:33.365134 22103 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:33.365923 22103 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.352480 21956 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:33.367535 22103 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.368742 17359 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:11:33.369114 17359 pending_rounds.cc:85] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 10
I20260709 12:11:33.369354 17359 pending_rounds.cc:107] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:11:33.369588 17359 raft_consensus.cc:2889] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.371373 22133 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:33.351289 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.383208 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.383939 17286 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:33.254626 22089 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:33.371191 22163 raft_consensus.cc:3055] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:33.392937 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.400120 21967 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.401685 21640 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.402845 22110 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.404412 21997 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.382158 22001 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.408334 22001 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.367574 21956 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.410074 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1866) took 1532 ms. Trace:
I20260709 12:11:33.410557 17441 rpcz_store.cc:276] 0709 12:11:31.877922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.212365 (+334443us) service_pool.cc:224] Handling call
0709 12:11:32.212614 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.230674 (+ 18060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:32.230708 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:32.230750 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:32.230793 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.409833 (+1179040us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54001b03d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:33.409877 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.410016 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41031552}
I20260709 12:11:33.411662 21956 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.358013 21999 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.415378 21999 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.415966 17362 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:33.354548 22141 consensus_queue.cc:237] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.418241 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.419855 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.420574 17441 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:33.421469 17433 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:33.419886 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.422894 17432 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:33.423981 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.423882 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:33.424729 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.429770 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:33.387281 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 226567us
I20260709 12:11:33.432053 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.231912 22135 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.435547 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.436058 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.436245 18008 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
W20260709 12:11:33.435679 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 245416us
I20260709 12:11:33.428121 18012 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 4 to 10, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:33.439723 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.440419 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.444800 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.446321 17437 raft_consensus.cc:2393] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:33.453188 22139 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:33.454300 22139 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.456467 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.462447 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.464357 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.464437 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.467748 17283 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:33.468696 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:33.391878 22163 raft_consensus.cc:740] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:33.470824 17284 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:33.346859 21968 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.469318 17286 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.469532 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.473718 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.474470 18015 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:33.475322 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.477237 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.487042 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.488257 17436 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:33.492743 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.493485 18006 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:33.426321 22089 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.493503 18008 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:33.498631 17436 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:33.506043 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.506395 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.507112 17365 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:33.510149 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.510864 17365 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:33.518015 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:33.518743 17361 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.522869 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.524870 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.506901 18008 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 7.
I20260709 12:11:33.523658 17367 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:33.557972 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:33.558861 18015 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.559150 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1870) took 1481 ms. Trace:
I20260709 12:11:33.559685 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.559561 17439 rpcz_store.cc:276] 0709 12:11:32.077879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.320943 (+243064us) service_pool.cc:224] Handling call
0709 12:11:32.325444 (+  4501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.417485 (+ 92041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:32.417523 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:32.417569 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:32.417608 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.558878 (+1141270us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b5400147dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:33.558930 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.559084 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211128064}
I20260709 12:11:33.573865 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:33.574565 17364 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:33.574895 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.572108 17981 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:33.590263 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:33.591503 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.592301 17435 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:33.471416 22135 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.604241 17361 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:33.575589 22015 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.608052 17981 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:33.606206 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.609233 17436 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:33.606137 17404 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.588250 21903 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:33.612692 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.613699 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.617086 17404 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.597889 22172 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.610953 21997 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.645627 22143 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.645049 22059 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.645923 22169 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.673270 22143 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.649421 22168 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.664548 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:33.676188 22143 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.652006 22141 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:33.679800 22177 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:11:33.662180 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 52809.5us
I20260709 12:11:33.718025 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:33.691947 22168 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.719352 22168 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.673764 22059 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.651728 22035 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.652383 21812 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.613473 22120 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.693399 17332 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:33.660503 22175 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.645556 21876 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.603066 22160 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:11:33.585896 22163 consensus_queue.cc:260] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.719669 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:33.614145 22015 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.722978 22059 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.694763 22037 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.736603 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.695968 22006 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.692065 21668 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.739714 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:33.746326 22174 log.cc:927] Time spent T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:33.652086 22172 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.671500 21997 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.750891 17361 raft_consensus.cc:1240] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:33.755537 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.740382 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:33.761277 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.762979 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.759358 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.741780 17980 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:33.723316 22165 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:33.729916 22035 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.774567 17364 raft_consensus.cc:2468] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 6.
I20260709 12:11:33.782979 21975 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.760504 21903 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.748481 22003 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:33.684067 22169 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.722188 22141 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.791373 17404 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:33.794729 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 58200.3us
I20260709 12:11:33.805142 17333 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.772904 22085 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:33.758812 21640 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:33.801205 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.730497 22105 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.773289 22163 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:33.803603 22176 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:11:33.771513 22037 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.881361 22037 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.882018 22008 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:33.882606 22008 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.884800 22008 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.885298 22008 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.886538 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:33.887228 17439 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:33.809176 17285 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:11:33.887097 22180 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 12:11:33.888761 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.809433 22141 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.890772 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.891148 21640 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.892194 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.892793 17291 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:33.893558 21640 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.809748 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.777796 21968 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:33.810169 22170 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:11:33.810649 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.811524 21876 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.903990 22172 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.842320 22100 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.757164 22175 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.907641 22175 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.812470 22134 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.814667 22039 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.908537 22039 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:33.909006 22039 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.885717 22008 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.912402 22059 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.912909 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.747939 21812 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.881829 22040 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.914408 22040 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.914784 22040 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.915541 21812 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.815349 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.916769 22059 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.816833 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:33.918553 17363 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:33.919718 18013 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:33.918530 22008 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:33.916703 22183 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:33.924337 22105 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.824050 22050 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.825383 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.931516 17284 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:33.829281 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.829766 22135 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.832506 22171 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.777514 21668 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.797101 21975 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:33.835951 22169 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.836362 22003 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.837637 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.838323 22107 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:33.840534 21997 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.843971 18015 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:33.847002 17286 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:33.964615 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.925807 22039 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.965824 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:33.966307 22133 raft_consensus.cc:2764] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:33.967166 22039 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:33.854519 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.967895 17365 raft_consensus.cc:1240] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.967774 21946 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:33.968571 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:33.969311 17290 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:33.969486 17283 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:33.797276 21977 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:11:33.855955 22139 raft_consensus.cc:2804] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:33.971091 22139 raft_consensus.cc:697] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:33.972011 22139 consensus_queue.cc:237] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.856724 22085 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.957688 21975 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.974687 22085 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.796645 22165 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:33.976941 22165 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:33.862208 22178 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:11:33.864405 22015 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.867805 22168 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.980485 22168 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.982151 21668 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:33.982393 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:33.983104 17358 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.954311 22171 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.983846 22171 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.785076 22089 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:33.793831 22130 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:33.986703 22130 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:33.987694 22130 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:33.960073 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 154992us
I20260709 12:11:33.794559 22035 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.893611 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.890121 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:33.990061 22193 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:33.898728 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:33.920894 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:33.991794 17363 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.993513 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:33.798406 22120 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.994325 22120 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.994742 22120 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.995464 22040 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:33.957880 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.959000 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:33.990758 17285 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:33.870801 22143 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.001391 22143 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:33.959600 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 266286us
I20260709 12:11:34.003834 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:33.998175 22040 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:34.009099 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:34.009443 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:33.994326 22193 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:33.982684 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.009765 17366 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.005352 17332 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:34.010367 17360 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:33.967085 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.005867 17363 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:34.012275 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.016671 17332 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:34.022516 17364 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:33.957691 22163 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:34.027743 17332 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:34.029788 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:34.031309 17404 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:34.029631 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.008366 22134 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:34.034756 17365 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:33.972072 22003 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:34.011649 22193 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.012359 22143 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.039659 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:34.035418 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.052165 17359 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:34.021867 22040 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:34.053479 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 272845us
I20260709 12:11:34.046169 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:34.053289 17440 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:34.050623 22193 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:34.067497 17407 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:34.034631 22169 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.072569 17407 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:34.074869 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 45164.3us
I20260709 12:11:34.075685 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:34.078925 17362 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:34.079979 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:34.081022 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:34.053939 22003 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:34.056370 21946 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:34.083211 17365 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.084192 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:34.050715 22110 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:34.050855 22085 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:34.086560 17332 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:34.096199 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:34.086715 17366 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:34.087234 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.087559 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:34.088707 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:34.097046 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:34.097714 17436 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.089814 17358 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:34.098894 17333 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:34.099169 17363 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.097096 17365 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
W20260709 12:11:34.090565 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 348834us
I20260709 12:11:34.085011 22134 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.076169 22125 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.091537 22135 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.091650 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:34.072114 22089 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.036629 22163 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.036311 22165 consensus_queue.cc:1059] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:34.081588 22187 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:34.103082 17332 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:34.076207 22040 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:34.057152 22143 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.008406 17185 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 6 to 7, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 7 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:34.079210 21956 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:34.113736 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.151207 18014 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:34.152266 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.120532 18013 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:11:34.153177 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.153575 18013 pending_rounds.cc:85] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 9
I20260709 12:11:34.123768 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:34.126521 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.120437 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.153857 18013 pending_rounds.cc:107] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:11:34.104168 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.106529 17978 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:34.156219 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 49781.9us
I20260709 12:11:34.103789 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.157222 17358 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 11: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:34.154409 17441 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:34.113175 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.132822 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.138782 17365 raft_consensus.cc:1240] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:34.122177 22134 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.139683 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.154914 18013 raft_consensus.cc:2889] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:34.156446 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.101181 22125 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:34.158942 18008 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:34.120894 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.158043 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:34.161564 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.153813 18006 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:34.162644 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.163710 17436 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:34.163975 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.165122 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.161032 18007 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:34.166731 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.166673 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.101409 21997 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:34.170666 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 67641.6us
I20260709 12:11:34.174389 17332 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:34.171597 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 72767.6us
I20260709 12:11:34.166152 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.123942 22169 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.167245 17258 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:34.111891 21812 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:34.175947 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 88471.5us
I20260709 12:11:34.171550 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:34.180981 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:34.184949 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:34.185112 22135 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.185870 22135 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.186270 22135 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:34.186394 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:34.186683 22135 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.186784 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.199544 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.210471 18015 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:34.210817 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.203946 21342 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.086395 22168 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:11:34.204223 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:34.115571 22107 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:34.085543 22003 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.172742 22172 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:34.111274 22085 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.157647 21956 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:34.173125 22059 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.234401 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.235046 17288 raft_consensus.cc:2376] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11. Re-sending same reply.
I20260709 12:11:34.183120 22175 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.209344 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:34.224385 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.121145 22089 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.199631 22039 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.208576 21749 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:34.094866 21946 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.229692 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.233677 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:34.220229 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:34.221243 22105 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.150976 22187 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.176604 22186 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:34.245873 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.249708 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.250074 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.158082 22171 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:34.278270 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 134533us
I20260709 12:11:34.231758 22172 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:34.257764 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 48534.3us
I20260709 12:11:34.234694 22059 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:34.278038 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.279381 17285 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:34.212545 21342 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:34.279104 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:34.235123 21956 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.291477 21342 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.243482 22134 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.284623 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.245922 18012 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:34.257169 21749 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.219092 21812 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.219309 22135 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.287156 17978 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:34.261446 22015 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.231164 22107 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.279640 22141 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.272848 22105 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:34.243189 21999 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:11:34.303983 17404 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:34.349045 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 45162us
I20260709 12:11:34.246515 21640 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:11:34.285234 22172 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.299649 17367 raft_consensus.cc:2368] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
I20260709 12:11:34.292897 22059 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.333806 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.300850 21749 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:34.348068 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 263920us
W20260709 12:11:34.355602 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 65109.7us
I20260709 12:11:34.366729 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:34.357167 21342 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.292598 22037 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:34.366991 17980 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:34.369655 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 112493us
I20260709 12:11:34.332360 22125 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.298849 21903 consensus_queue.cc:1059] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:11:34.333690 22141 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:34.350008 22105 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.261368 22040 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.301628 22134 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.377477 17367 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:34.385721 21342 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.356987 22015 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.373767 17436 raft_consensus.cc:1240] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:34.394917 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:34.395727 21342 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:34.396246 21342 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.396659 21342 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.328809 22139 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:11:34.382912 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:34.395867 17333 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:34.305933 22191 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 12:11:34.397966 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 110881us
I20260709 12:11:34.397828 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.400039 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.426510 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.380981 22141 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.428791 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:34.373674 22008 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:34.436179 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:34.439343 17367 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:34.439561 21342 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.440476 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:34.441602 17359 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:34.383802 22190 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.446597 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.394501 22015 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:34.425089 22143 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:34.400267 22205 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.401535 22163 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.428403 22186 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.452399 21946 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.454373 22003 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:34.399734 22207 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:34.457026 22171 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:34.458070 22107 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:34.461526 22193 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:34.462646 22201 log.cc:927] Time spent T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:11:34.400992 21975 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:34.476894 22195 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:11:34.479594 21956 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.480938 22059 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:34.448902 22197 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:11:34.497020 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.501153 22085 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:34.473524 22015 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:34.500732 22050 consensus_meta.cc:287] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.003s
I20260709 12:11:34.509336 22207 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:34.504071 22186 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:34.509932 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.543195 17367 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
W20260709 12:11:34.504037 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 321193us
I20260709 12:11:34.501813 22135 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:34.546988 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 330753us
I20260709 12:11:34.513298 22105 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.515201 17363 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:34.516230 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.516870 21975 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:34.517388 17284 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:34.504187 22208 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:34.508086 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.556077 17365 raft_consensus.cc:2410] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:34.507382 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.474545 21342 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:34.535168 17366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:34.557229 17366 raft_consensus.cc:606] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:34.557597 17366 raft_consensus.cc:614] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:34.497289 22089 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.538885 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:34.538980 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 125990us
I20260709 12:11:34.539759 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:34.540879 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:34.526443 21946 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:34.545928 17441 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:34.512158 22134 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.551698 18011 raft_consensus.cc:2410] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:34.551627 17406 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:34.518384 22110 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:34.500365 22205 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.506321 22143 consensus_queue.cc:1059] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:11:34.540093 22187 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:34.564222 22120 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.001s
I20260709 12:11:34.518980 22163 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:34.567600 21342 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:34.577621 21342 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.574014 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:34.563328 21812 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:34.586709 17366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:34.601876 17366 raft_consensus.cc:606] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:34.602252 17366 raft_consensus.cc:614] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:34.604759 22130 raft_consensus.cc:3055] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.605249 22130 raft_consensus.cc:740] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:34.608655 22186 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.619071 21956 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.620389 22059 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.620976 22220 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:34.621431 22220 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:34.621778 22220 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.622499 22110 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.626667 22105 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:34.595866 22205 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:34.595821 22196 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
W20260709 12:11:34.630692 22035 consensus_meta.cc:287] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.002s
I20260709 12:11:34.631289 21876 raft_consensus.cc:3055] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:34.631134 22035 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.631670 21876 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:34.632253 17438 raft_consensus.cc:2368] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9.
I20260709 12:11:34.632539 21876 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.633394 22193 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.577034 22163 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:34.634264 22163 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.606055 22130 consensus_queue.cc:260] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.570688 21423 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:34.638315 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.638145 17366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:34.646435 21342 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.561154 22008 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:34.584848 22210 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:34.659617 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:34.660166 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.661420 17360 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:34.662034 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.662582 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.663228 17360 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:34.664747 17367 raft_consensus.cc:1275] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:34.571331 22159 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:34.563385 22208 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.666509 22141 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.667851 22208 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.635599 22130 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:34.669739 18011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 993) took 2127 ms (client timeout 1897 ms). Trace:
I20260709 12:11:34.633955 21876 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.580988 22120 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.661514 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.668669 22141 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.674582 17366 raft_consensus.cc:606] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:34.675518 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 237186us
I20260709 12:11:34.582792 22217 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:34.675490 18011 rpcz_store.cc:269] 0709 12:11:32.542729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.542833 (+   104us) service_pool.cc:224] Handling call
0709 12:11:34.669510 (+2126677us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b5400152054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:34.669639 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4611554048}
I20260709 12:11:34.617731 22172 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.686159 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:34.691434 17361 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:34.691941 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:34.693157 22035 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:34.686919 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:34.672343 22160 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.699376 18015 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:34.703869 17433 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:34.714561 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:34.651013 21423 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:34.687894 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:34.981547 17436 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:34.688293 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:34.982707 17434 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:34.689833 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:34.984230 17437 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:34.699328 22160 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:34.679100 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 131314us
W20260709 12:11:34.687669 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 138456us
I20260709 12:11:34.597483 22207 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.723407 22008 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:34.971421 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:35.035104 17441 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.976684 22217 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:34.977267 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 296560us
I20260709 12:11:34.976789 22035 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:11:34.970415 22133 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:34.974069 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:35.108283 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:35.120054 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 146234us
W20260709 12:11:35.035120 21749 consensus_meta.cc:287] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.004s
I20260709 12:11:35.034915 22050 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.139621 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:35.140923 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:35.034300 22141 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:35.149721 17434 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:35.126890 21967 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:35.161324 17981 leader_election.cc:400] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9.
I20260709 12:11:35.147315 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:35.109578 22133 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:35.164659 17438 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:35.132791 22200 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.163841 17981 leader_election.cc:403] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:35.317732 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 156541us
I20260709 12:11:35.160915 21967 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:35.158601 22141 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.138605 21749 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:35.119004 22217 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.137820 22050 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:35.240113 22089 consensus_queue.cc:1059] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:35.320653 22200 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:35.330459 22050 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.332180 22200 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:35.155642 22198 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 12:11:35.219417 21757 consensus_queue.cc:1059] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:11:35.110927 22220 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:35.269764 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 113126us
W20260709 12:11:35.300506 22229 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.193s	user 0.001s	sys 0.005s
I20260709 12:11:35.300770 22172 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:35.297900 21876 consensus_meta.cc:287] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.006s
W20260709 12:11:35.297322 22163 consensus_meta.cc:287] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.663s	user 0.003s	sys 0.014s
I20260709 12:11:35.302418 21903 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:35.296020 22120 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:35.301613 22133 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.342665 17435 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.345952 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:35.299430 22130 consensus_meta.cc:287] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.017s
I20260709 12:11:35.217332 22160 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:35.298353 22015 consensus_meta.cc:287] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.751s	user 0.013s	sys 0.003s
I20260709 12:11:35.299930 17441 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
W20260709 12:11:35.307699 17979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.007s	sys 0.011s
I20260709 12:11:35.121484 17404 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:35.352792 17979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.007s	sys 0.011s
W20260709 12:11:35.353094 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 231670us
W20260709 12:11:35.202226 17978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.039s	sys 0.039s
W20260709 12:11:35.354336 17978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.039s	sys 0.051s
I20260709 12:11:35.137511 22165 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:35.162343 22143 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:35.360425 22143 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:35.360841 22143 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.361172 22143 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.362324 21876 consensus_queue.cc:1048] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:35.325985 22141 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:35.365761 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:35.339529 22163 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.366590 17366 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.330071 22089 raft_consensus.cc:3055] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:35.261775 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.319682 22191 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.370370 17333 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:35.347064 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.371718 22059 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:35.372536 22198 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:35.373049 22198 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:35.370038 22089 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:35.350695 21342 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.375437 21342 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.375627 22089 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:35.377445 21342 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:35.349210 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.348444 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.359196 22165 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:35.365939 22160 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.380584 22165 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:35.342281 21757 consensus_queue.cc:1243] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer e860f7e876b74ec589f447737822a4f6 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:35.384860 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:35.239600 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 128980us
I20260709 12:11:35.369275 17361 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:35.322773 17981 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:35.372277 22059 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.374404 22141 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:35.355119 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 914640us
I20260709 12:11:35.323225 21967 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.388244 17366 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:35.390566 21342 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:35.407975 21342 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:35.408823 21342 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.393669 17434 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.357657 22015 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.411316 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:35.412074 17441 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:35.394058 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 423673us
I20260709 12:11:35.394027 17332 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:35.395104 17438 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:35.397002 17978 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:35.389832 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:35.401583 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.394827 22159 consensus_queue.cc:1059] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:11:35.396374 22189 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:35.405714 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:35.415555 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:35.373517 22107 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:35.418576 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:35.418992 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:35.432608 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:35.412005 18011 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:35.420075 17436 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:35.420955 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 98280.4us
I20260709 12:11:35.422473 17435 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:35.424784 17363 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:35.425474 17332 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:35.426286 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:35.428565 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:35.434721 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:35.435799 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:35.436419 18008 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:35.438732 18015 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:35.440683 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:35.441679 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.442606 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:35.442651 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:35.442428 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:35.444280 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 54551.8us
I20260709 12:11:35.448908 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:35.450182 17438 raft_consensus.cc:2368] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
I20260709 12:11:35.450704 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:35.452034 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:35.453166 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:35.456693 17404 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:35.458246 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:35.458703 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:35.459380 18006 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:35.462330 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.463078 17290 raft_consensus.cc:2468] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:35.464352 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.464593 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:35.465009 17290 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:35.466312 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.467077 17285 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:35.467278 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.438933 22141 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:35.469056 22141 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:35.469213 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 43833us
I20260709 12:11:35.439252 21812 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:35.470417 21812 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:35.470820 21812 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.471288 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:35.472163 18012 raft_consensus.cc:2410] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:35.472934 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:35.431227 22220 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:35.423399 22230 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.475366 17283 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:35.477363 22198 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:35.479648 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:35.424459 22189 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:35.480576 17359 raft_consensus.cc:2368] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
I20260709 12:11:35.474130 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:35.470033 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:35.496315 17438 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.430423 22130 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:35.508949 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.509634 17286 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.444288 22172 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:35.500870 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:35.435271 22191 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9.
I20260709 12:11:35.499971 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.521775 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.523877 17288 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
W20260709 12:11:35.464265 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 330550us
I20260709 12:11:35.506860 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.507321 22217 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:35.429888 22107 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:35.488701 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:35.524077 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 67471.6us
I20260709 12:11:35.474175 22193 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:35.524629 17285 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:35.532868 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:35.480398 22037 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.530725 22171 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:35.537856 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 57689us
I20260709 12:11:35.538962 18008 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:35.612224 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:35.494616 22163 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:35.500600 21956 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:35.493428 21876 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.610677 17433 raft_consensus.cc:2368] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 15. Current term is 16.
I20260709 12:11:35.610808 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 1004) took 1425 ms. Trace:
I20260709 12:11:35.611014 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.630841 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:35.521404 21749 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:35.633940 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:35.615119 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 145126us
I20260709 12:11:35.636776 18015 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:11:35.608310 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.612107 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 77623us
I20260709 12:11:35.494261 22189 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.620867 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.640550 17285 raft_consensus.cc:2368] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
I20260709 12:11:35.621299 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:35.621646 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 77905.4us
I20260709 12:11:35.640733 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.642012 18008 raft_consensus.cc:2410] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:35.642268 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.636740 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:35.616902 17286 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
W20260709 12:11:35.620743 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:35.510188 22159 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:35.637877 17404 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:35.646878 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.611382 22200 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:35.654772 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:35.656056 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:35.656816 18008 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:35.658393 17255 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:35.628674 18010 rpcz_store.cc:276] 0709 12:11:34.113692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.120695 (+  7003us) service_pool.cc:224] Handling call
0709 12:11:34.120996 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.250664 (+129668us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:34.358966 (+108302us) log.cc:844] Serialized 14 byte log entry
0709 12:11:35.145640 (+786674us) log.cc:844] Serialized 14 byte log entry
0709 12:11:35.145939 (+   299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:35.145986 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:35.146030 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.331538 (+185508us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b180024f5e0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a2e522 00007f1222a307c1 00007f1222a30779 00007f1222a30709 00007f1222a306d1 00007f1222a2f9cd 0000000000388634 0000000000388479 00007f1222a1183a
0709 12:11:35.539019 (+207481us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540061a154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:35.539089 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.539205 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234591,"prepare.queue_time_us":130260,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":7010,"raft.queue_time_us":264277,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":6408,"spinlock_wait_cycles":304519168,"thread_start_us":618050,"threads_started":3,"wal-append.queue_time_us":200966}
I20260709 12:11:35.661360 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.662557 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.536048 22172 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:35.533089 22135 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.637750 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:35.645313 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 191462us
I20260709 12:11:35.652552 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:35.663317 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.688081 17285 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
W20260709 12:11:35.687892 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 50213.6us
I20260709 12:11:35.652352 22130 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:35.662550 17288 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:35.493755 22035 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 12:11:35.673888 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:35.695600 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.668780 21956 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:35.646391 22165 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.680922 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.680933 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:35.681939 21342 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:35.678125 17255 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:35.689116 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.664009 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:35.689461 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:35.690296 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:35.688398 22172 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:35.654698 22193 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:35.621659 22171 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.696928 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.618669 22191 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:35.699347 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 46876.2us
I20260709 12:11:35.708458 18008 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:35.753125 18010 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:35.762269 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.744550 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:35.680706 21975 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:35.770390 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.771061 17288 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.758787 21342 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:35.764281 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 74871.2us
I20260709 12:11:35.702401 21956 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.666831 22248 consensus_queue.cc:1059] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 12:11:35.767678 22171 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:35.674840 22252 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:35.681478 22186 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:35.666929 22159 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:35.687803 22200 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:35.794529 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:35.944713 17286 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:35.707711 22103 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:35.704594 22130 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.684365 22045 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:11:35.763355 17285 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:35.805320 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.023648 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:35.673527 22107 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.768676 22135 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.941910 21342 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.090469 21342 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:35.941138 17288 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:35.806121 21956 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.805505 21975 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.712759 22050 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.811570 21749 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:35.801921 22213 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.236s
I20260709 12:11:35.810621 22252 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:36.124265 22252 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.124871 22200 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:35.941048 22171 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.943864 22186 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.102906 17285 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.806157 22165 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.286s
I20260709 12:11:35.782310 22191 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.114657 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.128765 17439 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:36.093549 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 292564us
W20260709 12:11:36.132740 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 388223us
I20260709 12:11:36.099784 17283 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.134868 17288 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 4 to 10, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:11:36.142457 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.144232 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.124364 22159 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.144835 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:36.130410 22059 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.155926 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.195606 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.235502 17292 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:36.108552 22193 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.144829 22266 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:36.168846 21975 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.169528 22221 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.164090 22171 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:36.246115 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 568034us
I20260709 12:11:36.227226 21749 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.173110 22059 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.272828 22059 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.252281 22266 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.262863 21423 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.264555 22186 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.267719 22050 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:36.231259 22239 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.270036 22135 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:36.262765 22259 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:11:36.271351 22130 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.271975 22171 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:36.276871 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 132819us
W20260709 12:11:36.273355 22143 consensus_meta.cc:287] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.912s	user 0.010s	sys 0.001s
I20260709 12:11:36.279668 17283 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
W20260709 12:11:36.287220 17361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.007s	sys 0.010s
W20260709 12:11:36.298694 17361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.008s	sys 0.010s
W20260709 12:11:36.292464 17436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.013s	sys 0.005s
W20260709 12:11:36.300148 17436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.013s	sys 0.005s
W20260709 12:11:36.301000 17290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.012s	sys 0.010s
W20260709 12:11:36.301787 17290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.012s	sys 0.010s
W20260709 12:11:36.295344 22224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.010s	sys 0.009s
W20260709 12:11:36.308171 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 203102us
I20260709 12:11:36.310282 17255 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.312135 17255 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:36.305493 22224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.010s	sys 0.009s
I20260709 12:11:36.303412 22059 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.294145 22237 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:11:36.282593 22221 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:36.327003 22253 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:11:36.328245 22265 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:11:36.301343 22143 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.336032 22143 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.314256 22045 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.321408 22224 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:36.337044 22224 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.337441 22224 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.338936 22266 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.339367 22191 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.307163 22135 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:11:36.341794 22221 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:36.337057 22045 consensus_queue.cc:1059] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:11:36.342996 22237 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.343264 21975 raft_consensus.cc:3055] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:36.343644 21975 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:36.344511 21975 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:36.336304 21967 consensus_meta.cc:287] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.930s	user 0.010s	sys 0.000s
I20260709 12:11:36.346341 21967 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:36.347340 22245 log.cc:927] Time spent T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:11:36.348596 22237 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:36.348886 17291 raft_consensus.cc:2393] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:36.317179 22270 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:36.349697 22270 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.352247 22270 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.348351 22267 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:11:36.348423 21967 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.355036 21967 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:36.355175 22237 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.355715 21967 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:36.356518 22237 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.348454 22171 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.359124 22135 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:36.359519 22135 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:36.360406 22135 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:36.362133 21812 consensus_meta.cc:287] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.891s	user 0.005s	sys 0.005s
I20260709 12:11:36.362643 21812 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.352512 22252 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.370329 17285 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:36.371068 22160 consensus_meta.cc:287] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.992s	user 0.010s	sys 0.000s
I20260709 12:11:36.371265 22103 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:36.371927 22103 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.371937 17284 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:36.357623 21967 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.375909 22103 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.389267 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.391213 21812 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.397712 22266 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:36.403482 22266 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.404402 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.405731 22266 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.399722 22103 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:36.402020 22171 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.407833 22171 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:36.408816 22189 consensus_meta.cc:287] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.001s
I20260709 12:11:36.409268 22189 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.410722 22252 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:36.411391 22272 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.072s	user 0.000s	sys 0.002s
I20260709 12:11:36.402554 22281 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.412496 22281 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.413231 22224 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.398376 22270 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:36.414913 22270 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.415940 22224 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.419142 22248 raft_consensus.cc:3055] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:36.419608 22248 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:36.420025 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:36.420680 22171 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.420429 22248 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.419019 22103 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.380967 21956 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.411919 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2902) took 1043 ms. Trace:
I20260709 12:11:36.426417 17364 rpcz_store.cc:276] 0709 12:11:35.368360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.369677 (+  1317us) service_pool.cc:224] Handling call
0709 12:11:35.370052 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:35.387693 (+ 17641us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:35.387722 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:35.406410 (+ 18688us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.512606 (+106196us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:35.512652 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.512716 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.411673 (+898957us) raft_consensus.cc:1685] finished
0709 12:11:36.411694 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.411847 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15806,"raft.queue_time_us":17304,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":105807,"threads_started":1,"wal-append.queue_time_us":681187}
I20260709 12:11:36.435005 22240 raft_consensus.cc:3055] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:36.435531 22240 raft_consensus.cc:740] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:36.435968 21956 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:36.400578 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 86001.3us
I20260709 12:11:36.421649 22248 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.436440 22240 consensus_queue.cc:260] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.422431 22270 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.411491 22189 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.438059 17185 catalog_manager.cc:5697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 2 to 10, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 10 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:36.441152 22260 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.178s	user 0.000s	sys 0.003s
I20260709 12:11:36.441612 17366 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:36.442399 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:36.443467 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:36.444054 22226 raft_consensus.cc:3055] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:36.423838 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:36.445343 22050 raft_consensus.cc:3055] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.445772 22050 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:36.440570 17185 catalog_manager.cc:5697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.446759 22050 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.447800 22287 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:36.447878 22050 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.450126 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2785) took 1009 ms. Trace:
I20260709 12:11:36.450629 17291 rpcz_store.cc:276] 0709 12:11:35.440498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.441456 (+   958us) service_pool.cc:224] Handling call
0709 12:11:36.449855 (+1008399us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54001b6a54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:36.450027 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082406144}
W20260709 12:11:36.412670 22172 consensus_meta.cc:287] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.004s
I20260709 12:11:36.455081 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:36.402770 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 2904) took 1007 ms. Trace:
I20260709 12:11:36.455865 17364 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:36.456359 18012 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.414852 22281 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.442308 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:36.458014 17358 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:11:36.436699 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 121657us
I20260709 12:11:36.459594 22221 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.444478 22226 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:36.460170 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:36.460711 22172 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:36.461757 22258 log.cc:927] Time spent T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 12:11:36.438036 22240 raft_consensus.cc:3060] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:36.463061 17404 leader_election.cc:400] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
I20260709 12:11:36.456084 17361 rpcz_store.cc:276] 0709 12:11:35.395198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.397175 (+  1977us) service_pool.cc:224] Handling call
0709 12:11:35.397555 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:35.418122 (+ 20567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.418153 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:35.440764 (+ 22611us) log.cc:844] Serialized 52 byte log entry
0709 12:11:36.303930 (+863166us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:36.316308 (+ 12378us) log.cc:844] Serialized 14 byte log entry
0709 12:11:36.402374 (+ 86066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.402485 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.402537 (+    52us) raft_consensus.cc:1685] finished
0709 12:11:36.402552 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.402699 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11973,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":36322,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":209,"spinlock_wait_cycles":163072,"thread_start_us":847363,"threads_started":2,"wal-append.queue_time_us":828393}
I20260709 12:11:36.465548 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.508129 17406 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:36.507969 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:36.508164 17404 leader_election.cc:403] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:11:36.474922 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 160233us
I20260709 12:11:36.461611 21967 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.493834 17363 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.495050 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:36.509765 17332 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:36.512322 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 56485.2us
W20260709 12:11:36.513211 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.514376 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:36.503638 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:36.515007 17436 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:36.515259 17437 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.517580 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:36.518322 17438 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:36.521029 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.522795 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:36.506887 18012 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:36.509431 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:36.524561 17406 leader_election.cc:400] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
I20260709 12:11:36.525321 22281 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.526453 22220 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.526995 22220 raft_consensus.cc:697] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:36.527880 22220 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.509651 17255 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.510201 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.531004 18009 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:36.531239 22059 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10.
I20260709 12:11:36.530428 22226 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.532122 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.532681 22226 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.499076 22221 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.533663 17258 leader_election.cc:400] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
I20260709 12:11:36.533998 17258 leader_election.cc:403] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:36.499457 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:36.535717 17433 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:36.536217 18013 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:36.536677 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.535183 22221 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:36.458642 22287 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.542523 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.531177 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:36.543994 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.544377 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.544677 17286 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:36.510854 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.546031 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:36.546520 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.544276 18011 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:36.547279 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:36.547955 17433 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:36.550962 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.549942 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:36.556540 17432 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:36.552219 17286 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:36.553195 17407 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:36.553315 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:36.561221 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 51655.1us
I20260709 12:11:36.552052 22285 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
I20260709 12:11:36.564498 22172 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:36.543514 22207 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.579733 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:36.580471 17366 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:36.565685 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:36.566937 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2789) took 1110 ms. Trace:
I20260709 12:11:36.524501 22143 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:11:36.513329 22270 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.570427 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:36.570662 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:36.571516 17364 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:36.571838 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:36.588766 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:36.571516 17438 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:36.554879 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.598045 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:36.599009 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:36.574075 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:36.553932 17363 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:36.575037 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.577323 21342 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:36.556697 22287 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.554946 22221 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.587018 22217 consensus_queue.cc:1059] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:36.588466 17437 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:36.589841 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.596953 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:36.572504 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:36.611657 17361 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.572306 22160 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.552845 22171 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.615582 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:36.615852 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:36.617224 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.630327 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:36.633965 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.634790 18013 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:36.580104 22207 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.618441 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:36.620764 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 45820.6us
I20260709 12:11:36.625509 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.588290 22059 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:36.580888 22189 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:36.581662 17289 rpcz_store.cc:276] 0709 12:11:35.441799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.441912 (+   113us) service_pool.cc:224] Handling call
0709 12:11:35.466445 (+ 24533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:35.498905 (+ 32460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.498941 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:35.511842 (+ 12901us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.689902 (+178060us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:36.167062 (+477160us) log.cc:844] Serialized 14 byte log entry
0709 12:11:36.167455 (+   393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.167569 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.461139 (+293570us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:36.543514 (+ 82375us) raft_consensus.cc:1685] finished
0709 12:11:36.552447 (+  8933us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.552583 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2955,"prepare.queue_time_us":255350,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3927,"raft.queue_time_us":41060,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":55072,"spinlock_wait_cycles":6672640,"thread_start_us":475488,"threads_started":3,"wal-append.queue_time_us":490428}
I20260709 12:11:36.630370 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:36.643752 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.647200 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.645265 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:36.653941 17361 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:36.610009 22008 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.659240 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:36.663470 17406 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:36.659749 17332 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.609834 22222 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.665267 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.666932 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.669668 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:36.613994 22288 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:36.627668 22285 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:36.672515 17435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 2039) took 1986 ms (client timeout 1720 ms). Trace:
W20260709 12:11:36.676426 17435 rpcz_store.cc:269] 0709 12:11:34.686185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.686314 (+   129us) service_pool.cc:224] Handling call
0709 12:11:36.672248 (+1985934us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b540006d954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:36.672436 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495064320}
I20260709 12:11:36.676865 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:36.655242 22207 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.685039 22189 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.610177 22255 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:11:36.604386 22270 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.687799 22218 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.688691 22218 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.697640 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:36.699236 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.638993 22040 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.683210 17363 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:36.702428 17286 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:36.693661 22015 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:36.704324 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:36.706286 17332 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:36.662549 22008 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.727160 17332 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:36.675735 22252 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.668684 22222 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:36.663136 22261 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:11:36.680486 22237 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.668489 22059 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:36.703269 22040 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.702956 22159 raft_consensus.cc:2764] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:36.710217 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.735121 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:36.728933 22252 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:36.724989 22286 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.733037 22171 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.743726 17364 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:11:36.744575 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.678763 22288 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.731750 22287 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.730268 22008 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.746570 17364 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:36.748206 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:36.718290 22279 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.732579 22222 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.729135 22276 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.753492 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:36.782052 17366 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:36.782472 17362 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.781754 17289 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 15: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:36.784523 17358 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:36.739205 22040 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.785651 22276 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.744011 22252 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.780344 22248 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:36.794950 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 131558us
W20260709 12:11:36.796236 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 165953us
I20260709 12:11:36.798753 17255 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.830399 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:36.739388 22237 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.833045 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:36.843500 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.847838 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 245608us
I20260709 12:11:36.851523 17333 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.857667 17362 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:36.850069 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:36.862911 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.864285 17333 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:36.800531 21749 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:36.865837 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 266131us
I20260709 12:11:36.829843 22220 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.870653 21968 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:36.872141 21956 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.878881 22306 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:11:36.880976 22308 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.903168 22308 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:36.903543 22308 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.832291 22226 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:11:36.909487 17291 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:36.873919 17290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2797) took 1390 ms. Trace:
I20260709 12:11:36.847177 22238 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:36.875224 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.913322 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:36.890143 21749 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:36.877760 17363 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:36.861676 22255 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.894873 21956 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:36.915087 22255 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:36.915184 21956 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.915540 22255 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.916390 22159 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.870688 22134 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.916926 22159 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.898195 22237 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.894896 22270 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.909518 21968 raft_consensus.cc:697] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:36.908635 22304 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:36.921540 17283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 1988) took 1389 ms (client timeout 1579 ms). Trace:
I20260709 12:11:36.913029 17290 rpcz_store.cc:276] 0709 12:11:35.483374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.487061 (+  3687us) service_pool.cc:224] Handling call
0709 12:11:35.487356 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.302215 (+814859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.302248 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.308776 (+  6528us) log.cc:844] Serialized 26 byte log entry
0709 12:11:36.754658 (+445882us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:36.754694 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.754764 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.873662 (+118898us) raft_consensus.cc:1685] finished
0709 12:11:36.873690 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.873848 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20254,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":55,"thread_start_us":1131356,"threads_started":2,"wal-append.queue_time_us":489453}
I20260709 12:11:36.912532 17404 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:36.792599 22279 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.925192 17292 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
W20260709 12:11:36.921937 17283 rpcz_store.cc:269] 0709 12:11:35.534588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.611226 (+ 76638us) service_pool.cc:224] Handling call
0709 12:11:36.921371 (+1310145us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54003faf54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:36.921480 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058237696}
I20260709 12:11:36.927027 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.929345 22304 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.929831 22304 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.929934 21749 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:36.930297 22304 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.920883 21968 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.934235 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:36.863492 22059 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.934986 17290 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:36.887236 22276 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.919106 22159 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.939577 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:36.938921 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:36.943172 22218 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.943948 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:36.946218 22232 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 1.643s	user 0.006s	sys 0.007s
W20260709 12:11:36.946590 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.947983 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 904) took 2772 ms. Trace:
I20260709 12:11:36.948364 17440 rpcz_store.cc:276] 0709 12:11:34.175538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.178188 (+  2650us) service_pool.cc:224] Handling call
0709 12:11:34.223431 (+ 45243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.298772 (+ 75341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.298804 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.634791 (+335987us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b2c0015be28. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:11:34.635264 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.125150 (+489886us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:35.422376 (+297226us) log.cc:844] Serialized 14 byte log entry
0709 12:11:35.426806 (+  4430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.426947 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.945491 (+1518544us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:36.947749 (+  2258us) raft_consensus.cc:1685] finished
0709 12:11:36.947770 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.947909 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55335,"prepare.queue_time_us":397727,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":122172,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":19731,"spinlock_wait_cycles":28745344,"thread_start_us":833200,"threads_started":3,"wal-append.queue_time_us":667600}
I20260709 12:11:36.951174 22008 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.961572 22133 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.962705 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:36.958818 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.963980 17290 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:36.951996 22207 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.954839 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:36.958011 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.969436 17283 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:36.970556 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.940264 22252 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.964963 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.967003 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:36.984068 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:36.975244 21858 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:36.975965 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.958391 22224 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.989298 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.989298 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.992040 17290 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:36.993991 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.994925 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.995867 17283 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:36.996971 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:36.997373 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 1986) took 1470 ms. Trace:
I20260709 12:11:37.022900 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:37.023689 17290 raft_consensus.cc:3060] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.006031 17288 rpcz_store.cc:276] 0709 12:11:35.526888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.095527 (+568639us) service_pool.cc:224] Handling call
0709 12:11:36.095850 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.134702 (+ 38852us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:36.163558 (+ 28856us) log.cc:844] Serialized 14 byte log entry
0709 12:11:36.313305 (+149747us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:36.313355 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:36.313399 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.997131 (+683732us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b540043eed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:36.997181 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.997313 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5068,"raft.queue_time_us":15645,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":15774,"spinlock_wait_cycles":76229888,"thread_start_us":144232,"threads_started":1,"wal-append.queue_time_us":179922}
I20260709 12:11:37.084723 17288 raft_consensus.cc:1275] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:36.987152 22041 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.108701 22041 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:37.109280 22041 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:36.993000 22040 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.112615 22040 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.990581 22050 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.152370 17290 raft_consensus.cc:2468] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
W20260709 12:11:37.150597 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 319225us
I20260709 12:11:37.157213 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 910) took 1700 ms. Trace:
I20260709 12:11:36.997690 17283 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:37.153908 17290 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:37.157646 17360 rpcz_store.cc:276] 0709 12:11:35.450669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.450811 (+   142us) service_pool.cc:224] Handling call
0709 12:11:35.451125 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:35.481025 (+ 29900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.481057 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:35.481505 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.120430 (+1638925us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b18002c0140. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12256c34bc 00007f1222a1148b 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1
0709 12:11:37.120595 (+   165us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:37.120633 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.120706 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.120763 (+    57us) raft_consensus.cc:1685] finished
0709 12:11:37.120773 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.150997 (+ 30224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29528,"raft.queue_time_us":30379,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":10942,"spinlock_wait_cycles":13824768,"thread_start_us":24243,"threads_started":1,"wal-append.queue_time_us":459629}
I20260709 12:11:37.161681 17290 pending_rounds.cc:85] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 5
I20260709 12:11:37.156265 22200 raft_consensus.cc:3055] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:37.172631 22041 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:37.175107 22008 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:36.961483 22255 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:37.177395 22255 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:37.162177 17290 pending_rounds.cc:107] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:37.191534 17290 raft_consensus.cc:2889] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.119091 22040 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:36.995886 22224 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.162453 22200 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:37.202975 17283 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:37.203024 18006 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:37.208304 22230 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.195042 22160 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:11:37.189508 22222 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:37.204202 22040 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:37.250602 18015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 1004) took 1786 ms (client timeout 1653 ms). Trace:
W20260709 12:11:37.251080 18015 rpcz_store.cc:269] 0709 12:11:35.462139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.495629 (+ 33490us) service_pool.cc:224] Handling call
0709 12:11:37.248435 (+1752806us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x7b540023e6d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:37.248567 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183255296}
W20260709 12:11:37.261864 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.249459 22207 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:37.289130 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 366255us
I20260709 12:11:37.242434 22230 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:37.295459 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.296927 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 463925us
I20260709 12:11:37.287454 22279 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.293751 22252 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.254534 22200 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.323536 17404 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:37.322189 17406 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:37.302649 21956 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.329528 22319 raft_consensus.cc:2804] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:37.329912 22040 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.326756 22200 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:37.336460 22103 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:37.328792 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 342970us
I20260709 12:11:37.342536 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:37.343897 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:37.344554 17362 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 14: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:37.345989 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:37.346225 17360 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:37.346745 17362 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 13: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:37.347572 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:37.348075 17362 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:37.349934 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:37.350641 17364 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:37.351536 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:37.328835 22224 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.353281 17364 raft_consensus.cc:1240] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.358639 21956 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:37.360771 18006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 1008) took 1246 ms (client timeout 1658 ms). Trace:
I20260709 12:11:37.364742 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:37.364705 18006 rpcz_store.cc:269] 0709 12:11:36.114146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.114332 (+   186us) service_pool.cc:224] Handling call
0709 12:11:37.360601 (+1246269us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400631ad4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:37.360711 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436470144}
I20260709 12:11:37.325084 22008 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:11:37.348683 22319 raft_consensus.cc:697] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:37.368181 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:37.375157 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47248us
W20260709 12:11:37.376849 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 54779.1us
I20260709 12:11:37.379261 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:37.379601 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.379916 17367 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.381253 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:37.381388 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:37.382231 17364 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:37.383842 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:37.381856 22040 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:11:37.377857 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:37.391172 17978 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:37.391717 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:37.392438 18006 raft_consensus.cc:2393] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:37.393502 21858 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:37.393929 21858 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:37.386076 22303 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:37.394371 21858 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:37.394222 22100 consensus_queue.cc:1059] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:37.374552 22222 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:37.376159 22135 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.386278 17333 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:37.390201 17362 raft_consensus.cc:2468] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:11:37.395325 22050 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:37.408831 22230 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:37.411301 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:37.412055 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.397581 22281 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.416376 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:37.418774 17435 raft_consensus.cc:2376] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10. Re-sending same reply.
I20260709 12:11:37.414572 22040 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.423384 21956 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:37.423967 21956 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:37.424968 22317 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:37.425590 22252 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:37.428970 22308 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:11:37.432001 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.432723 17435 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:37.432840 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.433401 17434 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
W20260709 12:11:37.432966 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.434212 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.434746 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:37.435010 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:37.434334 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.416929 17333 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:37.432185 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.436244 17433 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:37.406075 22050 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:37.446895 17432 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:37.390617 22207 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:37.481971 22207 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.484263 22207 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.487102 21967 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:37.487560 21967 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:37.488379 21967 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.490422 22222 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:37.490986 22222 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.492950 22222 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.438581 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:37.495000 22143 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:37.495618 18009 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:37.496558 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:37.453733 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:37.429524 22308 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.476011 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:37.504146 17432 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.504348 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:37.451480 17283 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:37.477758 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.477881 17291 raft_consensus.cc:1240] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.479089 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:37.509547 17435 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:37.480301 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 63465.5us
I20260709 12:11:37.480823 22281 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.495585 22143 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.532773 22321 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:37.512217 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:37.513027 22313 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:37.513799 22050 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.519052 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:37.520943 17432 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:37.537748 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:37.538574 17283 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:37.536156 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:37.528175 21858 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.539650 22143 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.540172 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1904) took 2060 ms. Trace:
I20260709 12:11:37.540529 17439 rpcz_store.cc:276] 0709 12:11:35.479418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.479637 (+   219us) service_pool.cc:224] Handling call
0709 12:11:35.479925 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.143499 (+663574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.539943 (+1396444us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b540006d454. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:37.540115 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491683584}
I20260709 12:11:37.541230 21858 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:37.542129 22045 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.542558 22045 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:37.542977 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.543447 22045 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.544556 22045 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.545116 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.546422 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:37.547027 17406 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.662s (SENT)
I20260709 12:11:37.547775 17360 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 15: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:37.548707 17439 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:37.546974 17432 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.549242 17407 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:37.549955 22059 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:37.503352 22304 consensus_meta.cc:287] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.573s	user 0.004s	sys 0.008s
I20260709 12:11:37.546926 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.539180 17367 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:37.551890 17407 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:37.538885 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:37.557909 17432 raft_consensus.cc:2468] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:37.559015 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.556447 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:37.560655 22312 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.564235 17432 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:37.564291 22304 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:37.568871 22308 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.533547 22321 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.581467 17440 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:37.584580 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.585250 17439 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:37.585628 17440 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:37.550511 22303 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:37.554702 22281 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:37.588142 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.592319 17291 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:37.562517 22217 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.601699 22200 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:37.605446 22200 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.608750 22200 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.562341 22186 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:11:37.437463 22319 consensus_queue.cc:237] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:37.570359 22141 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:37.610692 22141 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:37.611462 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.611718 22141 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:37.614729 22304 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:37.614984 22281 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:37.563926 22059 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:37.615919 22281 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:37.617015 22059 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:37.602938 22217 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:37.617843 22217 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.619207 22308 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:37.620137 21956 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.621289 17361 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:37.632782 17361 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:37.622968 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.623673 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:37.636765 17360 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.624449 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:37.638657 17366 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:37.622352 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:37.640862 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2798) took 2152 ms. Trace:
I20260709 12:11:37.647826 17332 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:37.641256 17284 rpcz_store.cc:276] 0709 12:11:35.487991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.488094 (+   103us) service_pool.cc:224] Handling call
0709 12:11:35.522754 (+ 34660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.374014 (+851260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.640589 (+1266575us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b540007b054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:37.640769 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952144256}
I20260709 12:11:37.640172 17361 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:37.650660 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:37.649722 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:37.652621 17360 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.653656 17406 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:37.658420 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:37.661742 17433 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.661564 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:37.665784 17332 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:37.602365 22303 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.655766 22207 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.658489 22252 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.673410 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:37.669710 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:37.676860 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:37.661528 21956 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.679139 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 2000) took 1128 ms. Trace:
I20260709 12:11:37.650345 22308 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.680519 17289 rpcz_store.cc:276] 0709 12:11:36.550512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.709888 (+159376us) service_pool.cc:224] Handling call
0709 12:11:37.678941 (+969053us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b5400200dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:37.679084 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99081984}
I20260709 12:11:37.679718 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:37.686508 17437 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:37.686203 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:37.690495 17255 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:37.691155 17291 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:11:37.694092 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 301291us
I20260709 12:11:37.697566 17978 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:37.677958 22135 raft_consensus.cc:2764] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:37.683267 22059 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:37.704031 22059 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:37.704454 22059 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.686036 22040 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.700907 22045 consensus_queue.cc:1059] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:11:37.703446 22303 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.683372 22231 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:37.719996 21975 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.719802 22231 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.722967 22231 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:37.675897 22305 consensus_queue.cc:1048] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:11:37.687625 22304 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:37.715852 22163 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:37.677134 21968 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:11:37.681167 22160 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:11:37.722987 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2814) took 1174 ms. Trace:
I20260709 12:11:37.717360 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:37.726012 22304 raft_consensus.cc:697] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:37.700618 22207 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:11:37.721915 22288 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:37.752576 17286 rpcz_store.cc:276] 0709 12:11:36.548569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.666650 (+118081us) service_pool.cc:224] Handling call
0709 12:11:37.722806 (+1056156us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b540020f8d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:37.722932 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70357248}
I20260709 12:11:37.716861 22040 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:37.713208 22218 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:37.748040 22279 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:37.726624 22044 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
W20260709 12:11:37.800884 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 103414us
I20260709 12:11:37.817600 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:37.818504 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:37.816094 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:37.824270 18014 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
W20260709 12:11:37.825024 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 257341us
I20260709 12:11:37.817760 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:37.815874 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:37.749010 22135 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:11:37.795338 22143 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:37.828053 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:37.761041 22231 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.788179 22226 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:37.796973 22040 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.797338 22218 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:37.754297 22163 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.829970 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:37.840576 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:37.844624 18014 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.846791 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:37.850811 18012 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.852129 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:37.856112 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:37.857015 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:37.858180 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:37.864866 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.835158 22321 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:37.903223 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 73369.3us
W20260709 12:11:37.907152 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.796595 21903 consensus_queue.cc:1059] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:11:37.829326 22329 raft_consensus.cc:2804] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:11:37.904307 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 205767us
I20260709 12:11:37.918262 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:37.920161 17432 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:37.916692 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 58610.7us
W20260709 12:11:37.912391 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 146752us
I20260709 12:11:37.853332 22218 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:37.933496 17359 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
W20260709 12:11:37.940165 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.909878 22281 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.840297 22279 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.910372 22192 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:37.849042 22226 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:37.933427 22037 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.934260 22329 raft_consensus.cc:697] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:37.957746 17367 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.975694 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:37.976439 17365 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:37.987989 17364 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.988865 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:37.956956 22045 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:37.960309 22340 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:37.990940 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:37.960474 21968 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:37.987196 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 78337.5us
I20260709 12:11:37.992729 22045 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.988873 22238 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.995291 22045 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:37.995882 22336 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:11:37.997300 22326 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:11:37.997942 22328 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:37.989701 22285 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.002514 22285 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.003592 22239 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:38.004019 22239 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:38.004680 22285 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:37.988641 22287 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.006536 22226 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:38.008275 22238 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:38.008757 22238 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.009019 22308 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:37.960651 22192 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.991961 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:37.913689 22304 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.993049 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.015726 18011 raft_consensus.cc:2393] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:38.016917 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.016984 18010 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:38.002046 22325 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:11:37.988379 22339 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.041589 22059 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.982393 22037 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:37.994637 22340 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:37.974632 22281 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:11:38.037839 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.056118 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.037675 22333 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:11:38.046038 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:38.022882 22226 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:38.046702 17285 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
W20260709 12:11:38.033648 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 113011us
I20260709 12:11:38.062021 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:38.062579 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:38.011466 21968 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:38.008806 22279 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.032282 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.046702 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.055286 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:38.067008 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:38.079528 17406 leader_election.cc:336] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.707s (SENT)
I20260709 12:11:38.080036 17406 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:38.080348 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.067303 22192 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:38.067523 22226 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.074790 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.075361 18008 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:38.085289 17981 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:38.083184 18011 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:38.044317 22329 consensus_queue.cc:237] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.088202 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:38.004901 22239 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.075736 21968 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:38.094548 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:38.084242 22281 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:38.100018 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 143038us
I20260709 12:11:38.098757 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:38.099416 22017 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.093400 22133 raft_consensus.cc:2804] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:38.125461 17361 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:38.087754 22231 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.089705 22335 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.098677 22059 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.087992 21903 consensus_queue.cc:1059] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:11:38.132575 17407 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:38.100020 22281 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:38.103183 22192 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.137663 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.141500 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.126408 22235 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:38.127769 22239 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.126417 22345 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.125732 22252 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:38.147064 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:38.148428 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.155786 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:38.157430 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 235648us
I20260709 12:11:38.134464 22133 raft_consensus.cc:697] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:38.165779 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:38.143215 22281 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.179014 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:38.134286 22160 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:11:38.183542 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.180774 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:38.181449 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 84828.5us
I20260709 12:11:38.186352 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:38.186918 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:38.185734 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:38.188014 17291 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.189525 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.100445 22340 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:38.191699 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 59219.6us
I20260709 12:11:38.192322 17288 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 15: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:11:38.191037 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 50410.9us
I20260709 12:11:38.168828 22207 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.169312 22218 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.160065 22345 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.196678 22218 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.197028 22345 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.199093 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.199770 17292 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
W20260709 12:11:38.201591 22217 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.002s
I20260709 12:11:38.202306 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:38.202486 22226 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:38.202920 17292 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.207484 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:38.207563 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.209239 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:38.210431 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.212502 17365 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:38.163875 22339 consensus_queue.cc:1059] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:38.160032 22252 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.229127 17292 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:38.230314 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.231127 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.258634 17292 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
W20260709 12:11:38.260901 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 66315.5us
I20260709 12:11:38.229123 18010 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:38.262511 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.263175 18013 raft_consensus.cc:3055] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:38.263511 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 2158) took 1519 ms. Trace:
I20260709 12:11:38.264147 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:38.265028 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.270566 17288 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 15: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:38.181885 22343 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:11:38.273023 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.273701 17292 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:38.270370 17358 rpcz_store.cc:276] 0709 12:11:36.743824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.744058 (+   234us) service_pool.cc:224] Handling call
0709 12:11:36.783039 (+ 38981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.785037 (+  1998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.230744 (+1445707us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b5400242cd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:38.263452 (+ 32708us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923264}
I20260709 12:11:38.273694 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.270164 18013 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:38.275075 18010 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:38.275942 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:38.230073 21903 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.191891 22040 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.202065 22217 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.275488 18013 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.277889 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:38.278724 18015 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:38.279585 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:38.258134 22037 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:38.287748 18013 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:38.287022 22339 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.293279 17360 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:38.297045 22050 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.300320 17439 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:38.301368 22217 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:38.303939 22346 log.cc:927] Time spent T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:11:38.306174 22202 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.204340 22133 consensus_queue.cc:237] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.266855 22360 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:38.311157 17289 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:38.286862 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:38.312285 17291 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:38.314996 22368 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 12:11:38.285781 22352 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:11:38.341692 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.342965 22339 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.297246 18013 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:38.329051 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:38.345731 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 76837.6us
I20260709 12:11:38.346930 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:38.347790 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 49661.1us
I20260709 12:11:38.350711 17332 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:38.353420 22357 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.354087 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:38.354022 22357 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.355124 17332 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:38.356112 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:38.359036 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 97014.4us
I20260709 12:11:38.372684 22107 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.371089 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:38.350579 22279 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.377992 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:38.378451 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.379904 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.380662 17437 raft_consensus.cc:1240] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.353574 22372 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.381429 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.384169 17437 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:38.384817 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.371143 22141 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.345263 22160 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:11:38.393827 22370 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:38.394727 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.394187 17406 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:38.395567 17433 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:38.399420 22365 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.400012 22365 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:38.400401 22365 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.343549 22339 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.412706 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:38.418871 17258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.68:34143 timed out after 1.951s (SENT) [suppressed 27 similar messages]
I20260709 12:11:38.382162 22202 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:38.433830 21967 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.395867 22359 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:38.462122 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49479.1us
I20260709 12:11:38.463862 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:38.464215 18013 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:38.340370 22360 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.383733 22045 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.425767 22362 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.471621 17406 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:38.479605 17434 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:38.484459 22364 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.485098 22364 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:38.485494 22364 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.448050 22248 consensus_queue.cc:1059] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:11:38.478075 22337 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.459914 22359 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.466698 22335 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.496136 17406 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:38.466683 22202 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:38.476766 22370 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.495862 22248 raft_consensus.cc:3055] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:38.497047 22335 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:38.507221 22366 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:11:38.498260 22371 raft_consensus.cc:2804] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:38.512864 22371 raft_consensus.cc:697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:38.513005 22339 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.513460 22359 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.508667 22335 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.505939 22248 raft_consensus.cc:740] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:38.507602 22357 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:38.518884 22360 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:38.517705 22248 consensus_queue.cc:260] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.519779 22281 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.520723 22248 raft_consensus.cc:3060] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.522019 22281 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.525416 22364 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.525682 22337 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.519759 22252 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.529614 22364 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:38.565912 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.580341 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 84175.5us
I20260709 12:11:38.581971 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:38.587503 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.591948 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:38.594544 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.595574 22143 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:38.596480 22143 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.527805 22365 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.602860 22365 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.514415 22371 consensus_queue.cc:237] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.614494 22208 raft_consensus.cc:2804] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:38.616174 22208 raft_consensus.cc:697] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:38.614374 22222 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.616333 22370 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.619207 22370 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.635728 22337 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.501860 22202 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.637897 22337 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.643615 22274 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.527249 22238 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.646293 22274 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.653923 21749 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:38.655154 22235 consensus_meta.cc:287] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.004s
I20260709 12:11:38.655802 22235 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.673964 22238 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.674255 22202 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.675935 17367 raft_consensus.cc:1240] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:38.678529 22365 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.679303 22365 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:38.680107 17359 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 2909) took 2239 ms (client timeout 2215 ms). Trace:
W20260709 12:11:38.680612 17359 rpcz_store.cc:269] 0709 12:11:36.440307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.442178 (+  1871us) service_pool.cc:224] Handling call
0709 12:11:38.679648 (+2237470us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002df354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:38.679850 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2718336384}
I20260709 12:11:38.681998 22365 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:38.686493 22239 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.004s
W20260709 12:11:38.688161 22369 log.cc:927] Time spent T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:11:38.691331 22239 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:38.692152 22239 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.711974 17433 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.678058 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:38.655082 21749 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.736994 21903 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:11:38.741276 21903 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:38.731410 22239 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:38.747689 22345 consensus_queue.cc:1059] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:11:38.741690 21903 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:38.751279 22337 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.751811 22040 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.752091 22370 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.747535 22045 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.755287 22044 raft_consensus.cc:3055] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:38.755771 22044 raft_consensus.cc:740] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:38.749305 22206 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.756960 22044 consensus_queue.cc:260] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.748363 22208 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.761330 22044 raft_consensus.cc:3060] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:38.763938 22163 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.769440 17290 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:11:38.774227 22192 consensus_meta.cc:287] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.005s
I20260709 12:11:38.769757 22226 raft_consensus.cc:3055] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:38.758874 22206 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.783555 21749 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.764043 21903 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.784278 22226 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:38.797803 22192 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.801889 21903 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.813522 22372 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.816498 22172 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.817157 22172 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.818297 22206 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:38.818722 18007 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
W20260709 12:11:38.827414 22309 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 1.571s	user 0.004s	sys 0.003s
I20260709 12:11:38.830019 22323 raft_consensus.cc:3055] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:38.830648 22323 raft_consensus.cc:740] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:11:38.834594 21968 consensus_meta.cc:287] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.012s
I20260709 12:11:38.835170 21968 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.837764 21968 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.838632 22226 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.839311 22340 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.840412 22226 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.842948 17291 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:38.844512 22343 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:38.845000 22343 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:38.846010 17292 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:38.849011 22343 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.851150 22343 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:38.851773 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.853933 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:38.855306 22230 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:38.859483 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.861335 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 442369us
I20260709 12:11:38.862473 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:38.863122 22230 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.863672 22230 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.863584 22143 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:38.868453 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.869328 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 2176) took 1108 ms. Trace:
I20260709 12:11:38.869829 17364 rpcz_store.cc:276] 0709 12:11:37.761825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.762325 (+   500us) service_pool.cc:224] Handling call
0709 12:11:37.798958 (+ 36633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.988439 (+189481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.868868 (+880429us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540032ebd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:38.869154 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434291072}
I20260709 12:11:38.869424 22143 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:38.871495 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:38.874866 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.877537 22274 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:38.883343 22288 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.884063 22288 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.883965 17185 catalog_manager.cc:5697] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.886765 22282 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.887513 22282 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.893394 22089 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:38.870466 22050 consensus_meta.cc:287] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.013s
W20260709 12:11:38.907415 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 45118.2us
I20260709 12:11:38.909778 22288 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:38.912546 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:38.924654 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:38.913401 17434 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:38.894447 17185 catalog_manager.cc:5697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 4 to 5, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 5 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.916997 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:38.920361 22338 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.876s	user 0.002s	sys 0.000s
I20260709 12:11:38.921165 17441 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.921916 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:38.922283 22342 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.922616 17436 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:38.922298 22279 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.937062 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.937978 18012 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:38.937116 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:38.932013 22279 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.943534 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:38.945035 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:38.946048 18012 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:38.947010 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.947196 17360 raft_consensus.cc:3060] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.947783 18012 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:38.948922 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.949703 18012 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:38.947227 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:38.951635 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 929) took 1349 ms. Trace:
I20260709 12:11:38.954084 17439 rpcz_store.cc:276] 0709 12:11:37.602664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.611182 (+  8518us) service_pool.cc:224] Handling call
0709 12:11:38.951224 (+1340042us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54001a09d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:38.951454 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582398336}
I20260709 12:11:38.952593 22342 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.947798 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:38.954255 22279 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.973384 17364 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:38.973927 18006 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:38.974922 22240 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.982774 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:38.987107 17435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 925) took 1412 ms. Trace:
I20260709 12:11:38.988328 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:38.987617 17435 rpcz_store.cc:276] 0709 12:11:37.574860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.575087 (+   227us) service_pool.cc:224] Handling call
0709 12:11:37.602016 (+ 26929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.687089 (+ 85073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.687116 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.687155 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:37.687184 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.986593 (+1299409us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b54000ca154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:38.986673 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.986898 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195207040}
I20260709 12:11:38.989470 22353 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:38.990053 22353 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:38.991145 22353 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:38.997038 22342 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.000115 17185 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 4 to 5, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 5 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:39.002142 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 61358.4us
I20260709 12:11:39.003242 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.003872 22342 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.004660 22342 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.005136 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.005810 22240 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.006372 22267 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.006804 22240 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.007103 22267 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.007593 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.008785 17435 raft_consensus.cc:2410] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:39.009677 22267 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.012156 17359 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.018743 17364 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:39.019366 17367 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:38.990305 22323 consensus_queue.cc:260] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.021136 22323 raft_consensus.cc:3060] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.026779 22288 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:39.027624 22288 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.028759 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 1021) took 1050 ms. Trace:
I20260709 12:11:39.029189 18008 rpcz_store.cc:276] 0709 12:11:37.977906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.978407 (+   501us) service_pool.cc:224] Handling call
0709 12:11:37.978667 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.084777 (+106110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.028242 (+943465us) spinlock_profiling.cc:243] Waited 96.4 ms on lock 0x7b540050d054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:39.028561 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221653888}
I20260709 12:11:39.042861 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 924) took 1483 ms. Trace:
I20260709 12:11:39.043280 17441 rpcz_store.cc:276] 0709 12:11:37.559765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.570458 (+ 10693us) service_pool.cc:224] Handling call
0709 12:11:37.600105 (+ 29647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.933167 (+1333062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.042568 (+109401us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540036e054. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:39.042800 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036898048}
W20260709 12:11:39.033536 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.036031 22288 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:39.036787 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2805) took 2492 ms (client timeout 1662 ms). Trace:
I20260709 12:11:39.037942 17284 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:39.039078 17439 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:39.040729 17286 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:39.041584 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:39.044977 17285 rpcz_store.cc:269] 0709 12:11:36.544030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.544150 (+   120us) service_pool.cc:224] Handling call
0709 12:11:39.036418 (+2492268us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002ce7d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:39.036589 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3453492992}
I20260709 12:11:39.051741 17285 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.053551 17407 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:39.053223 17285 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:39.056936 17360 raft_consensus.cc:2468] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
W20260709 12:11:39.057003 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.048659 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.053062 22172 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:39.055869 17367 raft_consensus.cc:2376] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15. Re-sending same reply.
I20260709 12:11:39.067085 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 1025) took 1250 ms. Trace:
W20260709 12:11:39.005384 17184 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55932 (request call id 329) took 24057 ms (client timeout 15000 ms). Trace:
W20260709 12:11:39.069108 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.069448 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49612us
I20260709 12:11:39.067579 18015 rpcz_store.cc:276] 0709 12:11:37.816033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.817665 (+  1632us) service_pool.cc:224] Handling call
0709 12:11:37.818004 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.286354 (+468350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.062664 (+776310us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b540023da54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:39.066856 (+  4192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059066624}
I20260709 12:11:39.070973 22368 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:39.071693 22368 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.043323 17185 catalog_manager.cc:5697] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 4 to 7, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 7 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:39.074846 22208 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:39.075484 22208 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:39.080245 22312 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:39.083084 22386 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:11:39.085210 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 930) took 1130 ms. Trace:
I20260709 12:11:39.085698 17432 rpcz_store.cc:276] 0709 12:11:37.914979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.916188 (+  1209us) service_pool.cc:224] Handling call
0709 12:11:37.919976 (+  3788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.920608 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.031445 (+1110837us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b54000ff5d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:39.031858 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7905536}
I20260709 12:11:39.065349 22335 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.112021 22335 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:39.120031 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 159432us
I20260709 12:11:39.118539 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.131201 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.134285 18008 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:39.077332 17184 rpcz_store.cc:269] 0709 12:11:14.947906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.948112 (+   206us) service_pool.cc:224] Handling call
0709 12:11:39.005098 (+24056986us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:30.264428 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:30.265144 (+   716us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:30.265195 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:11:30.265213 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:30.266604 (+  1391us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:30.266704 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:30.266741 (+    37us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:30.442446 (+175705us) tablet.cc:701] Row locks acquired
0709 12:11:30.471044 (+ 28598us) write_op.cc:260] PREPARE: finished
0709 12:11:30.513739 (+ 42695us) write_op.cc:270] Start()
0709 12:11:30.588092 (+ 74353us) write_op.cc:276] Timestamp: P: 1783599090500730 usec, L: 0
0709 12:11:30.597319 (+  9227us) op_driver.cc:348] REPLICATION: starting
0709 12:11:30.642681 (+ 45362us) log.cc:844] Serialized 5930 byte log entry
0709 12:11:31.052230 (+409549us) op_driver.cc:464] REPLICATION: finished
0709 12:11:31.362441 (+310211us) write_op.cc:301] APPLY: starting
0709 12:11:31.362543 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:31.616620 (+254077us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:31.639271 (+ 22651us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:32.339075 (+699804us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:32.342837 (+  3762us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:11:32.342909 (+    72us) write_op.cc:312] APPLY: finished
0709 12:11:32.348807 (+  5898us) log.cc:844] Serialized 139 byte log entry
0709 12:11:32.404174 (+ 55367us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:32.412828 (+  8654us) write_op.cc:454] Released schema lock
0709 12:11:32.418764 (+  5936us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:32.419328 (+   564us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:32.419363 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2724654,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":275154,"apply.run_cpu_time_us":36168,"apply.run_wall_time_us":1056895,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66797,"num_ops":15,"prepare.queue_time_us":206529,"prepare.run_cpu_time_us":24762,"prepare.run_wall_time_us":690284,"raft.queue_time_us":127956,"raft.run_cpu_time_us":17205,"raft.run_wall_time_us":154525,"replication_time_us":454721,"thread_start_us":605236,"threads_started":5,"wal-append.queue_time_us":428983,"wal-append.run_cpu_time_us":25482,"wal-append.run_wall_time_us":2113502}]]}
I20260709 12:11:39.136711 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:39.137600 22342 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.141250 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:39.141526 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.116333 22288 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.076615 22208 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.139165 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.149909 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:39.154891 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.155539 22255 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:39.161489 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.165356 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.128558 22226 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:11:39.168787 22351 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.125s	user 0.002s	sys 0.013s
I20260709 12:11:39.173233 22282 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.165390 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:39.135285 22130 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:39.183238 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:39.185422 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.188421 17285 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:39.198448 22130 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.201404 22130 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:39.202435 22308 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.202939 22308 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:39.203325 22308 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.206576 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:39.207269 22312 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:39.207947 22312 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.210414 22364 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.211119 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:39.211262 22364 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.212530 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:39.213442 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:39.213598 22364 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:39.214457 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.215075 17436 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:39.216302 17435 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.218225 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.194499 18013 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:39.219350 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.219964 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:39.219599 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.210523 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.222697 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:39.223415 17359 raft_consensus.cc:1240] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.224099 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:39.224500 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:39.225309 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.225485 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.226640 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.227219 18010 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:39.228039 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.202190 22040 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.213891 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.229091 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:39.230238 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.231343 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.225915 18009 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:39.234318 18010 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:39.234712 22368 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.188238 22288 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.241071 22288 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:39.242208 22040 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.242669 22040 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.247110 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 2027) took 1037 ms. Trace:
I20260709 12:11:39.228251 22312 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:39.247524 17292 rpcz_store.cc:276] 0709 12:11:38.209520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.274451 (+ 64931us) service_pool.cc:224] Handling call
0709 12:11:39.246857 (+972406us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540007c954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:39.247040 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927449984}
I20260709 12:11:39.220047 17289 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:39.249073 17292 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:39.249189 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:39.251987 22388 log.cc:927] Time spent T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:39.252408 17286 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.252779 22279 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.255522 17291 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:39.262630 17290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 1000) took 1809 ms (client timeout 1980 ms). Trace:
I20260709 12:11:39.269790 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2828) took 1075 ms. Trace:
I20260709 12:11:39.271275 17284 rpcz_store.cc:276] 0709 12:11:38.194773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.194915 (+   142us) service_pool.cc:224] Handling call
0709 12:11:39.037280 (+842365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.045347 (+  8067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.269532 (+224185us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54002ce7d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:39.269695 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936256768}
I20260709 12:11:39.275174 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 1024) took 1459 ms. Trace:
I20260709 12:11:39.275730 18006 rpcz_store.cc:276] 0709 12:11:37.815735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.815857 (+   122us) service_pool.cc:224] Handling call
0709 12:11:39.274838 (+1458981us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001eafd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:39.275055 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2533043968}
I20260709 12:11:39.165146 22267 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.286648 22267 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.289038 22267 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.290201 22231 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:39.291492 22231 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:39.297330 22130 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:39.297618 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.299152 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.300875 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.302243 22040 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.293713 22255 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.166869 22342 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.263145 17290 rpcz_store.cc:269] 0709 12:11:37.452987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.453497 (+   510us) service_pool.cc:224] Handling call
0709 12:11:39.262353 (+1808856us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540007ba54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:39.262536 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2470026112}
I20260709 12:11:39.316849 22342 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.310632 17361 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:39.312170 22279 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.316207 22255 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:39.319876 22342 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:39.306185 17360 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:39.320727 22040 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.320873 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.327993 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.328933 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.299319 22130 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:39.335567 22276 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.245879 22390 log.cc:927] Time spent T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:11:39.339008 17359 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:39.339751 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.281656 22230 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.350088 22186 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:39.351349 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 167202us
W20260709 12:11:39.351560 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 100864us
W20260709 12:11:39.352980 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.201790 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.361579 22191 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:39.370594 18007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 1020) took 3555 ms (client timeout 1755 ms). Trace:
I20260709 12:11:39.362257 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:39.363232 22323 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:39.364552 17978 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.361302 22355 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.378998 18007 rpcz_store.cc:269] 0709 12:11:35.801509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.802200 (+   691us) service_pool.cc:224] Handling call
0709 12:11:39.353120 (+3550920us) spinlock_profiling.cc:243] Waited 2.79 s on lock 0x7b54003561d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:39.356958 (+  3838us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6426163456}
W20260709 12:11:39.375602 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.387969 18015 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 13: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:39.381927 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:39.389631 17361 raft_consensus.cc:2410] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:11:39.387907 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.391124 18006 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:39.359356 22130 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:39.391141 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.390275 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.392642 17366 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:39.374742 22186 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.394405 17441 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:39.396160 17359 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:39.398574 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.399089 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.401189 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.378832 22191 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:39.404116 21903 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:39.417407 21903 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:39.417763 17404 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:39.417820 22308 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.400689 22186 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.374647 22276 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.405282 22130 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.415449 22215 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:39.425271 22252 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.426076 22337 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:39.418527 21903 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.416229 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 2035) took 1195 ms. Trace:
I20260709 12:11:39.421039 17980 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.432372 17255 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:39.446441 22217 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.385325 22355 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.430009 17288 rpcz_store.cc:276] 0709 12:11:38.220539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.852712 (+632173us) service_pool.cc:224] Handling call
0709 12:11:38.854468 (+  1756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.909082 (+ 54614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.909103 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.924283 (+ 15180us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.969885 (+ 45602us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:38.969925 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.970000 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.245088 (+275088us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:39.415816 (+170728us) raft_consensus.cc:1685] finished
0709 12:11:39.415837 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.416058 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19658,"raft.queue_time_us":43465,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":144,"spinlock_wait_cycles":23223552,"thread_start_us":44966,"threads_started":1,"wal-append.queue_time_us":142546}
I20260709 12:11:39.392797 22323 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.449100 22089 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.462988 17287 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:39.465724 22276 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:39.468003 17258 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:39.471745 22360 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:11:39.477559 22186 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:39.477523 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 98083.3us
W20260709 12:11:39.479128 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 79343.5us
I20260709 12:11:39.481174 17364 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 14: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:39.471393 22130 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.484282 17286 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:11:39.487267 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 122903us
I20260709 12:11:39.488677 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:39.484611 17287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53674 (request call id 2787) took 4043 ms (client timeout 1622 ms). Trace:
W20260709 12:11:39.490517 17287 rpcz_store.cc:269] 0709 12:11:35.441096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.442204 (+  1108us) service_pool.cc:224] Handling call
0709 12:11:39.484311 (+4042107us) spinlock_profiling.cc:243] Waited 3.98 s on lock 0x7b5400392bd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:39.484511 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9153066240}
I20260709 12:11:39.470611 22089 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.493927 17288 raft_consensus.cc:1275] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:39.494083 22186 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.495194 17283 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:39.505511 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.496843 22226 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:39.497952 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.506034 22089 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.491653 22230 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:39.501399 22364 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:39.518494 17287 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:39.490069 22279 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.501489 22312 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:11:39.516582 22050 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:39.530969 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.522694 22276 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.532020 22343 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:39.547667 22186 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.548384 22255 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:39.549463 22364 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:39.550536 22395 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
W20260709 12:11:39.551733 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 53880us
I20260709 12:11:39.565213 22308 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.570282 17258 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:39.560221 22343 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:39.574273 22343 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.575274 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:39.576273 22279 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:39.576704 22279 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.577054 22279 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.583809 17289 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:39.586158 17289 raft_consensus.cc:1275] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:39.575719 22343 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.589797 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.590679 17289 raft_consensus.cc:2368] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13.
I20260709 12:11:39.592784 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.593212 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.594051 17287 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 8.
I20260709 12:11:39.594177 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.594834 17288 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:39.596673 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.601076 17288 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:39.602653 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.604696 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:39.605376 18009 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:39.605928 22394 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.389s	user 0.002s	sys 0.000s
I20260709 12:11:39.604523 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.533591 22215 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:39.610791 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.535223 22163 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:11:39.612113 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:39.619127 18007 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.620222 22186 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:39.571781 22353 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.606673 22276 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:39.625064 18008 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:39.625809 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.644483 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.618821 22172 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.566013 22230 consensus_queue.cc:1059] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:11:39.647789 17288 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:39.657560 22364 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.659994 22364 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.660661 22364 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.663164 22364 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.636921 22308 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.665068 22308 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:39.667181 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 105392us
I20260709 12:11:39.663981 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.668128 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:39.668829 22308 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.670776 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.671051 21876 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 12:11:39.671918 17289 raft_consensus.cc:2368] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12.
I20260709 12:11:39.613643 22304 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
W20260709 12:11:39.674989 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 137123us
I20260709 12:11:39.680639 17404 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:39.634492 22186 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.678429 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:39.689926 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:39.690047 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 207589us
I20260709 12:11:39.692826 17289 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:39.685315 22172 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.695114 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.694824 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.677050 22279 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.687932 22163 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:39.707369 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.650774 22353 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.711210 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:39.696190 22323 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:39.693380 22230 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:39.699849 22355 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.716488 22217 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:39.742959 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.738711 17441 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:39.710608 21876 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:39.738377 22230 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:11:39.752482 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 82425.9us
I20260709 12:11:39.753137 17978 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.737924 22163 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:39.755299 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:39.746948 22323 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.748049 22044 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.763877 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.760939 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:39.765504 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.766825 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.773474 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.768863 22089 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.769497 22413 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:39.782210 17366 raft_consensus.cc:1275] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:39.782568 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.783423 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.784513 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.784943 22303 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.785678 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:39.785518 22303 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.787801 22303 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:39.789004 22402 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:11:39.789629 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.776006 22308 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.800201 22308 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.800297 17363 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:39.800625 22308 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.802856 17435 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:39.794597 22230 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.795828 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:39.779744 22413 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.798429 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.799103 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.807575 18010 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:39.763049 21876 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.762642 22408 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.811932 22413 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.816476 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:39.817157 18006 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:39.818998 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.775029 22044 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.819788 17286 raft_consensus.cc:2368] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13.
I20260709 12:11:39.820958 18007 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:39.820376 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:39.782256 22215 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:11:39.826067 22230 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.826239 22255 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.826843 22255 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.826865 22044 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.774783 22217 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:11:39.829855 22279 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.830828 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.831604 17288 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:39.836083 21876 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:39.780491 22231 consensus_queue.cc:1059] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:39.838028 22231 raft_consensus.cc:3055] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:39.838436 22231 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:39.839208 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2829) took 1642 ms. Trace:
I20260709 12:11:39.839637 17283 rpcz_store.cc:276] 0709 12:11:38.197059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.197297 (+   238us) service_pool.cc:224] Handling call
0709 12:11:39.491182 (+1293885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.505876 (+ 14694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.839017 (+333141us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400392bd0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:39.839150 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2963422464}
I20260709 12:11:39.842716 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.843436 17436 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:39.843086 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.846882 17432 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:39.846753 22191 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.848150 22191 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.849012 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.849225 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.849670 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.849856 17290 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:39.850363 17288 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:39.850782 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.851503 17290 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:39.852797 22323 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:39.853672 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.854562 17291 raft_consensus.cc:2410] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:11:39.855406 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.855615 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.856550 22282 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.857108 22323 consensus_queue.cc:1048] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:39.857689 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.852977 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.849634 17292 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:39.858954 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.857564 22282 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:39.857998 22343 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:39.855993 17285 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.774470 22304 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:39.867494 17358 raft_consensus.cc:1275] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:39.873153 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:39.881626 22288 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:39.863369 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:39.855652 22231 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.888345 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.889077 17367 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:39.892021 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.893033 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:39.857708 22360 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:39.862600 22364 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:39.898711 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:39.882308 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:39.894471 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.901460 17361 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 14: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:39.891393 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:39.897765 22255 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.888948 22288 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:39.903518 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.910708 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.904147 17291 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:39.903167 22288 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.916536 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:39.845992 22308 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.922468 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:39.918644 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:39.905197 22364 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.898739 22360 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:39.922739 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:39.906139 22226 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:39.889878 22343 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.924654 17283 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:39.937201 22411 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.937915 22411 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.940245 22411 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:39.915395 22288 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.947005 17285 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:39.921073 22276 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:39.882221 22163 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.955562 22230 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.926652 22364 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.943626 22279 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:39.924293 22044 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:39.925402 22267 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.942117 22360 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:39.929354 22226 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.943251 22143 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:39.980501 22413 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:39.971760 22226 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:39.983119 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 95815.9us
I20260709 12:11:39.955641 22308 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:39.982852 18014 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:39.961043 22276 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:39.999260 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:39.964473 22279 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:40.002362 17367 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.005151 18009 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:40.020332 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.004541 22276 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.006934 22279 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.024444 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.028823 17436 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:40.000811 22191 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:40.016952 22089 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:40.034830 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:40.038192 22393 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.821s	user 0.003s	sys 0.003s
I20260709 12:11:40.038949 22413 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:40.054034 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:40.045399 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 78981.7us
I20260709 12:11:40.056480 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.065718 17432 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:40.069072 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.076081 17333 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:40.085031 17980 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:40.064896 22191 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.132244 22191 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:40.125980 22215 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.126461 22426 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.083020 22282 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:40.128819 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 72423.7us
I20260709 12:11:40.082490 22130 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:40.082229 22089 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:40.127732 22418 log.cc:927] Time spent T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:40.125765 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 1928) took 1721 ms. Trace:
I20260709 12:11:40.137362 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.163794 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:40.113981 22343 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.164595 17287 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.119835 22342 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.136790 22282 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.192159 22267 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.192855 22267 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.168612 22163 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.200192 22163 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.200623 22360 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.202323 22323 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.203042 17437 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:40.202916 22323 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.205051 22323 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.155776 22050 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:40.219871 17367 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:40.221721 22427 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.222334 22427 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.224681 22427 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.214391 22343 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.225600 22343 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:40.227626 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 142639us
I20260709 12:11:40.229226 22343 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:40.230520 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:40.230417 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:40.231518 18009 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.232735 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.164122 22089 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.233486 17290 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 13: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:40.234493 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.235102 22089 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.239302 18009 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:40.162040 17438 rpcz_store.cc:276] 0709 12:11:38.390954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.401837 (+ 10883us) service_pool.cc:224] Handling call
0709 12:11:38.402224 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.402600 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.402628 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.426751 (+ 24123us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.040064 (+613313us) spinlock_profiling.cc:243] Waited 948 us on lock 0x7b18004b3220. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:39.149943 (+109879us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:39.150004 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.150130 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.037487 (+887357us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:40.112296 (+ 74809us) raft_consensus.cc:1685] finished
0709 12:11:40.112317 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.112545 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9487,"raft.queue_time_us":7819,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":47436,"spinlock_wait_cycles":99106432,"thread_start_us":108546,"threads_started":1,"wal-append.queue_time_us":750793}
I20260709 12:11:40.208508 22282 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.251483 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:40.254595 18015 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 14: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:40.215507 22426 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.255362 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:40.236007 22050 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.269371 17287 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:40.279524 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:40.175045 22342 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.292496 17287 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:40.293437 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:40.294091 18009 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:40.294942 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 207588us
I20260709 12:11:40.297135 22419 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.302928 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.302994 18009 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:40.289086 22191 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:40.289594 22089 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.289734 22163 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:40.314869 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:40.319233 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:40.297657 22419 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.317420 22428 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.304344 22426 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.305166 22413 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.304975 22215 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:11:40.334447 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:40.341370 22308 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:40.342965 22276 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.326133 22427 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.326423 22343 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.346935 18015 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:40.324780 22191 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:40.345237 22342 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.352958 22191 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:40.354655 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.345265 22276 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:40.364442 22431 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.236s	user 0.001s	sys 0.002s
I20260709 12:11:40.364888 22267 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.330528 22426 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.367810 22426 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.330255 22413 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.368352 22426 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:40.368829 22426 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.370154 22413 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.372778 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.373551 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.374781 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.375361 17285 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:40.376441 17283 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:40.376793 22419 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:40.380302 22186 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.349853 17332 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:40.353796 22353 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:40.322687 22288 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.323951 22089 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.397271 17287 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:40.364514 22226 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.405954 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.407881 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:40.410223 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.410701 17284 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:40.411015 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.411773 17289 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:40.414426 17437 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.416369 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.422907 17255 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:40.419878 22353 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:40.425287 22089 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.398340 22343 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:40.434223 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 84456.6us
I20260709 12:11:40.435727 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:40.386078 22364 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.439185 22226 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.398785 22143 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:40.442368 17332 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.450289 22215 consensus_queue.cc:1059] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:40.451041 22353 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.451581 22426 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.457067 22050 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.414955 22130 consensus_queue.cc:1048] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:40.437254 22089 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.458290 22343 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.464321 22231 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.468268 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.426614 22044 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:40.469616 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:40.399325 22208 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:40.425351 22288 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:40.491184 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 48894.4us
I20260709 12:11:40.497292 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.494204 22419 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.507494 17332 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:40.513900 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 131154us
I20260709 12:11:40.515570 17332 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:40.520891 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.527320 17332 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.535521 21903 raft_consensus.cc:3055] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.536056 21903 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:40.537118 21903 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.538226 22186 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.538666 22186 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:40.539093 22186 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.544589 22050 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.546185 22364 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:40.505955 22089 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:40.504926 22044 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.550908 22415 raft_consensus.cc:3055] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:40.551422 22415 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:40.552083 22044 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.552299 22415 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.553624 22415 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:40.555150 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:40.556376 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.556972 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.511407 22419 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:40.573750 17441 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.574615 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:40.576524 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:40.581161 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.581553 22323 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:40.582424 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.583065 17432 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
W20260709 12:11:40.580668 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 199449us
I20260709 12:11:40.586694 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.586925 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.587954 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:40.588985 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.589468 17439 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:40.590035 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:40.591183 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.591564 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.519423 22252 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.593019 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.595361 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.582945 22230 raft_consensus.cc:3055] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.594293 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.573719 22419 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.600801 22230 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:40.607975 22230 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.609016 22230 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:40.604579 22449 log.cc:927] Time spent T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:11:40.609763 22186 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.592341 22255 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.605710 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:40.611336 18013 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:40.514667 22279 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.574898 22364 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.610842 22255 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.612880 22255 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.613103 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.614265 22279 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:40.602185 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.594987 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:40.628120 17406 leader_election.cc:400] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13.
I20260709 12:11:40.629746 17332 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:40.629771 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.629900 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.635233 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.596374 21903 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.640462 17981 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:40.626003 22279 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:40.642925 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:40.643657 18014 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.648664 17332 leader_election.cc:400] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13.
I20260709 12:11:40.649119 17332 leader_election.cc:403] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:40.613148 22186 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.588096 22282 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.653368 17981 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.654337 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:40.653877 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:40.656477 17433 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:11:40.550913 22089 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.644570 22288 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:40.664250 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 80001.7us
I20260709 12:11:40.651636 22252 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.666589 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:40.645934 22323 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:40.672891 17364 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:40.634811 22215 consensus_queue.cc:1048] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:11:40.674959 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.675805 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.645684 22279 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.677160 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.677184 17284 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:40.679105 17364 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.677848 17292 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:40.663987 22355 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13.
I20260709 12:11:40.678071 22413 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:11:40.681274 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:40.694578 17289 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.665215 22457 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.663863 22420 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:40.666229 22288 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:40.704875 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:40.686404 22421 log.cc:927] Time spent T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.498s	user 0.001s	sys 0.003s
I20260709 12:11:40.688589 22282 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.724234 17441 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:40.734690 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:40.736532 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:40.737300 17285 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.746225 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:40.725579 22420 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.747113 22420 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.747447 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:40.748051 17284 raft_consensus.cc:2376] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13. Re-sending same reply.
I20260709 12:11:40.747135 17283 raft_consensus.cc:2393] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:40.760531 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.749495 22419 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.727980 22288 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.765777 17286 raft_consensus.cc:2393] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:40.677286 22323 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:40.768251 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 183584us
I20260709 12:11:40.780707 18014 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:40.787587 22279 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:40.788349 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.789588 17364 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:40.793255 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 2101) took 1029 ms. Trace:
W20260709 12:11:40.793484 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 134495us
I20260709 12:11:40.794569 22267 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:40.795138 22267 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.795724 22143 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:40.796312 22304 consensus_queue.cc:1059] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:40.796965 22143 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:40.797376 22143 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:40.800081 18015 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:40.801659 17362 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:40.797258 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 109819us
I20260709 12:11:40.805928 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:40.808544 17285 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:40.813916 22267 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:40.824082 17364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a03a1e696734298850b94830af8a727"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:40.824807 22222 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.824988 17364 raft_consensus.cc:606] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:40.827507 21876 raft_consensus.cc:3055] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.827963 21876 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:40.828480 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:40.829136 17285 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:40.831912 22323 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.793694 17440 rpcz_store.cc:276] 0709 12:11:39.763355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.600244 (+836889us) service_pool.cc:224] Handling call
0709 12:11:40.602962 (+  2718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:40.603213 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:11:40.603546 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.643062 (+ 39516us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.792730 (+149668us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b18003c8f20. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229a8c0a 00007f122c0e8219 00007f1222a30a40 00007f1222a2b4e4 00007f1222a2b455 00007f1225b13060 00007f1225b25716 00007f1225b36287 00007f1225b36208
0709 12:11:40.792899 (+   169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:40.792961 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:40.793003 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.793070 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.793191 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144754,"prepare.queue_time_us":166840,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":5480,"raft.queue_time_us":152573,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":198,"spinlock_wait_cycles":26972160,"thread_start_us":38913,"threads_started":1,"wal-append.queue_time_us":86999}
I20260709 12:11:40.834368 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:40.835021 17284 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:40.836975 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.807405 17289 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
W20260709 12:11:40.838228 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 171947us
I20260709 12:11:40.777487 17978 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:40.839854 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:40.825299 22222 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.842312 22222 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.842955 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.846866 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.842883 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:40.849056 18008 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.849152 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:40.850216 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 72832.6us
I20260709 12:11:40.852026 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.852985 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:40.853653 17435 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.845036 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.859189 17439 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:40.860412 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.805810 22419 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:40.865180 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:40.867714 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:40.872915 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:40.873839 17440 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.878764 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:40.879446 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:40.878870 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:40.881034 18006 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:40.885965 17258 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.887454 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:40.839255 22267 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:40.863330 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:40.862162 17406 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:40.894666 17255 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.900590 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:40.901271 18014 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.858978 22304 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:40.858944 22408 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.902066 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.806561 22420 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.897781 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:40.911190 18008 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.859292 22450 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:40.861338 22343 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:40.912216 17255 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:40.895660 22427 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.828838 21876 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:40.899076 22426 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.929390 18014 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:40.839949 22143 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.904533 22044 raft_consensus.cc:2764] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:40.907447 22342 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.905438 22304 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:40.914575 22089 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.913106 22130 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.905637 22252 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:40.959172 17436 raft_consensus.cc:2393] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:40.905285 22267 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.904394 22453 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:11:40.961067 22304 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.955400 22427 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.918545 22450 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:40.978406 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.937063 22279 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.987037 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:40.994532 17363 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:40.996523 18007 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:40.972313 22143 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.997265 22255 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:40.975021 21876 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:41.002311 22458 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 12:11:41.009915 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 168633us
I20260709 12:11:41.011248 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:41.020649 17406 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:41.023834 22450 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:41.027856 22255 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:41.033417 17435 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:41.034515 22360 consensus_queue.cc:1048] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:41.036089 22208 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.036785 22208 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.037065 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:41.038174 22208 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:41.038630 22462 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:41.038559 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:41.039340 22450 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.039872 22450 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.040935 22452 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.041913 22450 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:41.044028 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:41.045332 22474 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.055538 17406 leader_election.cc:400] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12.
I20260709 12:11:41.057077 17406 leader_election.cc:403] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:41.064424 22452 consensus_queue.cc:1059] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:41.064985 17407 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:41.071190 22452 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:41.071583 22452 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:41.072077 22208 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.072474 22208 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.072983 22208 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.072428 22452 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.073817 22452 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.066963 22420 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:41.068516 22470 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:41.081449 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:41.082419 22208 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.085274 22208 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:41.085974 22208 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12.
I20260709 12:11:41.088071 22208 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:41.088526 22450 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.089792 22450 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.092062 22450 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:41.088462 22474 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.089160 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:41.101069 17292 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.105031 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:41.108268 22419 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:41.108954 22419 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.110330 22282 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:41.110983 22282 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:41.109439 17292 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:41.111907 22282 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.117435 17406 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:41.118837 22208 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.119242 22208 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.119593 22208 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.139954 22267 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:41.144799 22288 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:41.011524 22165 consensus_queue.cc:1059] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:11:41.069028 22252 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:41.154913 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 163991us
I20260709 12:11:41.170212 17359 raft_consensus.cc:2368] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10.
I20260709 12:11:41.173923 22475 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:41.176788 22468 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:11:41.179214 17283 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:41.218034 17980 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:41.218978 18008 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
W20260709 12:11:41.219076 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 317050us
I20260709 12:11:41.222854 17258 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:41.222970 17440 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:41.223868 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:41.225044 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:41.225658 18013 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.191609 22427 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:41.236786 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:41.238416 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:41.240586 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:41.240908 22279 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.246501 17258 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:41.251690 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:41.227640 22415 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:41.232206 22412 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.229212 22267 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:41.256767 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 344600us
I20260709 12:11:41.259486 17255 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:41.266011 17332 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:41.309556 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:41.309058 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 81279.3us
I20260709 12:11:41.283072 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:41.251296 22450 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.281711 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:41.242319 22427 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:41.251025 22428 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.286332 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:41.324721 18008 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:41.330179 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:41.331166 18012 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:41.332950 17332 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:41.328994 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 224038us
I20260709 12:11:41.330260 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:41.334517 18006 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:41.222162 22222 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:41.253136 22230 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.644s	user 0.013s	sys 0.000s
W20260709 12:11:41.296483 21903 consensus_meta.cc:287] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.004s
I20260709 12:11:41.257495 22226 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.283792 22415 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:41.297236 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:41.348658 17286 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.313832 22040 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:41.282750 17284 raft_consensus.cc:2468] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:41.241238 22481 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:41.315461 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 56086.6us
I20260709 12:11:41.316458 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:41.356948 17366 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:41.254017 22172 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:11:41.338116 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:41.264220 22412 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.340569 17290 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.344955 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:41.297676 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:41.366084 18010 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:41.366076 18008 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:41.352569 17292 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:41.359073 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:41.359853 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:41.357103 17435 raft_consensus.cc:2393] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 10: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:41.319384 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:41.367978 17367 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:41.369099 17440 raft_consensus.cc:2368] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10.
I20260709 12:11:41.351637 22040 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.345846 22353 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.377947 17438 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:41.373657 17255 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:41.374339 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:41.379007 18008 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:41.381074 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:41.382524 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:41.383247 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:41.377475 17358 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:41.394361 18006 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:41.401051 17365 raft_consensus.cc:2393] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:41.371491 22040 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:41.405612 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 84690.6us
I20260709 12:11:41.411480 17332 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:41.412577 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:41.413185 17438 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:41.434577 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 70834.5us
I20260709 12:11:41.372946 22485 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:41.393016 22483 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.401808 22186 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.401963 22419 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:41.461297 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 78840.4us
I20260709 12:11:41.461585 22497 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:41.466672 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 55255.7us
I20260709 12:11:41.404974 22267 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:41.408058 22481 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:41.407191 22364 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.437120 22355 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:41.474013 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:41.436298 22288 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:41.477491 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:41.442379 22353 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:41.436018 22413 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:41.487160 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 115854us
I20260709 12:11:41.492515 17437 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:41.481799 22481 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.480422 22186 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:41.502560 17441 raft_consensus.cc:2410] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:11:41.499683 17258 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:41.459030 22485 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:41.442176 22415 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.486246 22483 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:41.519227 17365 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:11:41.519861 17367 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:41.519966 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:41.516288 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:41.515352 17438 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:41.489652 22499 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:41.516444 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:41.495787 22419 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:41.844035 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.515894 22044 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:41.479971 22252 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:11:41.846428 17980 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:41.864459 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 348074us
I20260709 12:11:41.512151 22481 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.508126 22353 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:41.665779 22255 raft_consensus.cc:993] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:41.533381 22474 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 12:11:41.511013 22475 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:41.501283 22413 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.495847 22364 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:41.859390 18013 consensus_meta.cc:287] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.630s	user 0.003s	sys 0.011s
I20260709 12:11:41.901427 18013 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:41.846992 17286 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
W20260709 12:11:41.865978 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 422597us
I20260709 12:11:41.866401 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:11:41.902745 17255 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.013s	sys 0.016s
W20260709 12:11:41.900794 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 54451.5us
I20260709 12:11:41.899108 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:41.904011 17255 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.014s	sys 0.016s
W20260709 12:11:41.904955 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 531368us
I20260709 12:11:41.906544 18006 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:41.908644 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 402642us
I20260709 12:11:41.868916 22044 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.857852 22499 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:41.878434 22304 consensus_meta.cc:287] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.885s	user 0.015s	sys 0.007s
W20260709 12:11:41.884652 22482 log.cc:927] Time spent T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.447s	user 0.004s	sys 0.006s
I20260709 12:11:41.877899 22426 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.937513 22279 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:41.937904 17362 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:41.938542 22279 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:41.940788 22279 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:41.933774 22505 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:41.930336 17365 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:41.891738 22427 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:41.891135 22230 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.946576 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 2225) took 1323 ms. Trace:
I20260709 12:11:41.958287 17359 rpcz_store.cc:276] 0709 12:11:40.622889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.638175 (+ 15286us) service_pool.cc:224] Handling call
0709 12:11:41.942681 (+1304506us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54000f50d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:41.946492 (+  3811us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174241152}
I20260709 12:11:41.946750 22323 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.916381 22172 raft_consensus.cc:2804] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:41.935194 22480 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.936758 22288 raft_consensus.cc:1081] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:41.931319 22044 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.915217 22475 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:41.971771 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 60621.1us
I20260709 12:11:41.936803 22412 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:41.978660 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 69456.5us
I20260709 12:11:41.936367 22304 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:41.963172 22495 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.994257 17407 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:41.996440 17362 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:41.973517 22172 raft_consensus.cc:697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:41.977301 22222 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:41.973379 22355 consensus_queue.cc:1059] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:41.963248 22230 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:42.005287 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 106314us
I20260709 12:11:41.968338 22323 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.994374 22419 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:41.992796 22503 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.960624 22186 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.998243 22143 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.008343 22474 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:41.972398 22480 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:41.994163 22411 consensus_queue.cc:1059] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:42.010090 22050 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.012234 22252 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:41.971308 22353 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.035676 22143 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.041095 22440 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.066596 22440 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:42.067028 22440 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.068063 22143 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.061657 22252 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:42.041900 22498 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:11:42.042500 22419 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.043697 22323 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.015215 22499 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:42.047206 21876 consensus_meta.cc:287] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 1.040s	user 0.008s	sys 0.010s
W20260709 12:11:42.036612 22208 consensus_meta.cc:287] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.917s	user 0.011s	sys 0.007s
I20260709 12:11:42.049186 22426 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.051213 22304 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.052088 22413 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.005722 22495 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.088981 22495 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:41.973451 22483 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.090787 22411 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:42.091234 22411 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:42.034561 22503 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.092025 22411 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.093292 22411 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.094276 22480 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.094420 22503 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.035122 22485 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.086405 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.071700 22524 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:42.058228 17174 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1c41ebef06654a43a98e69d0c065bba4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica aaafaad0810b4e95983d2d73ec814346 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:42.059054 22172 consensus_queue.cc:237] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.031196 22364 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.060060 22222 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.060529 22050 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.108593 22050 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.109841 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.110564 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.111202 17366 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:42.111696 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.112308 17438 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:42.071861 22252 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.072904 22230 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:42.086510 22040 consensus_meta.cc:287] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.000s
I20260709 12:11:42.086932 22413 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:42.058579 22504 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:42.074293 22474 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:42.115694 22413 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.116065 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:42.116771 17359 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:42.116674 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.117700 17438 raft_consensus.cc:2410] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:42.117882 22413 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:42.074465 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 208110us
I20260709 12:11:42.102664 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.104043 17367 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:42.103403 17292 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.106431 22222 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.095005 22503 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.114656 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:42.106030 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 101635us
I20260709 12:11:42.105455 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.139657 17284 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:42.121196 17435 raft_consensus.cc:2410] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:42.121150 17404 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.138348 17439 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:42.144042 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.146692 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.148638 22413 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.149307 22413 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.152184 22413 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.152060 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.154560 22480 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.155019 22480 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:42.155431 22480 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.156376 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.157747 22426 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:42.159411 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.160955 22413 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:42.161443 22413 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.161821 22413 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.096176 22208 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.168330 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:42.170634 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:42.170873 17367 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.171191 18006 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.094501 22163 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:11:42.167640 22488 log.cc:927] Time spent T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.177s	user 0.001s	sys 0.002s
W20260709 12:11:42.183341 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 98935.8us
I20260709 12:11:42.192716 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.137647 21876 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.194115 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.165494 22208 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.199630 17434 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:42.115406 22040 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.200953 17333 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.173018 22492 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:42.198794 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 135057us
I20260709 12:11:42.211799 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:42.212568 17286 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 10: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:42.109961 22044 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.179697 22143 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:42.213835 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.213979 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.200435 22252 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:11:42.217216 17980 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.217752 18010 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:42.218719 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.165797 22503 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.217519 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.218766 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.233903 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.228180 17438 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:42.200551 22426 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.228631 18011 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:42.234064 17284 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:42.231228 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.230015 18006 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:42.103129 22524 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.235790 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.226226 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.207491 22485 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.233906 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.252115 17367 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:42.210929 22353 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.217424 22515 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.253472 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:42.262451 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:42.207326 22492 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:42.254246 18014 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 7.
I20260709 12:11:42.253122 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.254217 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.255833 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.265272 17284 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:42.242548 22415 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.260406 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:42.206171 21876 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.262041 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.274117 18011 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 10: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:42.266387 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:42.259416 17980 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.266463 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:42.270123 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.222078 22267 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:11:42.273730 18012 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:42.277158 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.251632 22497 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:42.277804 18007 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 9.
I20260709 12:11:42.291064 17406 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:42.262493 22279 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.256520 22495 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.292960 22050 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:11:42.295675 22428 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:42.290222 22172 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.255352 22485 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.274353 22492 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.297204 22518 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.234719 22143 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.298115 22532 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.264565 22509 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.328613 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:42.262185 22323 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.299882 18010 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: [9.9-10.10]
I20260709 12:11:42.306684 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:42.329681 22323 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.330790 21876 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.273636 22163 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.331501 22163 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:42.314550 22415 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.298764 22413 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.332230 22415 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.332656 22415 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.334021 22413 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.309302 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 2073) took 1021 ms. Trace:
I20260709 12:11:42.331969 22323 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.334736 17291 rpcz_store.cc:276] 0709 12:11:41.288318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.288841 (+   523us) service_pool.cc:224] Handling call
0709 12:11:41.289091 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.311862 (+ 22771us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:41.341947 (+ 30085us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.410551 (+ 68604us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:41.410612 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:41.410667 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.658193 (+247526us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18003c6be0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229fc2a6 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12228b49c4 00007f12228b2acb 00007f1222a6ddc9
0709 12:11:42.309052 (+650859us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b540007b554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:42.309105 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.309233 (+   128us) inbound_call.cc:177] Queueing success response
0709 12:11:42.323050 (+ 13817us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b48003000d8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
Metrics: {"prepare.queue_time_us":20659,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3562,"raft.queue_time_us":33262,"raft.run_cpu_time_us":6938,"raft.run_wall_time_us":873159,"spinlock_wait_cycles":136952704,"thread_start_us":68184,"threads_started":1,"wal-append.queue_time_us":69456}
I20260709 12:11:42.308732 22495 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.337270 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.312608 18012 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.321249 22222 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.301833 22279 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:42.339249 22279 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.340870 22440 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.269047 22515 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.342613 17285 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:42.343036 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.331935 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:42.344955 22304 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.325486 17434 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 6.
I20260709 12:11:42.346485 22282 raft_consensus.cc:3055] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:42.346938 22282 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:42.347165 22163 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.347802 22282 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.348623 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.349036 22282 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.331076 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.350056 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.351284 18012 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:42.351509 22143 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.331681 22497 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:42.343789 22515 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.318280 22172 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.355041 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:42.346537 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.355757 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.272666 22513 consensus_queue.cc:1059] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.139s
I20260709 12:11:42.328023 21956 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.326916 22044 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.333913 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.363145 18009 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 17: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:42.246518 22426 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.338263 22495 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.356290 18010 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:11:42.329281 18011 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.357188 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.343696 17367 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:42.360685 17286 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:42.352576 22143 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.354832 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2861) took 1067 ms. Trace:
I20260709 12:11:42.369652 17404 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.369799 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.319286 22532 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.376799 22515 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.377349 22515 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.377697 22515 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.376960 22532 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.367784 17288 rpcz_store.cc:276] 0709 12:11:41.287730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.287856 (+   126us) service_pool.cc:224] Handling call
0709 12:11:41.291560 (+  3704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.296238 (+  4678us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:41.296608 (+   370us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.389965 (+ 93357us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.399849 (+  9884us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.400021 (+   172us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:41.400237 (+   216us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.403271 (+  3034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.403358 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.663207 (+259849us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b1800432220. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229fc2a6 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f
0709 12:11:42.351136 (+687929us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800432220. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f12229fc2a6 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12228b49c4 00007f12228b2acb 00007f1222a6ddc9
0709 12:11:42.352343 (+  1207us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b24001871d8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12228b49c4 00007f12228b2acb 00007f1222a6ddc9 00007f1222a6da55 00007f1222a6cfb0 00007f12256e3488 00007f12256e3be8 00007f12256bb398 00007f12256b676a 00007f12256b5bb6
0709 12:11:42.354630 (+  2287us) raft_consensus.cc:1685] finished
0709 12:11:42.354651 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.354761 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6511,"prepare.queue_time_us":4569,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":49471,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":36261,"spinlock_wait_cycles":115845376,"thread_start_us":89093,"threads_started":1,"wal-append.queue_time_us":111980}
I20260709 12:11:42.362974 21956 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.379498 21956 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.379784 22143 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.380415 22304 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.380800 22509 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.381361 22509 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.380949 22304 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:42.377727 22531 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:42.330664 22485 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:42.390142 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.379520 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.377628 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.400274 17288 raft_consensus.cc:2393] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 7: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:42.261925 22474 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.408638 17360 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 11. Ops: []
I20260709 12:11:42.403831 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.319461 22518 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.417064 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.418450 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.419561 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.420745 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.421336 17288 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:42.397213 22536 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.425385 22536 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:42.426306 22536 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.425004 22475 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.427567 22536 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.430065 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2859) took 1143 ms. Trace:
I20260709 12:11:42.378396 22522 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:42.434544 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.385689 22520 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.438318 17288 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:42.382057 22143 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.436802 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.382948 22524 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.440176 18010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4198acb44a394602a442737d55022d72"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:59534
I20260709 12:11:42.456810 18010 raft_consensus.cc:606] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:42.457217 18010 raft_consensus.cc:614] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:42.384276 22304 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.443751 17290 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:42.450966 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 1065) took 1168 ms. Trace:
I20260709 12:11:42.451730 22415 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.383540 22509 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.431324 17283 rpcz_store.cc:276] 0709 12:11:41.287103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.287254 (+   151us) service_pool.cc:224] Handling call
0709 12:11:41.310452 (+ 23198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.506217 (+195765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.506247 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.790373 (+284126us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.974751 (+184378us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b48003000d8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:11:42.073758 (+ 99007us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:42.098530 (+ 24772us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.428677 (+330147us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54001296a0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225a96733 00007f1225b1bdbf 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c
0709 12:11:42.428738 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.429738 (+  1000us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b54002ce7d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:42.429783 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.429826 (+    43us) raft_consensus.cc:1685] finished
0709 12:11:42.429836 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.429970 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11812,"prepare.queue_time_us":27198,"raft.queue_time_us":23326,"raft.run_cpu_time_us":6089,"raft.run_wall_time_us":583751,"spinlock_wait_cycles":304379904,"thread_start_us":279520,"threads_started":2,"wal-append.queue_time_us":194300}
I20260709 12:11:42.466316 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.468410 18007 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:42.468128 18015 rpcz_store.cc:276] 0709 12:11:41.282636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.282792 (+   156us) service_pool.cc:224] Handling call
0709 12:11:42.450750 (+1167958us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b540067ff54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:42.450899 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110462336}
I20260709 12:11:42.411598 22323 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.442734 22492 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.437855 22522 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:42.472095 22440 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.432034 22518 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.443281 22520 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.454794 22279 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.471218 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.476665 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.352653 22497 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.477460 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1958) took 1161 ms. Trace:
I20260709 12:11:42.514742 17440 rpcz_store.cc:276] 0709 12:11:41.315776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.319132 (+  3356us) service_pool.cc:224] Handling call
0709 12:11:42.477275 (+1158143us) spinlock_profiling.cc:243] Waited 955 us on lock 0x7b54001478d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:42.477400 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196864}
I20260709 12:11:42.486390 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.388789 22481 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.487763 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:42.490185 22516 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:42.484294 22513 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.469017 22515 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.477746 22360 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.516261 17290 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:42.517184 17291 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:42.496742 17437 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.488480 22520 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.546285 22492 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.485966 22323 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.549324 22323 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.550428 22143 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.551128 22143 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.552937 22497 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.554677 22143 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.555287 22279 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.560789 17258 leader_election.cc:400] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10.
I20260709 12:11:42.561110 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:42.562795 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.564069 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.566772 22477 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:42.567194 22477 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:42.567472 22515 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.568027 22477 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.569322 22477 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.570567 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.571887 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.575052 22360 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.576545 22503 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.577271 22360 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.579952 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:42.580572 17433 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.580745 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.568069 22515 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:42.582868 22515 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.586876 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.517270 22440 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.589814 22440 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.592015 22440 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:42.551172 22527 log.cc:927] Time spent T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:42.596161 22040 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.597306 22172 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.605290 22415 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.606259 22515 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:42.608757 22480 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.610960 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:42.611652 18012 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:42.612104 18011 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:42.612538 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:42.613009 18011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:59534
I20260709 12:11:42.613611 18011 raft_consensus.cc:606] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.613983 18011 raft_consensus.cc:614] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:42.620453 22481 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.621321 17284 raft_consensus.cc:2368] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10.
I20260709 12:11:42.624497 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:42.625550 22511 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:42.626508 22143 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:42.625875 17407 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:42.627442 17439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 2133) took 1772 ms (client timeout 2197 ms). Trace:
I20260709 12:11:42.645948 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:42.635360 22478 raft_consensus.cc:3055] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.561111 17258 leader_election.cc:403] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:42.646615 18008 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:42.646437 17439 rpcz_store.cc:269] 0709 12:11:40.855185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.867349 (+ 12164us) service_pool.cc:224] Handling call
0709 12:11:42.627277 (+1759928us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400147dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:42.627382 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2821783808}
W20260709 12:11:42.648165 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 87522.7us
I20260709 12:11:42.652715 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:42.653164 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:42.653966 18007 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.650151 22478 raft_consensus.cc:740] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:42.655376 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.656015 17439 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:42.656641 22255 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.656944 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:42.657524 17439 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.658269 22511 consensus_queue.cc:1243] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer 868a5e341d0a41b4ac0927342c8cd598 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:42.658852 22255 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.659266 22255 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.658133 17407 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.648561 22515 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.646013 22143 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.663329 22143 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.646768 22040 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.664103 22040 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:42.664908 22491 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 1.253s	user 0.015s	sys 0.010s
I20260709 12:11:42.665556 22360 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.670738 17367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:42.671452 17367 raft_consensus.cc:606] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:42.674265 22509 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.674945 22509 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.675228 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.666007 22360 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.676892 22360 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.677196 22505 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:42.678792 22411 consensus_meta.cc:287] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.005s
I20260709 12:11:42.650703 22497 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.668545 17406 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.679850 22497 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.681061 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.682348 17255 leader_election.cc:400] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10.
I20260709 12:11:42.676643 22522 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.683240 22304 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.683673 22304 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.683831 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:42.684659 17435 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.685007 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:42.686492 22485 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:42.689738 22543 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:11:42.691141 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 941) took 1195 ms. Trace:
I20260709 12:11:42.691542 17362 rpcz_store.cc:276] 0709 12:11:41.496158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.496300 (+   142us) service_pool.cc:224] Handling call
0709 12:11:42.690951 (+1194651us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b540032f5d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:42.691081 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958584064}
I20260709 12:11:42.692745 17363 raft_consensus.cc:1275] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:42.693038 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.693742 17366 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:42.696270 22411 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:42.684072 22522 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.696941 22411 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.698989 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:42.711158 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:42.714092 18008 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:42.714838 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:42.715476 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.717144 17362 raft_consensus.cc:2393] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 13: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:42.715507 17364 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:42.720449 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.653719 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:42.727505 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.662724 22515 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.732491 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:42.733177 18014 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.734529 22411 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.738663 22040 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.740665 22255 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.742961 22509 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.747211 17439 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:42.749778 18007 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:42.713366 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:42.757004 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 43705.1us
I20260709 12:11:42.759614 17981 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.684052 22304 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.768059 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:42.769398 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 115751us
I20260709 12:11:42.774506 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.769796 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.715763 22440 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10.
I20260709 12:11:42.780993 18014 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:42.783420 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.789273 17439 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:42.718930 22450 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.737928 17433 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:42.783696 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.719266 22475 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.788403 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 474549us
I20260709 12:11:42.790957 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.792388 17435 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:11:42.793165 17292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a03a1e696734298850b94830af8a727"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:11:42.793443 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.769459 22415 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.805984 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:42.776068 22509 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.804579 17365 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:42.811856 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:42.809376 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:42.813257 17367 raft_consensus.cc:2368] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
I20260709 12:11:42.797222 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.810621 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:42.769575 22485 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.784675 22483 raft_consensus.cc:2764] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:11:42.639123 22513 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.817574 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:42.819249 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:42.819717 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:42.815234 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:42.823415 17364 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 14: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:42.823017 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:42.798185 22255 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.802736 22503 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:42.806756 22130 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:42.810895 22481 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.828522 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:42.823395 17283 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:42.810163 22415 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.650522 22516 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.816625 22495 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.807668 22450 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.816588 22089 consensus_queue.cc:1059] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:42.811122 22475 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:42.816802 22465 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.929450 17436 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:43.051003 17363 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:42.933269 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.924886 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:42.923900 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.059942 17364 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:42.820827 22226 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:42.814141 22412 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:42.954238 22282 consensus_meta.cc:287] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
W20260709 12:11:43.033344 22544 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.378s	user 0.004s	sys 0.000s
I20260709 12:11:43.075448 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.059453 17978 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.821516 22411 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.829417 22040 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:43.076202 18014 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:43.081489 17435 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:42.847075 22497 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.871836 22323 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:42.871192 22426 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.093357 22426 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:43.093851 22426 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.080264 22360 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.096325 22426 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.051795 22481 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.058085 22415 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.082967 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:43.099274 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:42.919606 22523 raft_consensus.cc:2764] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:11:42.873759 22440 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.030848 22515 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:43.072880 21956 consensus_meta.cc:287] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.693s	user 0.003s	sys 0.006s
W20260709 12:11:43.037320 22518 consensus_meta.cc:287] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.539s	user 0.003s	sys 0.003s
I20260709 12:11:42.879175 22353 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:42.818065 22509 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:42.859378 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:42.829092 22499 consensus_queue.cc:1059] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.248s
I20260709 12:11:43.064376 22492 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:43.118906 17174 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1c41ebef06654a43a98e69d0c065bba4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica aaafaad0810b4e95983d2d73ec814346 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:43.104247 21903 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:43.119895 22513 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.120039 22516 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.096264 22360 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:42.825325 22485 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.075778 22549 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:11:43.084208 22040 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:43.122404 22040 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.062656 22495 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.126091 22495 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.090191 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.118955 22499 raft_consensus.cc:3055] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.128192 22499 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.118925 22492 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.129079 22499 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.103511 22481 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.130373 22499 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.130838 22492 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:43.128441 22485 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:43.093940 22304 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.134187 22304 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:42.880736 22532 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.091545 22323 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:43.076905 22226 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.092537 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:11:43.101126 22536 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.101785 22515 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:43.106454 17286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.003s	sys 0.020s
W20260709 12:11:43.148536 17286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.003s	sys 0.020s
I20260709 12:11:43.101097 18012 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:43.150213 17292 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:43.150630 17292 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.108877 17438 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:43.040843 22143 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.110679 17433 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:43.112684 22186 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:43.158720 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.169467 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:43.176918 22226 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.177598 22323 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.153851 22505 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:43.181291 22481 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.090674 22450 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.103647 22465 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.080148 22412 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.108435 22518 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.205073 22465 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:43.101375 22440 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.156088 18010 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 14: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:43.156931 17438 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:43.181316 22477 consensus_meta.cc:287] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.001s
I20260709 12:11:43.185938 22509 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:43.105847 21956 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.185688 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.206200 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:42.856505 22503 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:43.210579 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.225394 17439 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:43.225709 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.154088 22515 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.232436 17288 raft_consensus.cc:2368] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:43.214241 17292 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.183997 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:43.237926 17290 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.240999 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.241680 17358 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:43.242681 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36408 (request call id 1054) took 1032 ms. Trace:
I20260709 12:11:43.243057 17285 rpcz_store.cc:276] 0709 12:11:42.210604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.210770 (+   166us) service_pool.cc:224] Handling call
0709 12:11:43.242518 (+1031748us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b540007ba54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:43.242628 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208873216}
I20260709 12:11:43.244604 17285 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:43.247673 17291 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.252190 22364 raft_consensus.cc:993] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:43.252768 22364 raft_consensus.cc:1081] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:43.167621 22186 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.220180 17289 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:43.208717 22475 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.216915 22465 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.261281 17290 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:43.245944 17285 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:43.263741 17288 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:43.232468 22522 consensus_meta.cc:287] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.003s
I20260709 12:11:43.285486 17980 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.284911 17289 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:43.289270 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:43.116240 17333 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:43.276382 22364 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:43.291107 17285 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:43.289633 22172 raft_consensus.cc:2764] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:43.292166 17290 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:43.295643 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 179472us
I20260709 12:11:43.303365 17333 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:43.304620 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.305301 17289 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 7.
I20260709 12:11:43.288540 22279 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:43.307008 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 200798us
W20260709 12:11:43.320632 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:43.317440 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 217053us
I20260709 12:11:43.322738 17441 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:43.317962 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 266769us
I20260709 12:11:43.324724 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.325242 17441 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:43.328650 17437 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:43.328590 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:43.278214 22503 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.333098 17980 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:43.330551 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:43.334810 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53688 (request call id 2079) took 1114 ms. Trace:
I20260709 12:11:43.341656 17284 rpcz_store.cc:276] 0709 12:11:42.220646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.330803 (+110157us) service_pool.cc:224] Handling call
0709 12:11:43.334614 (+1003811us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54000514d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:43.334741 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621962112}
I20260709 12:11:43.335888 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2862) took 2047 ms. Trace:
I20260709 12:11:43.304123 22411 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:43.342840 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.343958 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.342351 17287 rpcz_store.cc:276] 0709 12:11:41.288030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.288132 (+   102us) service_pool.cc:224] Handling call
0709 12:11:41.288432 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.392000 (+103568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.392036 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.407446 (+ 15410us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.883788 (+476342us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:41.891074 (+  7286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.327460 (+1436386us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003fa554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:43.327507 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.327551 (+    44us) raft_consensus.cc:1685] finished
0709 12:11:43.327563 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.335791 (+  8228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237557632,"thread_start_us":442349,"threads_started":1,"wal-append.queue_time_us":532949,"wal-append.run_cpu_time_us":1887,"wal-append.run_wall_time_us":1083550}
I20260709 12:11:43.344755 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.345134 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.314961 22499 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:43.314715 22143 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.350194 22521 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.374248 22521 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.376457 22521 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.378664 22480 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.343498 22282 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.380431 22282 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.380796 22282 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.381349 22415 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:43.383524 22520 consensus_meta.cc:287] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.785s	user 0.006s	sys 0.004s
I20260709 12:11:43.344660 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.387095 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.353226 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:43.354014 22186 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.320848 22279 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.354620 22515 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.391434 22515 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:43.392035 22515 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.305682 22364 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.355145 22524 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.394872 22524 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:43.356622 22500 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 1.420s	user 0.004s	sys 0.000s
I20260709 12:11:43.358026 22426 raft_consensus.cc:3055] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:43.355149 21956 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:43.401319 22426 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:43.405102 22426 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.406037 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.406737 17287 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:43.407485 22549 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:43.407951 22549 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.408300 22549 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:43.340045 22497 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 12:11:43.384449 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 940) took 1898 ms. Trace:
I20260709 12:11:43.416657 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.416210 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:43.418622 17366 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.419566 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.419868 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.420507 17287 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:43.370344 22172 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:43.371465 22478 consensus_queue.cc:260] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.342541 22163 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.418881 17358 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:43.439616 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.360447 22532 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:43.418506 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 85491.6us
I20260709 12:11:43.444749 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.445605 17285 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:43.422183 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:43.425134 17439 raft_consensus.cc:1240] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:43.426029 17438 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:43.413589 17360 rpcz_store.cc:276] 0709 12:11:41.490849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.491390 (+   541us) service_pool.cc:224] Handling call
0709 12:11:41.491714 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.409125 (+917411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.384215 (+975090us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540018cc54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:43.384387 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108256512}
I20260709 12:11:43.449551 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:43.450279 17285 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.431233 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:43.451519 17363 raft_consensus.cc:3055] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:43.409830 22547 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 12:11:43.433797 17437 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:43.434649 17255 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:43.441831 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.453528 17362 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:43.443025 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.432049 17292 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.457259 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:43.346742 22481 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.459259 17432 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:43.452042 17363 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.320994 22419 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
I20260709 12:11:43.468803 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.464638 22323 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.461165 22089 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.470319 22323 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.471602 22524 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.472198 22567 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:11:43.472512 22323 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.474677 17363 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.475718 17363 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.438046 22499 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.428969 22411 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.429893 22480 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:43.479590 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:43.481163 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 60174.8us
I20260709 12:11:43.462298 22426 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.486563 21956 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.486914 22255 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:43.489467 22364 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.490212 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:43.491905 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.493515 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.494223 17288 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:43.484221 17258 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.456032 22440 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.496863 17285 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:43.461825 22518 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.502673 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:43.497562 17255 leader_election.cc:400] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
I20260709 12:11:43.503973 17255 leader_election.cc:403] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:43.478076 22343 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.499681 17980 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:43.509622 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:43.510516 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.512105 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.512720 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:43.513278 18014 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:43.512739 18012 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:43.480150 22412 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.431754 22520 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.510138 17980 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:43.480738 22165 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:43.490131 22364 raft_consensus.cc:3055] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:43.522217 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.562402 17366 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:43.518313 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.523483 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:43.523455 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.563460 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.524919 18015 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:43.497917 22480 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.508253 22413 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.516156 22536 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.508319 22089 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:43.534417 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:43.518901 22226 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
I20260709 12:11:43.537890 22279 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.539361 17363 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:43.540601 22282 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.542374 18014 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:11:43.542946 22515 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.496841 22532 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.505144 22323 consensus_queue.cc:1048] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:11:43.518821 22564 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.455565 22163 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.551340 22040 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:43.555881 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 45844.6us
I20260709 12:11:43.571346 22525 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:43.476775 22499 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.565448 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.564409 17286 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:43.571308 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:43.563534 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 45165.7us
I20260709 12:11:43.594223 17404 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:43.595108 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.596326 17366 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:43.572674 18007 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:43.598289 17366 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:43.576998 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.578712 18006 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 15: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:43.551520 22569 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.580111 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:43.600186 18014 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.581609 17440 raft_consensus.cc:2368] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
W20260709 12:11:43.581693 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 63477.9us
I20260709 12:11:43.601186 17258 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:43.601473 18015 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:43.602187 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.581689 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.602514 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.570492 22165 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.585996 22089 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:43.581496 22536 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.593115 22411 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.637639 22536 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.610616 22226 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:43.638659 22525 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:43.639762 22252 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:43.639600 22525 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.640161 22252 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.562273 22364 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.641078 22252 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.641499 22364 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.642738 22364 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.643107 22480 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.644407 22252 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:43.582610 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:43.557994 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.646967 18009 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:43.603977 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.606530 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:43.577010 22561 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:43.586400 22481 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:43.609405 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.648710 22561 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.587477 22343 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.649768 22343 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.650352 22343 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:43.650748 22343 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.652364 22415 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.651605 22465 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.653682 17285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:53688
I20260709 12:11:43.654320 18012 raft_consensus.cc:1240] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:43.654824 17290 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:43.656466 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.656709 17285 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:43.657083 17285 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.657269 17363 raft_consensus.cc:2410] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:43.657457 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:43.656872 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.656262 17406 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:43.663825 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:43.665205 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.666092 17439 raft_consensus.cc:2410] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:43.666647 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.667877 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.604903 17404 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:43.614130 22515 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.670610 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.618391 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.665477 17332 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:43.609965 22130 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:43.623158 17365 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.624428 22040 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.589811 22564 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:43.587872 22532 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.686609 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.630141 22163 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.635337 22520 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:43.635119 22089 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.649119 22561 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:43.669124 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.669159 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:43.670825 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 66012.1us
I20260709 12:11:43.671933 17441 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 11: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:43.671247 17283 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:43.673383 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.674834 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:43.698661 18010 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.675143 17289 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:43.638628 22226 raft_consensus.cc:697] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:43.676060 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:43.675464 22143 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.677276 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.677731 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.359722 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:43.679260 18013 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.711098 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:43.712281 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.712879 18013 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:43.680301 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:43.682258 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.683182 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.717756 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:43.718393 17435 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.684717 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.684927 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:43.608887 22569 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.654978 22465 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.674060 17285 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.721138 17438 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.689816 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:43.686867 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.676613 22556 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.670928 22515 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.689502 22412 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:43.730191 17285 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.676753 22130 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:43.672556 22481 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:43.697276 17437 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:43.676206 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:43.706815 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:43.707141 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:43.708397 18008 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:43.708642 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:43.723526 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.749542 17363 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.723690 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:43.687282 22564 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.674515 22353 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:11:43.726634 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.693396 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:43.724133 22186 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.689888 22571 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:11:43.724682 22569 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.640237 22165 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:43.742702 18011 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:43.673064 22497 consensus_queue.cc:1059] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:11:43.744943 17258 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:43.745169 17406 leader_election.cc:400] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:43.686978 22483 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:43.750344 17283 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.751276 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.767441 17363 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:43.709520 22143 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.749579 17289 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:43.768082 22143 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.769063 22497 raft_consensus.cc:3055] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.769652 22497 raft_consensus.cc:740] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.746446 22130 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.729068 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.724419 22556 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.758522 17432 raft_consensus.cc:2393] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:43.728223 22520 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.739213 22515 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.760803 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.788218 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:43.715752 17332 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:43.761708 17435 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:43.762125 17285 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:43.708364 22163 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:11:43.750671 17291 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:43.753400 22474 consensus_queue.cc:1059] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:43.726816 22496 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:11:43.777143 17438 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:43.777715 17365 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:43.778469 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.744469 22415 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:11:43.774307 18011 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:43.792729 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 77066.2us
I20260709 12:11:43.805187 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.808008 17332 leader_election.cc:400] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10.
I20260709 12:11:43.805495 17441 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:43.784312 22450 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.801816 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:43.775050 22503 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:43.746378 22226 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.819162 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.785588 22556 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.803287 22483 consensus_queue.cc:1243] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer e860f7e876b74ec589f447737822a4f6 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:43.804070 22495 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:43.807312 22419 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:43.838467 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:43.839376 18006 raft_consensus.cc:2368] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10.
I20260709 12:11:43.840262 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.840940 17291 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:43.827713 22044 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:43.850653 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.819831 22186 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:11:43.792368 22549 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:43.853760 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 81647.5us
I20260709 12:11:43.864591 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.855086 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:43.851301 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:43.857600 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:43.858757 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.867556 17438 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:43.859896 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.820240 22499 consensus_queue.cc:1059] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:11:43.868463 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:43.790349 22497 consensus_queue.cc:260] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.871503 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:43.870959 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.872197 17438 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:43.868916 17435 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:43.875550 17435 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:43.877885 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:43.852438 22419 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.838541 22465 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:11:43.897059 22208 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.915259 22208 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.915606 22208 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.919826 22581 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.920322 22581 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.920680 22581 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.922326 22172 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.922745 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1972) took 1362 ms. Trace:
I20260709 12:11:43.922873 22172 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.923138 17440 rpcz_store.cc:276] 0709 12:11:42.560595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.560817 (+   222us) service_pool.cc:224] Handling call
0709 12:11:43.922558 (+1361741us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400114754. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:43.922688 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345026816}
I20260709 12:11:43.919209 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.914768 22419 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.929773 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:43.930459 17291 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:43.931106 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:43.898008 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:43.834633 22503 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:43.899153 22040 consensus_queue.cc:1175] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33539b233c2044afa31017244f6cc0d1" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 7 } }
I20260709 12:11:43.874006 22568 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.835326 22481 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:43.906420 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:43.912963 22343 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:43.873790 22163 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.897305 22411 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.936955 17981 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:43.939687 18010 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:43.957412 22580 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.960367 22503 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:43.955615 22536 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.974282 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:43.974887 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 165936us
I20260709 12:11:43.956226 22532 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:43.965438 22497 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.980189 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:43.968977 22522 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.963672 22568 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.987329 22522 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.987480 22255 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.973820 22411 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.988647 22580 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.007155 22580 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.007439 22411 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.008715 22411 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.009562 22580 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:43.940212 22515 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.006809 22581 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.011840 22515 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.012501 22252 consensus_queue.cc:1059] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:44.013231 22581 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.013621 22252 raft_consensus.cc:3055] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:44.014032 22252 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:44.014232 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:44.015029 17290 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:44.014433 17286 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:44.015219 22511 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:11:44.020172 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.022289 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:44.024866 17406 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:44.025936 22475 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.026367 22475 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.027238 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 2246) took 1103 ms. Trace:
W20260709 12:11:44.028481 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.001868 22568 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.039359 22208 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.040403 22521 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.040835 22521 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:44.041711 22208 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:44.031582 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:44.026719 22475 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.963999 22561 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.043220 22353 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:44.043617 22343 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.044157 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.044631 22282 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.066640 22282 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:44.067405 22552 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.912s	user 0.004s	sys 0.000s
I20260709 12:11:44.044682 22583 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:44.068682 22583 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:44.045077 22549 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.046841 22412 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.070016 22583 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:44.004093 22564 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.051133 22569 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.072045 18012 raft_consensus.cc:2368] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
I20260709 12:11:44.072700 22564 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:44.073004 22569 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.073729 18013 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:44.052196 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.074555 17284 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.004338 22499 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:11:44.052930 22556 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.029167 22255 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.079255 22255 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.080267 22556 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.005350 22522 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.086488 17441 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 14: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:44.024873 22478 raft_consensus.cc:3060] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.027653 17365 rpcz_store.cc:276] 0709 12:11:42.924403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.924583 (+   180us) service_pool.cc:224] Handling call
0709 12:11:44.027078 (+1102495us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b5400082854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:44.027181 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297523584}
I20260709 12:11:44.056334 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.057415 17407 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:44.110714 17362 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:44.063624 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.112138 17290 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.980754 22130 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.070254 22412 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:43.997844 22536 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.073662 17333 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:44.030478 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:44.093575 17283 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:44.097146 17284 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
W20260709 12:11:44.119174 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 62941.7us
I20260709 12:11:44.127640 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:44.121107 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 63771.4us
W20260709 12:11:44.126667 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 53092.1us
W20260709 12:11:44.132995 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 170347us
I20260709 12:11:44.132481 17333 leader_election.cc:400] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10.
I20260709 12:11:44.135782 17333 leader_election.cc:403] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.136059 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.137446 17333 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.138931 17367 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:44.140208 17407 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:44.141652 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.142019 17333 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.145911 17291 raft_consensus.cc:2393] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:44.146180 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.147423 17407 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:44.151319 17290 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:44.156457 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:44.157130 18009 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.170923 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.171756 22562 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.171934 22555 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:44.172523 22555 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:44.173415 22555 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.174558 22419 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:44.112355 22483 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:11:44.177284 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.174256 17433 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.180981 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:44.181705 17432 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.183671 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:44.186486 22484 consensus_queue.cc:1059] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:44.187779 22484 raft_consensus.cc:3055] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.188124 22484 raft_consensus.cc:740] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:44.189031 22484 consensus_queue.cc:260] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.127082 22208 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.125912 22089 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:44.194384 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:44.197965 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.132187 22536 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.196103 18009 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:44.143610 22364 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 9. Current term is 10.
I20260709 12:11:44.144553 22353 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.145769 22499 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:44.231621 17433 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:44.222738 17258 leader_election.cc:400] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
I20260709 12:11:44.200172 22536 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.233282 17258 leader_election.cc:403] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.202172 22515 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:44.190850 22419 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:44.197197 22579 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:11:44.192186 22558 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.169763 22186 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.195850 22450 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.041725 22521 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.198172 22562 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.168998 22343 raft_consensus.cc:2764] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:44.234694 22279 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
I20260709 12:11:44.237277 22411 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.169440 22143 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.245219 22559 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:44.245949 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:44.349646 22585 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:11:44.385286 17286 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 13: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:44.248112 22561 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.248528 22564 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:44.249850 17290 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:11:44.252058 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 293801us
I20260709 12:11:44.255391 17978 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.254659 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:44.195055 22252 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:44.353036 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 100391us
W20260709 12:11:44.350126 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 88724us
I20260709 12:11:44.231024 22089 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.401654 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:44.358269 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:44.397600 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 143037us
I20260709 12:11:44.398736 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.347925 22364 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:44.350601 22569 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:44.203480 22412 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.406975 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:44.426700 17406 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:44.428634 17437 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:44.349754 22556 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:44.405766 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:44.372179 22581 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.408946 17439 raft_consensus.cc:2368] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15.
I20260709 12:11:44.409297 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:44.350059 22419 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.406754 17436 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:44.406167 18013 raft_consensus.cc:2393] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 8: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:44.421104 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:44.431336 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:44.402415 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:44.400347 22521 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.434327 22364 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.442557 22364 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.436712 17367 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
W20260709 12:11:44.410230 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 154921us
I20260709 12:11:44.435930 22163 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:44.451918 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 49599.3us
I20260709 12:11:44.453244 17258 leader_election.cc:400] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
I20260709 12:11:44.453622 17258 leader_election.cc:403] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.405938 22208 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.404646 22499 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:44.399124 22564 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.459808 17291 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:44.411154 22590 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.475804 22186 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:44.476768 18040 heartbeater.cc:646] Failed to heartbeat to 127.15.191.126:37225 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.191.126:37225 timed out after 15.000s (SENT)
I20260709 12:11:44.476497 22186 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.480073 22186 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.482800 22484 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.438305 22252 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.452385 22581 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.423852 22525 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.392050 22559 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.388691 22411 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.357697 22568 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.466172 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.512606 17286 raft_consensus.cc:2393] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 14: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
W20260709 12:11:44.470610 22588 log.cc:927] Time spent T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:44.470942 22208 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:44.460071 22561 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:11:44.408643 22413 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:11:44.471745 22499 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.462162 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:44.550598 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 88529.6us
I20260709 12:11:44.464298 22556 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:44.494488 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 67893.9us
I20260709 12:11:44.460788 22495 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:44.439428 22549 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:11:44.502899 17436 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 8.
I20260709 12:11:44.460613 22567 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13.
I20260709 12:11:44.467429 22474 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.491919 22412 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.436328 22569 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:44.541115 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 130609us
I20260709 12:11:44.572683 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:44.494211 22186 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.588217 22186 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.590497 22186 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:44.502542 22497 consensus_meta.cc:287] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.004s
I20260709 12:11:44.492810 22130 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:44.542523 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 132085us
I20260709 12:11:44.592245 17981 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.593240 22532 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.594650 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:44.595312 17291 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:44.595988 22592 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:44.491151 22515 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:44.561126 17283 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:44.596544 22592 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:44.545881 22593 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:11:44.574867 18009 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:44.599182 22592 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.600616 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:44.601353 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:44.579100 22255 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.580792 22581 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:44.598807 22515 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.603507 22255 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.600666 18011 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:44.597342 17980 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:44.606341 18007 raft_consensus.cc:1217] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Deduplicated request from leader. Original: 10.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:11:44.606953 22143 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:44.607525 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:44.578727 22556 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.601253 18009 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.587687 22569 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.613250 22569 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:44.613680 22569 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:44.614048 22569 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:44.616518 22564 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.606840 18007 raft_consensus.cc:1240] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:44.618897 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:44.619822 22475 consensus_meta.cc:287] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 12:11:44.620308 22475 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.606822 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:44.624486 18011 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:44.624616 22172 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.626576 17288 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:44.639460 22559 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:44.644284 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.644768 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.645134 18009 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:44.646093 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:44.646221 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 192325us
I20260709 12:11:44.646656 18011 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.576787 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:44.648530 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 94702.2us
I20260709 12:11:44.649042 18012 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:44.652532 17432 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:44.655850 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.656627 17291 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.656865 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:44.658142 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.658708 17292 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.561734 22226 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:44.668368 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.666684 17407 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:44.675539 18011 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:44.667202 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:44.676651 17288 raft_consensus.cc:2368] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:44.667732 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:44.677009 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:44.678826 17292 raft_consensus.cc:2468] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:44.680827 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.681423 17288 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.681685 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:44.682236 22604 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.682596 22040 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.682722 22604 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.682943 22364 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:44.683290 22040 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:44.683868 22040 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:44.683615 22598 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:44.575929 22495 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:44.683050 17333 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:44.686815 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.690683 22571 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:44.691074 22411 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.691959 22499 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.653321 22474 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:44.691821 22040 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.692783 22282 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.693174 22474 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.662873 22597 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 12:11:44.696496 22222 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.691113 22571 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:44.697795 22571 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.563476 22563 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.122s
W20260709 12:11:44.679623 22588 log.cc:927] Time spent T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:11:44.699030 22571 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:44.700078 22568 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:44.641911 17174 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1c41ebef06654a43a98e69d0c065bba4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica aaafaad0810b4e95983d2d73ec814346 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:11:44.701525 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 125867us
I20260709 12:11:44.696929 22592 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.719544 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:44.689872 17978 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:44.656760 22163 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:44.723991 17291 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:44.725617 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:44.727486 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:44.728067 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:44.728165 17432 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:44.729713 17437 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:44.679723 22556 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:44.730891 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:44.731769 17440 raft_consensus.cc:2368] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14.
I20260709 12:11:44.707592 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.732643 17292 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.733354 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:44.736099 17406 leader_election.cc:400] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:44.736487 17406 leader_election.cc:403] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.728760 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:44.742763 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:44.756002 17441 raft_consensus.cc:2393] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 8: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:44.757344 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:44.724663 22522 consensus_meta.cc:287] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.001s
I20260709 12:11:44.748443 17406 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:44.764829 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:44.719229 22226 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:44.668282 22426 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 12:11:44.679589 22255 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:11:44.693197 22282 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:44.678877 22353 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:11:44.735425 22364 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.736079 22172 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.757889 22602 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:44.758772 22525 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.778504 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:44.779479 17292 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:44.780912 17406 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:44.758551 22475 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:44.758194 22555 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:44.696764 22536 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.787534 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:44.791054 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:44.769366 22411 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.687527 22208 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.805912 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:44.807650 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:44.810129 17367 raft_consensus.cc:2410] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:44.812424 22536 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.795276 22602 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.817687 22602 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.802014 22495 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.808353 17441 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:44.825717 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33816 (request call id 1985) took 1143 ms. Trace:
I20260709 12:11:44.789166 22525 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.827508 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:44.768759 22522 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.847939 22522 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:44.826174 17433 rpcz_store.cc:276] 0709 12:11:43.682487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.689509 (+  7022us) service_pool.cc:224] Handling call
0709 12:11:44.825559 (+1136050us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400115b54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:44.825661 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040043392}
I20260709 12:11:44.831194 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:44.832255 17441 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:44.834131 22478 consensus_meta.cc:287] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.000s
I20260709 12:11:44.836107 22226 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.831318 22282 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.787644 22605 raft_consensus.cc:2804] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.860816 22605 raft_consensus.cc:697] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:44.801517 22497 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:11:44.791114 22364 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:44.863281 22364 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.865223 17288 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:44.874471 22608 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:11:44.842734 22163 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.802462 22581 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:44.850723 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:44.888181 17286 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.851158 17255 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:44.852813 17981 leader_election.cc:400] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14.
I20260709 12:11:44.889770 17981 leader_election.cc:403] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.803889 22411 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:44.855348 17434 raft_consensus.cc:1275] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:44.804762 22604 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:44.821301 21903 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.853770 22044 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.850013 22525 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.896243 17441 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:44.896764 17361 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:44.861910 22605 consensus_queue.cc:237] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.891516 17255 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.927605 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:44.893266 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.902370 22515 raft_consensus.cc:2764] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:44.915576 17286 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:44.901425 22581 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:44.902014 22282 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.899025 22536 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14.
I20260709 12:11:44.929746 17981 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.890089 22569 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.934845 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:44.901288 22165 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.925668 21903 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.930727 22044 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.924832 22130 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.933920 22562 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.944849 22411 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.933837 22608 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.954655 17981 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.948719 17255 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:44.959633 17255 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.959671 17981 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:44.968194 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:44.982761 17441 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:44.953155 22279 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.982930 17255 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:44.985158 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:44.985641 22562 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.987169 22415 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.987742 22415 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:44.988641 22415 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.953425 22465 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:44.987329 22600 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.966516 22569 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.964413 22044 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:44.961831 21903 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:44.957995 22130 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.956696 22165 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:44.966495 22581 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:44.966740 22515 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:44.968144 22411 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.965073 22536 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:44.956928 22522 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:45.031813 22465 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:45.040375 22252 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:45.042704 22450 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:45.042667 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.073410 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:45.075841 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:45.075146 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:45.082211 17287 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:45.046034 22130 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:45.052938 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:45.057016 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48990 (request call id 2261) took 1025 ms. Trace:
I20260709 12:11:45.087356 17258 leader_election.cc:400] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15.
I20260709 12:11:45.088236 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:45.084822 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.081513 17407 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:45.086510 17361 rpcz_store.cc:276] 0709 12:11:44.031199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.031347 (+   148us) service_pool.cc:224] Handling call
0709 12:11:45.056797 (+1025450us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54003d09d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:45.056941 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823329536}
I20260709 12:11:45.091133 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:45.088547 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:45.097636 18008 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:45.094648 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:45.079658 22450 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:45.106439 17980 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:45.106942 18015 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:45.082149 22608 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:45.053903 17183 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 11, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 11 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:45.111034 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 981) took 2455 ms. Trace:
I20260709 12:11:45.127255 17434 rpcz_store.cc:276] 0709 12:11:42.656065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.155334 (+499269us) service_pool.cc:224] Handling call
0709 12:11:43.186437 (+ 31103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.899512 (+1713075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.110783 (+211271us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540034e754. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:45.110970 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3837303040}
I20260709 12:11:45.104213 22559 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.130370 22559 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.130784 22559 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.131459 22525 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.087181 22252 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.135212 22252 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:45.095323 22562 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:45.136037 22562 raft_consensus.cc:697] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:45.137152 22562 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.087085 22465 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.082432 22522 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:45.140502 22522 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.084360 22515 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:45.118463 22163 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.118966 22419 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.120774 22450 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.122408 22608 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:45.125672 22616 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:11:45.101513 22089 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:45.159559 22089 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:45.160574 22089 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.161126 22549 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:45.162473 22536 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:45.162863 22536 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:45.163699 22536 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.126160 22413 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:45.166584 17980 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.167016 22413 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:45.167210 22465 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.167835 22465 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:45.167990 22413 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:45.145057 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.173377 22608 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:45.178339 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:45.178818 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.181428 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:45.182039 17291 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.184752 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:45.185627 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.186909 17433 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:11:45.187336 17433 pending_rounds.cc:85] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 10
I20260709 12:11:45.195888 17364 raft_consensus.cc:2410] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:45.199981 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.200074 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.200935 17291 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:45.204969 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:45.206041 17361 raft_consensus.cc:2410] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:45.207201 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:45.208025 17363 raft_consensus.cc:2368] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:45.207841 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:45.209227 17359 raft_consensus.cc:2393] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 14: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:45.209425 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.214251 22571 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:45.214881 22571 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.215616 22255 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:45.216194 22255 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.217272 22571 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:45.220764 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.222136 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.207037 17358 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:45.223879 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.224200 17358 pending_rounds.cc:85] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 9
I20260709 12:11:45.225893 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.224493 17358 pending_rounds.cc:107] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 10.10
W20260709 12:11:45.228200 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.228132 17358 raft_consensus.cc:2889] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:45.187561 17433 pending_rounds.cc:107] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:45.229236 17433 raft_consensus.cc:2889] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:45.227156 22600 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:11:45.236498 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:45.241387 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.196391 22323 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:45.249337 17981 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.253611 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:45.258558 22556 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:45.259222 22556 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.261399 22556 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:45.234479 17183 catalog_manager.cc:5697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 9, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 9 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.269500 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:45.279428 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:45.231557 22282 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.277220 18009 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:45.237408 22571 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:45.168665 22515 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.227049 22568 consensus_queue.cc:1048] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:11:45.308260 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 54748.6us
I20260709 12:11:45.291241 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.291550 17290 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:45.246304 22255 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.289212 18010 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:45.251720 22594 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.310189 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.310323 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:45.315549 17361 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:45.271256 22591 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.315716 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.321359 17436 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:45.322584 18015 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:45.245649 22343 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:11:45.320015 17364 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:45.277556 22172 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:11:45.361590 22532 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:45.372189 17438 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:45.283535 22597 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:45.372228 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.372186 17433 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:45.278611 22323 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.373703 17437 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:11:45.379033 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.380925 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.289629 22282 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.348908 22465 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.330013 22525 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.308180 22571 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.385371 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.363442 22558 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:45.387653 17440 raft_consensus.cc:1217] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Deduplicated request from leader. Original: 12.9->[14.10-16.11]   Dedup: 14.10->[16.11-16.11]
I20260709 12:11:45.390465 17440 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 16. Current term is 17. Ops: [14.10-16.11]
I20260709 12:11:45.388603 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.395006 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.330122 22163 consensus_queue.cc:1059] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:11:45.402336 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.406337 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.407397 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.314395 22606 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:45.408056 17440 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:45.410670 17433 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:45.386289 22562 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:45.409909 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:45.322479 22411 consensus_queue.cc:1059] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:11:45.420436 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:45.431174 17978 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:45.431525 17364 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.423008 17438 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.425045 17333 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.426421 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.427752 17439 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:45.428335 18008 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:45.401450 22558 raft_consensus.cc:697] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:45.441547 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.447664 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:45.392335 22465 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.382519 22532 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.442777 22562 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.460115 22532 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.464550 17438 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:45.466073 17981 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:45.466509 22562 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.471648 22646 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:45.473098 22364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.006s	sys 0.010s
W20260709 12:11:45.473506 22364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.006s	sys 0.010s
I20260709 12:11:45.429737 22255 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.476138 17333 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.480415 22483 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:45.480762 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.481559 22483 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:45.455627 22628 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:11:45.485342 22413 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:45.485980 22413 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:45.486327 17333 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:45.418949 22581 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:11:45.450238 22503 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.418305 22559 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.454840 22607 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.489266 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:45.492146 17359 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:11:45.505282 17359 pending_rounds.cc:85] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 11
I20260709 12:11:45.505612 17359 pending_rounds.cc:107] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:11:45.496223 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.497174 17358 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:11:45.507516 17358 pending_rounds.cc:85] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 10
I20260709 12:11:45.507731 17358 pending_rounds.cc:107] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:11:45.507969 17358 raft_consensus.cc:2889] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:45.508590 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.505934 17359 raft_consensus.cc:2889] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:45.509610 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.497908 17283 raft_consensus.cc:2368] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13.
I20260709 12:11:45.490314 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.476264 22594 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:45.512903 17333 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:45.515169 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:45.515841 17358 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.515966 17364 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
W20260709 12:11:45.518533 22629 log.cc:927] Time spent T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:11:45.521824 22634 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:45.487123 22411 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:45.522431 22634 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.523118 22411 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.523540 22411 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.524659 22634 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.479451 22561 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:45.520181 17255 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:45.490732 22624 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:11:45.467768 22412 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:11:45.500762 22632 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:11:45.487668 22165 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:45.516821 22597 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.497639 22559 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.535521 22607 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:45.542498 22631 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:11:45.526690 22623 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:11:45.536237 22412 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:45.538177 22643 log.cc:927] Time spent T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:11:45.484172 22255 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.549023 22255 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.549571 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.503500 22465 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.545886 22412 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:45.486950 22413 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.551934 22412 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.539366 22571 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:45.539269 22561 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.516968 22558 consensus_queue.cc:237] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.540457 22411 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.540963 22323 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.562829 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.553747 22412 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.572016 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:45.576437 17434 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:45.593127 17358 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:45.599413 17255 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:45.599651 17287 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:45.600456 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.570885 22089 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.607525 17367 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:45.613131 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:45.574965 22637 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.617388 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:45.616276 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.616657 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.620231 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:45.622788 17432 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:45.625586 17358 raft_consensus.cc:2393] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:45.625870 17284 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:45.593370 22607 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:45.606451 22640 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.609926 22411 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:45.639261 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:45.640338 17432 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.577082 22255 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:11:45.594239 22559 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:11:45.595918 22343 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:11:45.655678 17362 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:45.623605 22172 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:11:45.652848 22640 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:45.660110 22640 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.627275 22637 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.664251 22637 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:45.618264 22571 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.679478 17358 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:11:45.680198 17358 pending_rounds.cc:85] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 10
I20260709 12:11:45.680531 17358 pending_rounds.cc:107] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:11:45.680832 17358 raft_consensus.cc:2889] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:45.682821 17432 raft_consensus.cc:2468] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:45.686017 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.686640 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.687263 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.687492 17361 raft_consensus.cc:2410] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:11:45.687908 17365 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:45.688309 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.692674 17978 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.695282 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.657009 22607 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.698933 17360 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:45.696918 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.690948 22411 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.708354 22532 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:45.710954 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.711843 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.707947 17978 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:45.690349 22571 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.841172 17286 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:45.856541 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.782230 17404 leader_election.cc:400] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11.
I20260709 12:11:45.830828 17292 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:11:45.871091 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 105915us
I20260709 12:11:45.843955 17287 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:45.832226 17441 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:45.834472 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:45.816958 17284 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:45.751150 17365 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:45.750437 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:45.747442 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:45.874441 17291 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 12:11:45.871420 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.870150 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:45.879148 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 171268us
I20260709 12:11:45.881337 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.751101 17359 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:11:45.882454 17359 pending_rounds.cc:85] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:11:45.882758 17359 pending_rounds.cc:107] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:11:45.883076 17359 raft_consensus.cc:2889] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:45.883390 17363 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:45.884929 17363 pending_rounds.cc:85] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 6
I20260709 12:11:45.885246 17363 pending_rounds.cc:107] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:45.742506 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:45.971179 17358 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.789135 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:45.905505 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 163086us
I20260709 12:11:45.885756 17363 raft_consensus.cc:2889] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:45.853775 22627 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.441s	user 0.002s	sys 0.000s
I20260709 12:11:45.846566 22252 raft_consensus.cc:3055] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:45.705575 22515 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.257s
I20260709 12:11:45.839337 22165 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.961980 22604 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.000815 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:45.849212 22561 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:45.800186 22646 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.839067 22602 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.860073 22282 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:45.819386 22511 raft_consensus.cc:3055] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:45.854465 22419 raft_consensus.cc:3055] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:45.998701 22605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.061s	user 0.006s	sys 0.019s
I20260709 12:11:45.750039 22647 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.287s
I20260709 12:11:45.707149 22649 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:45.966331 22483 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:45.965935 22478 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.031047 17365 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:45.885075 22532 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:45.880095 22343 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.145s
I20260709 12:11:46.037789 17358 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:46.215230 22163 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:46.215850 22163 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.035797 17333 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:46.039790 22661 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:11:46.238590 17440 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:46.042289 22657 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:11:46.016664 22089 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.706249 22607 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:45.739537 22411 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:45.887315 22226 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260709 12:11:45.887137 22590 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.150s
I20260709 12:11:46.046646 22419 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:46.248852 22419 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.249895 22419 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.779897 22536 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.022567 22252 raft_consensus.cc:740] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:46.254547 22590 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:46.254933 22252 consensus_queue.cc:260] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.256086 22252 raft_consensus.cc:3060] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.032764 22165 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.258962 22607 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:46.259754 22165 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:46.256223 22411 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:46.250880 22279 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.261461 22279 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.262961 22647 raft_consensus.cc:2804] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:46.263628 22279 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:46.050743 17185 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60632 (request call id 221) took 35619 ms (client timeout 15000 ms). Trace:
I20260709 12:11:46.263942 22647 raft_consensus.cc:697] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 15 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:46.264317 17185 rpcz_store.cc:269] 0709 12:11:10.431370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.431604 (+   234us) service_pool.cc:224] Handling call
0709 12:11:46.050636 (+35619032us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:39.687038 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:39.756103 (+ 69065us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:39.762204 (+  6101us) write_op.cc:435] Acquired schema lock
0709 12:11:39.762906 (+   702us) tablet.cc:662] Decoding operations
0709 12:11:39.915346 (+152440us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:39.919262 (+  3916us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:39.919297 (+    35us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:39.919972 (+   675us) tablet.cc:701] Row locks acquired
0709 12:11:39.920020 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:11:39.920211 (+   191us) write_op.cc:270] Start()
0709 12:11:39.920361 (+   150us) write_op.cc:276] Timestamp: P: 1783599099920148 usec, L: 0
0709 12:11:39.920399 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:11:39.936311 (+ 15912us) log.cc:844] Serialized 2831 byte log entry
0709 12:11:40.317543 (+381232us) op_driver.cc:464] REPLICATION: finished
0709 12:11:40.379014 (+ 61471us) write_op.cc:301] APPLY: starting
0709 12:11:40.379129 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:40.446700 (+ 67571us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:40.446859 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:40.531480 (+ 84621us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:40.531793 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:11:40.531854 (+    61us) write_op.cc:312] APPLY: finished
0709 12:11:40.532204 (+   350us) log.cc:844] Serialized 73 byte log entry
0709 12:11:40.532410 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:40.532529 (+   119us) write_op.cc:454] Released schema lock
0709 12:11:40.532587 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:40.533007 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:40.533038 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8561212,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":61164,"apply.run_cpu_time_us":11404,"apply.run_wall_time_us":153982,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33373,"num_ops":7,"prepare.queue_time_us":342714,"prepare.run_cpu_time_us":19316,"prepare.run_wall_time_us":320662,"raft.queue_time_us":190118,"raft.run_cpu_time_us":8915,"raft.run_wall_time_us":27561,"replication_time_us":395059,"thread_start_us":395730,"threads_started":4,"wal-append.queue_time_us":86058,"wal-append.run_cpu_time_us":61716,"wal-append.run_wall_time_us":1820849}]]}
I20260709 12:11:46.079957 22255 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.270236 22255 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.270704 22255 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.272953 22647 consensus_queue.cc:237] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.088413 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 1006) took 1104 ms. Trace:
I20260709 12:11:46.274569 17436 rpcz_store.cc:276] 0709 12:11:44.984152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.984799 (+   647us) service_pool.cc:224] Handling call
0709 12:11:44.987342 (+  2543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.321802 (+334460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.088089 (+766287us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54000cb554. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:46.088333 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767494400}
I20260709 12:11:46.106902 18010 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:46.121609 22571 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:46.036866 22040 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.276782 22040 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.125916 17332 leader_election.cc:400] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13.
I20260709 12:11:46.281185 17332 leader_election.cc:403] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:46.131618 22664 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:11:46.143886 18015 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:46.145733 18007 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:46.147360 22413 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:46.047361 22511 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:46.148886 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 99144.7us
W20260709 12:11:46.157663 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.048561 22605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.006s	sys 0.019s
W20260709 12:11:46.169185 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 53050.3us
I20260709 12:11:46.189339 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:46.300804 17432 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.301306 17283 raft_consensus.cc:1275] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:46.185158 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:46.207549 17434 raft_consensus.cc:1240] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:46.207895 22532 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.203872 22495 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:46.209041 22594 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:46.314790 18015 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:46.210510 22478 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.230746 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 1106) took 1150 ms. Trace:
I20260709 12:11:45.754657 17183 catalog_manager.cc:5697] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 14, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 14 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:46.046345 22646 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.236382 22450 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.217976 22163 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:46.244994 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 209288us
I20260709 12:11:46.373474 18007 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:46.243676 17361 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:11:46.374951 18007 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:11:46.244414 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 51872.2us
I20260709 12:11:46.241472 22089 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.279084 22040 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:46.325727 22594 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.285643 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:46.285698 18010 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:46.190788 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:46.305910 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 432997us
I20260709 12:11:46.307654 17437 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:46.308215 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:46.433552 17435 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:46.313146 17291 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:46.315104 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:46.047315 22602 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.323707 17432 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:46.302731 22343 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.441004 22343 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.441345 22282 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:46.441759 22524 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.442176 22282 consensus_queue.cc:1243] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer 868a5e341d0a41b4ac0927342c8cd598 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:46.442296 22524 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.442662 22597 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:46.443888 22343 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:46.325196 18014 rpcz_store.cc:276] 0709 12:11:45.080138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.080250 (+   112us) service_pool.cc:224] Handling call
0709 12:11:45.080542 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.080880 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.080918 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:45.081355 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:11:45.291156 (+209801us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:45.291194 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.291257 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.853193 (+561936us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:46.230414 (+377221us) raft_consensus.cc:1685] finished
0709 12:11:46.230438 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.230678 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3684,"raft.queue_time_us":8602,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":3288960,"thread_start_us":185294,"threads_started":1,"wal-append.queue_time_us":286092}
I20260709 12:11:46.444649 22583 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.444805 22524 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:46.445191 22583 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.448609 22602 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:46.450222 22511 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.450508 17183 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 7 to 12, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 12 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:11:46.336788 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.303148 22590 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:46.306515 22549 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.307482 22364 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.367405 17283 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:46.283696 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 157935us
I20260709 12:11:46.455965 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:46.469233 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:46.326855 22222 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:11:46.303009 22226 consensus_queue.cc:1059] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:11:46.439528 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:46.483062 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:46.452270 17183 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 11, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 11 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:46.451429 22511 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.319005 22279 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 12:11:46.500427 22597 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:46.500994 22597 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:46.285970 22499 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13.
I20260709 12:11:46.502378 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:46.503109 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:46.454828 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.430310 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 61492.2us
I20260709 12:11:46.503078 17364 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:46.470633 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:46.471874 17432 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:11:46.473001 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.509301 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:46.454931 17361 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:46.425297 22481 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.513813 17438 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:46.451555 22658 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:11:46.440203 17360 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:46.438426 22637 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:11:46.439092 22483 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.488055 17404 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:46.486675 22607 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:11:46.489283 22556 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:46.484488 22497 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:11:46.484341 22353 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:11:46.490383 17434 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:46.491073 17183 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:46.495167 22478 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:46.496786 22089 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:46.477217 22165 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.325398 22495 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:46.474414 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 166279us
I20260709 12:11:46.515509 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:46.516076 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 2170) took 1138 ms. Trace:
I20260709 12:11:46.483942 18008 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:46.500300 22226 raft_consensus.cc:3055] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:46.508428 18010 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:46.535696 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:46.539875 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.540520 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 52546.1us
I20260709 12:11:46.469720 22163 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:11:46.469841 22605 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:11:46.478598 22590 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.477617 22364 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.568697 17437 rpcz_store.cc:276] 0709 12:11:45.377284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.377490 (+   206us) service_pool.cc:224] Handling call
0709 12:11:45.392572 (+ 15082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.433245 (+1040673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.515873 (+ 82628us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400147dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:46.516020 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104046848}
I20260709 12:11:46.546062 22558 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:46.592712 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.570232 18014 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:46.521581 22481 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.569727 22608 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.543197 22483 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.572892 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:46.571328 22591 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.581995 22649 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.609061 17407 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:46.612356 22663 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:11:46.613502 22130 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.613955 22130 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.614311 22130 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.614841 22165 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:46.615302 22165 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.615639 22165 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:46.620710 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.627044 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:46.627846 17360 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:46.629491 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:46.630364 17292 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:46.636096 17255 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:46.573535 22226 raft_consensus.cc:740] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:46.568028 22604 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:46.606534 22089 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.660727 17331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.065s	sys 0.158s
W20260709 12:11:46.661352 17331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.065s	sys 0.158s
W20260709 12:11:46.663612 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.668058 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.670838 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:46.671412 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:46.671517 17292 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:46.619658 22649 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.678066 17290 raft_consensus.cc:1240] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: [11.8-12.9]
W20260709 12:11:46.451689 22606 consensus_queue.cc:1175] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "868a5e341d0a41b4ac0927342c8cd598" responder_term: 10 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:46.597719 22478 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:11:46.639046 22279 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.681039 22089 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.606155 22555 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:11:46.678782 22353 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.766758 18010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:59534
W20260709 12:11:46.767042 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 217160us
I20260709 12:11:46.767424 18010 raft_consensus.cc:606] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:46.691051 22649 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.620008 22608 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.695003 22279 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.649729 22503 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 12:11:46.767632 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 141052us
W20260709 12:11:46.698585 22662 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:11:46.622344 22591 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.767429 22555 consensus_queue.cc:1243] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer aaafaad0810b4e95983d2d73ec814346 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:46.799731 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:46.800650 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 228695us
I20260709 12:11:46.769889 22411 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:46.800792 18010 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:46.765758 22044 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:46.766530 22598 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:46.810801 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:46.767138 22426 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.775874 22279 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:46.826886 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 217899us
I20260709 12:11:46.874383 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:46.824869 22569 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.004s	sys 0.014s
W20260709 12:11:46.884337 22569 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.004s	sys 0.014s
W20260709 12:11:46.818945 22412 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.003s	sys 0.015s
W20260709 12:11:46.886087 22412 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.004s	sys 0.015s
I20260709 12:11:46.899688 22426 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.797966 22583 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:46.822614 22208 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.013s	sys 0.037s
I20260709 12:11:46.773180 22353 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.913403 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:46.914206 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:46.914584 17366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.014s	sys 0.006s
I20260709 12:11:46.821343 22665 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:46.932502 17366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.014s	sys 0.006s
I20260709 12:11:46.933192 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 1111) took 1192 ms. Trace:
W20260709 12:11:46.914158 17363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.000s	sys 0.017s
I20260709 12:11:46.826471 22044 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.941318 18009 rpcz_store.cc:276] 0709 12:11:45.740357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.740555 (+   198us) service_pool.cc:224] Handling call
0709 12:11:45.740964 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.741377 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.741410 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:45.741920 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.304329 (+562409us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:46.304370 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.304434 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.932923 (+628489us) raft_consensus.cc:1685] finished
0709 12:11:46.932949 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.933121 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":784,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"thread_start_us":498544,"threads_started":1,"wal-append.queue_time_us":753302}
W20260709 12:11:46.942708 17363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.001s	sys 0.017s
I20260709 12:11:46.948645 18009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:59534
I20260709 12:11:46.949395 18009 raft_consensus.cc:606] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:11:46.894493 22637 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.916009 22208 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.013s	sys 0.037s
W20260709 12:11:46.944624 22679 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:46.680244 17183 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 12, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 12 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:46.890034 22598 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.828135 22411 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:46.961838 22364 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:46.939718 22478 consensus_queue.cc:1048] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:11:46.802366 22226 consensus_queue.cc:260] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:46.982513 22683 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.983197 22495 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.001304 22089 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:46.953374 22665 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:47.022823 22559 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:47.050392 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.971987 22637 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:47.050189 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.062677 22559 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:47.064657 22674 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:11:47.065203 22559 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.067077 22044 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.070966 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.071718 17358 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:47.072609 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.073732 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.020956 22483 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:47.078684 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.062572 22669 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:11:47.022938 22683 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.086316 22683 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.087869 22598 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.090250 22411 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.091549 17358 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:47.050130 22687 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.092447 22687 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:47.094655 22687 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:47.097224 22637 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:47.083634 17365 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:11:47.109328 22252 consensus_meta.cc:287] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.853s	user 0.001s	sys 0.008s
I20260709 12:11:47.110911 22426 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:47.112968 22536 consensus_meta.cc:287] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.861s	user 0.008s	sys 0.000s
I20260709 12:11:47.113891 18012 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:47.114293 18012 pending_rounds.cc:85] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 10
I20260709 12:11:47.114503 18012 pending_rounds.cc:107] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:47.114712 18012 raft_consensus.cc:2889] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:47.116040 22649 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:47.117589 22450 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.000s
W20260709 12:11:47.121493 22130 consensus_meta.cc:287] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.507s	user 0.003s	sys 0.003s
I20260709 12:11:47.127391 22608 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.128415 22649 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:47.130287 17183 catalog_manager.cc:5697] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:47.132275 17183 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 14, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.151368 17291 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
W20260709 12:11:47.152724 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 451099us
I20260709 12:11:47.153658 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:47.163364 22419 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.913s	user 0.004s	sys 0.008s
W20260709 12:11:47.170518 22165 consensus_meta.cc:287] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.003s
W20260709 12:11:47.152127 22532 consensus_meta.cc:287] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.001s
I20260709 12:11:47.170156 22555 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.149225 22687 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:47.185981 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:47.180663 22511 consensus_meta.cc:287] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.005s
W20260709 12:11:47.189554 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.122030 22130 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.196678 22044 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:47.200405 22130 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:47.202621 22681 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:47.195132 22635 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:11:47.204879 22478 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:47.205526 22478 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:47.206284 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.209415 22665 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.210083 22478 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.189829 22555 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.216349 22555 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.216847 22555 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.217345 22555 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.218688 17436 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:47.221297 22594 consensus_meta.cc:287] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.000s
W20260709 12:11:47.229486 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.195595 22353 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:47.237323 22672 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
I20260709 12:11:47.187331 22532 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.269069 22532 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.172328 17183 catalog_manager.cc:5697] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 12. New cstate: current_term: 12 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:47.275907 17183 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:47.278088 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 3050) took 1528 ms. Trace:
I20260709 12:11:47.278618 17362 rpcz_store.cc:276] 0709 12:11:45.749517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.999226 (+249709us) service_pool.cc:224] Handling call
0709 12:11:46.007902 (+  8676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.150548 (+1142646us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:47.150580 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:47.150622 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:47.150655 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.277831 (+127176us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540032fad4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:47.277879 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.278017 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20511,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6128,"spinlock_wait_cycles":2626976128}
W20260709 12:11:47.279677 22692 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:11:47.280411 22522 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:47.239301 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.240056 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.240669 22226 raft_consensus.cc:3060] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.242192 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 2283) took 1200 ms. Trace:
W20260709 12:11:47.283221 22671 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.580s	user 0.002s	sys 0.000s
I20260709 12:11:47.283596 17366 rpcz_store.cc:276] 0709 12:11:46.041925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.049969 (+  8044us) service_pool.cc:224] Handling call
0709 12:11:46.050996 (+  1027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.279750 (+228754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.279784 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.280272 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.940976 (+660704us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:46.941018 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.241733 (+300715us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540032ebd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:47.241790 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.241853 (+    63us) raft_consensus.cc:1685] finished
0709 12:11:47.241866 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.242126 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1082,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":16117,"spinlock_wait_cycles":525198592,"thread_start_us":660394,"threads_started":1,"wal-append.queue_time_us":787441}
I20260709 12:11:47.283149 17441 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
W20260709 12:11:47.243212 22255 consensus_meta.cc:287] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.972s	user 0.011s	sys 0.000s
I20260709 12:11:47.286069 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 1110) took 1142 ms. Trace:
I20260709 12:11:47.286466 22255 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:47.288136 22646 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.288733 22255 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.243140 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 1112) took 1099 ms. Trace:
I20260709 12:11:47.244573 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.290305 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.290673 17367 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.291371 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.292449 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.292994 17436 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:47.245163 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:47.246874 22591 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.293834 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.289419 18012 rpcz_store.cc:276] 0709 12:11:46.143976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.144759 (+   783us) service_pool.cc:224] Handling call
0709 12:11:46.145013 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.115325 (+970312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.242911 (+127586us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b540067ff54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:47.243075 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227327872}
I20260709 12:11:47.182861 22165 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.296700 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.295862 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.297678 22165 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.247480 18011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 1115) took 1142 ms. Trace:
I20260709 12:11:47.298528 17436 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:47.249378 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.251444 22590 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.252148 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:47.300282 18010 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:47.253253 17439 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:47.253576 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.253858 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.188951 22450 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.307415 22450 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.307790 22635 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:47.286490 18013 rpcz_store.cc:276] 0709 12:11:46.143384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.143501 (+   117us) service_pool.cc:224] Handling call
0709 12:11:46.143780 (+   279us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:46.242560 (+ 98780us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:46.242588 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:46.243159 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 12:11:46.587904 (+344745us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:46.587945 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.264679 (+676734us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b5400630e54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:47.264735 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.282703 (+ 17968us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:47.285826 (+  3123us) raft_consensus.cc:1685] finished
0709 12:11:47.285849 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.286007 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"spinlock_wait_cycles":182419584,"thread_start_us":344365,"threads_started":1,"wal-append.queue_time_us":459620}
I20260709 12:11:47.309460 22044 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.305402 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:47.309969 17432 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
W20260709 12:11:47.305536 17174 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1c41ebef06654a43a98e69d0c065bba4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica aaafaad0810b4e95983d2d73ec814346 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:47.307953 22450 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:47.311344 22635 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.313125 22450 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.194397 22426 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.278165 17183 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 9, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 9 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:47.247435 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.247143 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:47.264166 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.316449 17183 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 16, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 16 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:47.318183 17183 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 11, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 11 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:47.319321 22689 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:47.319093 22688 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:47.319823 22689 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:47.320230 22689 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:47.320163 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 67957.6us
I20260709 12:11:47.330963 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:47.333402 18015 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:47.333482 22591 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:47.334889 22591 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.335247 22591 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.338984 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:47.338044 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:47.298449 18011 rpcz_store.cc:276] 0709 12:11:46.105078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.105240 (+   162us) service_pool.cc:224] Handling call
0709 12:11:46.105612 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.105976 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.106003 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.242903 (+136900us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b2c000b05a8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:11:46.243315 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.588335 (+345020us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:46.588370 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.588433 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.236726 (+648293us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:47.247262 (+ 10536us) raft_consensus.cc:1685] finished
0709 12:11:47.247282 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.247422 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1786,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":132269184,"thread_start_us":344685,"threads_started":1,"wal-append.queue_time_us":451548}
I20260709 12:11:47.340273 18013 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.328083 17404 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:47.345211 18008 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:47.346305 22556 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:47.346763 22556 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.347152 22556 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.348029 22597 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.351897 22597 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.359468 22481 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.363585 22511 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:47.310114 22044 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.371647 22450 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:47.196455 22687 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.389505 22635 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.221778 22594 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.392941 18006 raft_consensus.cc:1240] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:47.395115 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 1119) took 1173 ms. Trace:
I20260709 12:11:47.395449 18006 rpcz_store.cc:276] 0709 12:11:46.221751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.231594 (+  9843us) service_pool.cc:224] Handling call
0709 12:11:46.231932 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.393340 (+1161408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.394747 (+  1407us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400623ed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:47.395040 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2669613824}
I20260709 12:11:47.398345 22594 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:47.401067 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.401894 17437 raft_consensus.cc:2393] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 16: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:47.403434 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.404954 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:47.338459 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:47.406384 17435 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 8.
I20260709 12:11:47.319841 17183 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 7 to 11, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 11 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:47.407995 17183 catalog_manager.cc:5697] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 10, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 10 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:47.422845 17183 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 10, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 10 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
W20260709 12:11:47.409471 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 81501us
I20260709 12:11:47.411619 22511 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.430667 22687 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.418561 22044 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:47.424181 22279 consensus_meta.cc:287] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 12:11:47.425607 22689 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:47.441733 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.027s	sys 0.036s
W20260709 12:11:47.442119 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.027s	sys 0.036s
I20260709 12:11:47.426554 17981 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:47.409071 22555 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.435210 18013 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:47.431088 22511 raft_consensus.cc:3055] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:47.443840 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 631487us
I20260709 12:11:47.447075 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:47.447713 17291 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:47.449194 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.452410 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.440932 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:47.453442 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:47.453442 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.454084 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.454674 17364 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:47.454753 17362 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:47.455674 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.446179 22511 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:47.438278 22222 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:11:47.456763 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:47.457355 17363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.013s	sys 0.026s
W20260709 12:11:47.457686 17363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.013s	sys 0.026s
I20260709 12:11:47.459489 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:47.459719 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.460105 18013 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.460927 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:47.461081 17407 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:47.465122 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:47.466259 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:47.445694 22426 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.479629 18013 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:11:47.480859 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.489567 17366 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:47.490607 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.491320 17358 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:47.464649 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:47.480222 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:47.494918 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.442955 22481 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:47.443846 22044 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:11:47.405352 22591 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.489595 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.499426 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.518886 17360 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:47.519845 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.521219 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:47.501277 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:47.503486 18007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.037s	sys 0.036s
W20260709 12:11:47.522367 18007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.037s	sys 0.036s
I20260709 12:11:47.506433 17367 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.508344 17287 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.498694 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:47.458206 22571 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:47.473435 22226 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:47.526952 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:47.474567 22646 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:47.528208 17364 raft_consensus.cc:3060] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.442477 22279 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:47.522270 17358 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:47.529680 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.533690 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:47.535094 17366 pending_rounds.cc:85] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 10
I20260709 12:11:47.535481 17366 pending_rounds.cc:107] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:11:47.535733 17366 raft_consensus.cc:2889] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:47.536402 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.538409 22511 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.539386 22695 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.539896 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:47.540060 22695 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:47.540684 22495 consensus_queue.cc:1059] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:47.539887 22511 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.431236 17183 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 4 to 10, term changed from 11 to 14, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:47.542996 22591 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.543733 18012 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 16: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:47.543437 17183 catalog_manager.cc:5697] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 11, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 11 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:47.545315 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 1116) took 1077 ms. Trace:
I20260709 12:11:47.545215 17183 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:47.545866 22524 raft_consensus.cc:993] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:47.545692 18007 rpcz_store.cc:276] 0709 12:11:46.468075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.504007 (+ 35932us) service_pool.cc:224] Handling call
0709 12:11:46.504285 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.504489 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:46.910966 (+406477us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.544946 (+633980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:47.545007 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:47.545057 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.545125 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.545256 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22029,"prepare.queue_time_us":557747,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":11802,"raft.queue_time_us":23172,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":1016939,"threads_started":2}
I20260709 12:11:47.540586 17360 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.549571 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:47.452713 22594 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:47.550426 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:47.559314 17406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.012s	sys 0.085s
I20260709 12:11:47.512055 22598 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:47.584782 17287 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
W20260709 12:11:47.616957 17406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.012s	sys 0.090s
I20260709 12:11:47.490597 22549 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:47.604331 17364 raft_consensus.cc:2468] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:11:47.597165 22567 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:47.489648 22559 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
W20260709 12:11:47.597935 22671 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:11:47.622601 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 840144us
W20260709 12:11:47.617708 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 100786us
I20260709 12:11:47.618216 17434 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:47.623092 17980 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:11:47.622211 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 97913.3us
I20260709 12:11:47.651681 17361 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:11:47.652041 17361 pending_rounds.cc:85] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 11
I20260709 12:11:47.652245 17361 pending_rounds.cc:107] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:11:47.652508 17361 raft_consensus.cc:2889] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:47.652261 17407 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:47.478031 22208 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:47.708112 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:47.616648 22594 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.625696 22598 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.626331 22689 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.626695 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:47.751456 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:47.616950 17437 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.638208 22524 raft_consensus.cc:1081] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:47.639554 17978 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:47.758882 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 119405us
I20260709 12:11:47.641508 17364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:47.760226 17364 raft_consensus.cc:606] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:47.760591 17364 raft_consensus.cc:614] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:47.644532 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.608253 22685 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:47.762806 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 110621us
I20260709 12:11:47.548766 22646 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:47.550935 22571 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.709049 17360 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:47.832957 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:47.833559 17360 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.712476 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:47.748401 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.621361 17367 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
W20260709 12:11:47.836961 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 74777.4us
I20260709 12:11:47.756320 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:47.637264 22567 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:47.763981 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:47.764640 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:47.763661 17404 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:47.835861 17978 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:47.839460 17438 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.710770 22503 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.711491 22591 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:47.890470 22591 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:47.891502 22591 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.748040 22594 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:47.844091 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 131669us
W20260709 12:11:47.886197 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 235630us
I20260709 12:11:47.846042 17437 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:47.846354 17360 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:47.831197 22685 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:47.908407 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 376327us
I20260709 12:11:47.910243 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:47.849020 22646 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:47.849432 22536 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:47.851800 22532 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.852921 22606 raft_consensus.cc:2804] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:47.853317 22208 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:47.854640 17978 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:47.861330 17364 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:47.863173 22353 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.864452 22567 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:47.866899 22598 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:47.867528 17183 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:47.870795 22699 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:11:47.871690 22089 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:47.875036 22700 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:11:47.642059 22549 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:47.880290 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.885464 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 122000us
I20260709 12:11:47.886309 22130 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:47.886579 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 122997us
I20260709 12:11:47.887051 22522 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:47.888180 22590 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:11:47.906575 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:47.907778 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:47.912114 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:48.009542 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 101850us
W20260709 12:11:48.009634 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 97588.6us
I20260709 12:11:47.951707 22606 raft_consensus.cc:697] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:47.944324 17438 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:47.905999 22412 raft_consensus.cc:2764] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:11:47.843384 22637 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:47.933379 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:47.953236 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 98673.6us
I20260709 12:11:47.915161 22511 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.932045 22670 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:47.967499 22522 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.935459 22698 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:48.006026 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 474788us
I20260709 12:11:47.889988 22503 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.930960 22499 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:47.965350 17404 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:47.935927 22665 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 12:11:47.920105 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.014310 17360 raft_consensus.cc:606] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:47.956221 22532 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.945639 22536 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:47.967638 22646 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.023823 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 2279) took 2272 ms. Trace:
W20260709 12:11:48.043852 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 110561us
W20260709 12:11:48.016595 22703 log.cc:927] Time spent T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:11:48.048019 17255 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:48.145084 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 97145.4us
I20260709 12:11:48.145819 17255 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:48.146610 22635 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:48.147069 22635 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:48.048273 17283 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.005s	sys 0.026s
W20260709 12:11:48.048098 17291 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.007s	sys 0.014s
I20260709 12:11:48.147585 22635 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:48.148118 17291 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.007s	sys 0.015s
I20260709 12:11:48.009842 22581 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.103135 17360 raft_consensus.cc:614] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:48.148845 22581 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.020833 22597 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:48.149860 22597 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.150310 22597 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:48.151335 22706 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:48.018396 22524 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:48.156308 22646 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.046605 22522 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.160100 22597 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:48.106575 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 141328us
I20260709 12:11:47.962476 22089 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.114436 17363 rpcz_store.cc:276] 0709 12:11:45.750919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.012890 (+261971us) service_pool.cc:224] Handling call
0709 12:11:46.013227 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.944129 (+930902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.944164 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.944709 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.458017 (+513308us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:47.458063 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.458159 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.023543 (+565384us) raft_consensus.cc:1685] finished
0709 12:11:48.023571 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.023749 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34092,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":103170,"spinlock_wait_cycles":5376,"thread_start_us":1443435,"threads_started":2,"wal-append.queue_time_us":666021}
I20260709 12:11:48.100106 22637 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.164995 22637 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.162801 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:48.167025 17404 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:48.119005 22705 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:11:48.119513 22713 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.119872 22503 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:48.065044 22208 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:48.121474 22556 consensus_meta.cc:287] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
W20260709 12:11:48.126740 22707 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:11:48.127213 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.108574 22279 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:48.127564 22708 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:11:48.143539 22222 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.164441 22089 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:48.147843 17283 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.006s	sys 0.027s
I20260709 12:11:48.167788 22478 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.046133 22511 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.167629 22637 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:48.178530 22130 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.181348 22713 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.098878 22698 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.181469 22044 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.210700 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:48.211793 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:48.203444 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 185701us
I20260709 12:11:48.188078 22689 raft_consensus.cc:2764] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:11:48.194062 22670 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:48.266986 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.201515 22499 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:48.242659 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 231493us
W20260709 12:11:48.213843 17332 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.740s (SENT) [suppressed 6 similar messages]
I20260709 12:11:48.246043 17441 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:11:48.287171 22707 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:48.206346 22702 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:48.207949 22478 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.244029 22044 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.191043 22556 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.208509 22665 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.211303 22713 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:48.341662 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 194206us
I20260709 12:11:48.345096 17438 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:48.213943 22130 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.292393 22499 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:48.369261 22499 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.366194 22130 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:48.377748 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 260892us
I20260709 12:11:48.366460 22698 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:48.368119 22413 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:48.194223 22606 consensus_queue.cc:237] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.315891 22685 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:48.303103 22597 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:48.377238 17434 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:48.275707 22601 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.314143 22279 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:48.340920 22524 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:48.318534 22044 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.297501 22670 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.454589 17361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 996) took 2023 ms. Trace:
I20260709 12:11:48.564467 17361 rpcz_store.cc:276] 0709 12:11:46.431256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.517500 (+ 86244us) service_pool.cc:224] Handling call
0709 12:11:46.517793 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.652905 (+1135112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.454278 (+801373us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400242cd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:48.454505 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606900992}
W20260709 12:11:48.412259 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.562950 22635 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.364264 22665 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:48.593374 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 326810us
I20260709 12:11:48.492085 22581 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:48.542515 22499 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.441788 22413 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:48.661985 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 495002us
I20260709 12:11:48.666728 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:48.666971 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 372473us
I20260709 12:11:48.669202 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:48.675112 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:48.678764 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:48.679536 17435 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:48.682935 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:48.684427 22581 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:48.595571 22683 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:48.706411 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 492554us
I20260709 12:11:48.566385 22601 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.567528 22279 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.723909 17981 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:48.664614 22536 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:48.207034 17183 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 14, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 14 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:48.728269 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:48.729490 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:48.730784 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:48.737107 18007 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:48.698951 22532 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.742434 18007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:59534
I20260709 12:11:48.747638 18007 raft_consensus.cc:606] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:48.748142 18007 raft_consensus.cc:614] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:48.727108 22685 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:48.752628 17331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.009s	sys 0.009s
I20260709 12:11:48.723073 22581 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:48.726893 22163 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:48.758875 17331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.009s	sys 0.009s
I20260709 12:11:48.737020 22569 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:48.764261 17361 pending_rounds.cc:85] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:11:48.768172 17361 pending_rounds.cc:107] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:11:48.768461 17361 raft_consensus.cc:2889] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:48.712283 22689 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:48.740044 22737 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:48.752115 22511 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:48.721796 22683 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.746213 22597 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.755744 22685 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.827997 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:48.762445 22731 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:48.861359 17283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.006s	sys 0.020s
W20260709 12:11:48.880228 17283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.007s	sys 0.020s
I20260709 12:11:48.756649 22532 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:48.772800 22719 log.cc:927] Time spent T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:11:48.767850 22569 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.774814 22556 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:48.780555 22729 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:48.772774 22581 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.757838 22698 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:48.777104 22702 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:48.870631 22255 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.775617 22163 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.879046 22685 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.776621 22733 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:48.755046 22524 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.888805 22569 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:48.915167 22721 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.335s	user 0.001s	sys 0.001s
I20260709 12:11:48.911165 22252 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:48.916501 22732 consensus_queue.cc:1059] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 12:11:48.926728 22594 consensus_meta.cc:287] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.031s	user 0.012s	sys 0.000s
W20260709 12:11:48.931242 22522 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.000s
W20260709 12:11:48.931651 22723 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:11:48.913003 22040 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:48.922338 22255 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.934448 22635 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:48.914031 22729 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.917876 22698 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.885761 22731 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.945128 22665 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:48.944667 22670 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:48.920907 22702 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.941509 22522 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.943186 22594 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:48.986932 22717 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.433s	user 0.001s	sys 0.000s
I20260709 12:11:48.979986 22601 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:48.996285 22718 log.cc:927] Time spent T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 12:11:48.996420 22710 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.436s	user 0.000s	sys 0.001s
I20260709 12:11:48.993505 22739 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:49.002453 22735 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:11:49.002336 22739 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:48.934746 22733 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.004173 22739 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.005769 22702 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:48.996327 22714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.010s	sys 0.045s
I20260709 12:11:48.999089 22742 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:49.010068 22714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.010s	sys 0.046s
W20260709 12:11:49.011390 22736 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 12:11:49.014261 22731 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:49.014899 22729 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.012172 22742 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.017395 22742 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.040429 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:11:48.867463 17330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.010s	sys 0.017s
W20260709 12:11:49.049312 17330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.010s	sys 0.017s
W20260709 12:11:49.051543 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.052380 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.052502 17287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:36408
I20260709 12:11:49.054618 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.054944 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.055963 17286 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:49.057608 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.062237 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.063822 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.045903 17183 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 8, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 8 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:49.065632 17359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 998) took 1617 ms. Trace:
I20260709 12:11:49.066265 17359 rpcz_store.cc:276] 0709 12:11:47.447611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.447850 (+   239us) service_pool.cc:224] Handling call
0709 12:11:47.448122 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.491049 (+ 42927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.491082 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.491551 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.774089 (+1282538us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b1800237f40. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:49.064664 (+290575us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:49.064772 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.064913 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.064981 (+    68us) raft_consensus.cc:1685] finished
0709 12:11:49.064992 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.065352 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60398,"raft.queue_time_us":43172,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":20679,"spinlock_wait_cycles":12546304,"thread_start_us":290043,"threads_started":1,"wal-append.queue_time_us":1519280}
I20260709 12:11:49.067981 17183 catalog_manager.cc:5697] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 9, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 9 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:49.069391 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:49.070421 17359 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.071890 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:49.083015 17366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 3062) took 1586 ms. Trace:
I20260709 12:11:49.084045 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 2305) took 1569 ms. Trace:
I20260709 12:11:49.083653 17366 rpcz_store.cc:276] 0709 12:11:47.496154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.500032 (+  3878us) service_pool.cc:224] Handling call
0709 12:11:47.534871 (+ 34839us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:47.576184 (+ 41313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.576224 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:47.576885 (+   661us) log.cc:844] Serialized 52 byte log entry
0709 12:11:48.048656 (+471771us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:48.048702 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.048779 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.082433 (+1033654us) raft_consensus.cc:1685] finished
0709 12:11:49.082479 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.082812 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12446,"raft.queue_time_us":45198,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":7673,"thread_start_us":471416,"threads_started":1,"wal-append.queue_time_us":786047}
I20260709 12:11:49.084614 17365 rpcz_store.cc:276] 0709 12:11:47.514150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.154724 (+640574us) service_pool.cc:224] Handling call
0709 12:11:48.155081 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.592417 (+437336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.592452 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.651099 (+ 58647us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.083266 (+432167us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:49.083390 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.083518 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.083591 (+    73us) raft_consensus.cc:1685] finished
0709 12:11:49.083605 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.083847 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35868,"raft.queue_time_us":185960,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":30553,"thread_start_us":756579,"threads_started":2,"wal-append.queue_time_us":298094}
I20260709 12:11:49.086791 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:49.087158 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.083076 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 3073) took 1578 ms. Trace:
I20260709 12:11:48.925813 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 3068) took 1428 ms. Trace:
I20260709 12:11:49.087702 17360 rpcz_store.cc:276] 0709 12:11:47.504774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.149136 (+644362us) service_pool.cc:224] Handling call
0709 12:11:48.149471 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.200826 (+ 51355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.200875 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.208292 (+  7417us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.723522 (+515230us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:48.723562 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.723630 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.082368 (+358738us) raft_consensus.cc:1685] finished
0709 12:11:49.082421 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.082840 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41333,"raft.queue_time_us":153807,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":7171,"thread_start_us":433944,"threads_started":1,"wal-append.queue_time_us":695965}
I20260709 12:11:49.094551 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.096253 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.097244 17183 catalog_manager.cc:5697] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:49.087041 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:49.090139 17367 rpcz_store.cc:276] 0709 12:11:47.497667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.837616 (+339949us) service_pool.cc:224] Handling call
0709 12:11:47.837987 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.844192 (+  6205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.844224 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.851257 (+  7033us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.182368 (+331111us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:48.182416 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.182505 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.925542 (+743037us) raft_consensus.cc:1685] finished
0709 12:11:48.925566 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.925734 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19726,"raft.queue_time_us":6278,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":330760,"threads_started":1,"wal-append.queue_time_us":719903}
W20260709 12:11:49.098541 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 419984us
I20260709 12:11:49.101110 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:49.100158 17183 catalog_manager.cc:5697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 10, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 10 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:49.115334 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 1126) took 1655 ms. Trace:
I20260709 12:11:49.115847 18010 rpcz_store.cc:276] 0709 12:11:47.459525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.462849 (+  3324us) service_pool.cc:224] Handling call
0709 12:11:47.463178 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.463555 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.463585 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.464073 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.962844 (+498771us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:47.962885 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.962958 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.114748 (+1151790us) raft_consensus.cc:1685] finished
0709 12:11:49.114788 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.115033 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":764,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7717,"thread_start_us":498459,"threads_started":1,"wal-append.queue_time_us":876684}
I20260709 12:11:49.101537 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:48.954627 22040 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.120965 22163 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:49.123705 22040 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.124226 22163 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.124490 22040 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:49.125285 22040 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.129899 22040 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.130574 22040 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:49.125190 22163 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:48.939258 22252 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.117082 17183 catalog_manager.cc:5697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 7 to 8, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 8 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:49.134708 22252 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.105674 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.135018 17183 catalog_manager.cc:5697] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:49.104627 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.137526 17183 catalog_manager.cc:5697] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 4 to 11, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 11 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:49.139881 17183 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 16, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 16 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:49.141255 22252 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:49.142365 22252 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.143313 22163 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.098042 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.105079 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:49.149652 17366 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:49.131265 22040 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.153893 22040 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.161863 17183 catalog_manager.cc:5697] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 11, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 11 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
W20260709 12:11:49.155961 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.146720 22252 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.165272 22279 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:48.964947 22413 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.197798 22683 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:49.204599 22665 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:49.212797 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 1010) took 1606 ms. Trace:
W20260709 12:11:49.213030 17291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.004s	sys 0.000s
W20260709 12:11:48.977429 22419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.014s	sys 0.022s
I20260709 12:11:49.165113 22282 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:48.945753 22343 raft_consensus.cc:3055] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:49.184144 22450 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.304279 22726 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:49.320801 17291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.005s	sys 0.000s
I20260709 12:11:49.323022 22282 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.317559 17358 rpcz_store.cc:276] 0709 12:11:47.606949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.374784 (+767835us) service_pool.cc:224] Handling call
0709 12:11:48.375113 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.655497 (+280384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.655529 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:48.655570 (+    41us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:11:48.655601 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.212282 (+556681us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54001130d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:49.212344 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.212615 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644359424}
I20260709 12:11:49.338783 22450 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.340626 22670 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:49.314903 22040 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.345679 17359 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:49.348430 22670 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:49.384894 22670 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.386705 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 1124) took 1910 ms. Trace:
I20260709 12:11:49.387173 17283 rpcz_store.cc:276] 0709 12:11:47.476258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.476391 (+   133us) service_pool.cc:224] Handling call
0709 12:11:47.476701 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.477040 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:48.193612 (+716572us) log.cc:844] Serialized 14 byte log entry
0709 12:11:48.880697 (+687085us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.049258 (+168561us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.049635 (+   377us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:49.049742 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.049916 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.386282 (+336366us) raft_consensus.cc:1685] finished
0709 12:11:49.386311 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.386516 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":685121,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":59236,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":33963,"spinlock_wait_cycles":3033344,"thread_start_us":1272160,"threads_started":2,"wal-append.queue_time_us":765600}
I20260709 12:11:49.389359 22089 consensus_queue.cc:1059] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:49.352208 17287 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:11:49.340911 22499 consensus_meta.cc:287] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.679s	user 0.013s	sys 0.006s
I20260709 12:11:49.352866 22343 raft_consensus.cc:740] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:49.354265 22726 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.354635 22635 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:49.392297 22419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.018s	sys 0.031s
I20260709 12:11:49.318699 22665 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:49.358707 17257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.005s	sys 0.009s
I20260709 12:11:49.318849 22252 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.359903 18015 raft_consensus.cc:2393] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 9: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:49.341734 22450 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.360875 22511 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.365404 22698 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:49.368633 22581 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.370051 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.370280 22634 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.377213 22594 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:49.377926 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 59994.1us
I20260709 12:11:49.382714 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 1005) took 1898 ms. Trace:
I20260709 12:11:49.396139 22252 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.398852 17362 rpcz_store.cc:276] 0709 12:11:47.484433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.484673 (+   240us) service_pool.cc:224] Handling call
0709 12:11:47.490942 (+  6269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.491333 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:47.519618 (+ 28285us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.960997 (+441379us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.038840 (+ 77843us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.039021 (+   181us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:48.039056 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.039133 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.387101 (+347968us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b480027e358. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:11:49.379353 (+992252us) raft_consensus.cc:1685] finished
0709 12:11:49.382284 (+  2931us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.382533 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53915,"prepare.queue_time_us":35915,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":3166,"raft.run_cpu_time_us":3519,"raft.run_wall_time_us":986750,"spinlock_wait_cycles":5251840,"thread_start_us":379409,"threads_started":1,"wal-append.queue_time_us":663478}
I20260709 12:11:49.352427 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 1129) took 1805 ms. Trace:
W20260709 12:11:49.385532 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 48167us
I20260709 12:11:49.392961 17287 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:49.395318 17257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.006s	sys 0.009s
I20260709 12:11:49.400226 22769 raft_consensus.cc:3055] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:49.342790 22040 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.390774 22279 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.400859 17291 rpcz_store.cc:276] 0709 12:11:47.546941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.547092 (+   151us) service_pool.cc:224] Handling call
0709 12:11:47.547402 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.547590 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:48.148484 (+600894us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.351756 (+1203272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.351873 (+   117us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:49.352032 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.352150 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.352346 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23460,"prepare.queue_time_us":614901,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":498537,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3851,"thread_start_us":1750529,"threads_started":3,"wal-append.queue_time_us":596857}
I20260709 12:11:49.394143 22665 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:49.413806 22044 consensus_meta.cc:287] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.844s	user 0.022s	sys 0.005s
W20260709 12:11:49.414567 22713 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.038s	user 0.008s	sys 0.007s
I20260709 12:11:49.414484 22044 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.415436 22713 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.417444 22044 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.418387 22713 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.422091 22634 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.423120 22172 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:49.427750 22634 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.428318 22532 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:49.407855 22419 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.409950 22769 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:49.392650 22635 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.422127 17255 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:49.450083 22172 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.451385 22522 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:49.453413 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.434964 22685 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:49.456786 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.463713 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 294392us
I20260709 12:11:49.456028 22511 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.475703 22569 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.466920 22172 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.481940 22511 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.460426 22044 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:49.407785 22343 consensus_queue.cc:260] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.374663 17183 catalog_manager.cc:5697] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 10, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 10 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:49.487838 22569 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.490911 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:49.447187 22714 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:49.487727 22481 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.517525 17258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.132s	user 0.028s	sys 0.036s
W20260709 12:11:49.518051 17258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.028s	sys 0.036s
I20260709 12:11:49.518409 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.519744 22714 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.520970 22567 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.460451 22279 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:49.518424 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 1.13846e+06us
I20260709 12:11:49.525386 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.525195 22769 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.526957 22769 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.528879 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.529664 17284 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:49.530838 17288 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:49.530467 22481 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.533193 22481 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.533579 22713 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.542258 22713 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.543357 22252 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.534327 18012 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:49.535004 22571 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.535378 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.530652 17283 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:49.540521 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.541190 22608 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:49.543018 17291 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:49.482788 22419 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.545105 17287 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.556126 18010 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:49.549085 22608 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:49.558220 22608 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.559096 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.559585 22608 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:49.523085 22343 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.533934 22481 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.547789 17285 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:49.560838 22481 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.566323 22481 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.577044 22040 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:49.580561 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.524945 22044 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:49.583452 22780 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:49.584041 22279 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.585068 22685 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.586272 22635 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.569854 22450 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:49.602366 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.559834 22646 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.608144 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.615003 17285 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
W20260709 12:11:49.610898 22725 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.242s	user 0.002s	sys 0.001s
I20260709 12:11:49.619096 22733 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.633709 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.634716 18007 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:49.629359 18010 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
W20260709 12:11:49.642005 17438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 1054) took 1431 ms (client timeout 1702 ms). Trace:
W20260709 12:11:49.642565 17438 rpcz_store.cc:269] 0709 12:11:48.210312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.210444 (+   132us) service_pool.cc:224] Handling call
0709 12:11:49.641579 (+1431135us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b54001473d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:49.641778 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228568960}
I20260709 12:11:49.651386 22044 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.656497 22712 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.651400 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.658952 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.666478 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.666608 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.652082 22634 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.667307 18013 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:49.680967 22634 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.684065 22714 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.630244 22450 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:49.686671 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.689402 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.694137 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.695575 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.696244 18011 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 8.
I20260709 12:11:49.697065 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.698781 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.700366 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:49.700700 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.701122 17437 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.701323 17359 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:11:49.700384 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.701779 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:49.702368 18015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 1128) took 2242 ms (client timeout 2385 ms). Trace:
W20260709 12:11:49.702783 18015 rpcz_store.cc:269] 0709 12:11:47.460182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.460582 (+   400us) service_pool.cc:224] Handling call
0709 12:11:49.702083 (+2241501us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400670f54. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:49.702269 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3968599424}
I20260709 12:11:49.704259 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:49.707129 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.710997 17437 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
W20260709 12:11:49.711964 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.713989 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.706501 17358 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:49.715721 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.714087 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.719594 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.719874 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.720381 17435 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:49.724897 18011 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:49.686756 22712 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.725183 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:49.724920 18010 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:49.740736 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.741631 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.742646 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.743558 17285 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:49.748230 17286 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:49.716683 22713 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.748946 22646 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.759867 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:49.755645 17333 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:49.747766 22282 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.767628 17285 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:49.763127 17255 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:49.769129 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.770215 22745 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.772379 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.767164 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.781250 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.781972 17289 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:49.785806 17333 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:49.761407 22646 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.787832 17435 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:49.789332 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:49.789857 17364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 3071) took 2279 ms. Trace:
I20260709 12:11:49.790683 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.793447 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:49.795225 17440 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:49.778808 22040 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.799387 22745 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.803182 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.804005 17433 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:49.804553 22726 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.804929 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.806424 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.794325 17407 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:49.807862 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:49.809054 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:49.812319 17290 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:49.790067 22419 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.796198 22713 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:49.804478 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.794523 22282 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:49.811895 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:49.822253 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.826253 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.827903 22130 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:11:49.825928 17291 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:49.823392 17439 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:49.807202 22040 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:49.825464 22282 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:49.834200 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:49.835294 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.823745 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:49.832006 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:49.835671 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.836467 17284 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:11:49.837560 17358 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:49.838030 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.817071 22089 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:49.834390 22282 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:49.840145 17362 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:11:49.791563 17364 rpcz_store.cc:276] 0709 12:11:47.504276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.951919 (+447643us) service_pool.cc:224] Handling call
0709 12:11:47.954543 (+  2624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.956494 (+  1951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.956529 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.957040 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.243248 (+286208us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:48.243302 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.243395 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.610038 (+1366643us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:49.756286 (+146248us) raft_consensus.cc:1685] finished
0709 12:11:49.756311 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.783725 (+ 27414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1514,"raft.queue_time_us":4723,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":44223,"spinlock_wait_cycles":19180288,"thread_start_us":285835,"threads_started":1,"wal-append.queue_time_us":410848}
I20260709 12:11:49.841869 17438 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.843675 22771 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.844414 22771 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.845223 17978 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:49.846598 22524 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:49.846779 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:49.847245 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:49.848076 22569 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:49.848676 22569 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:49.849392 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.839875 22089 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:49.849740 22569 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.850517 22089 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:49.851636 22791 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:49.841655 17362 pending_rounds.cc:85] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 9
I20260709 12:11:49.854525 17362 pending_rounds.cc:107] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:11:49.854843 17362 raft_consensus.cc:2889] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:49.856076 22604 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:49.857360 17436 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:49.858939 22771 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.848793 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:49.862635 17284 raft_consensus.cc:2410] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:49.864089 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:49.865307 22787 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:49.871564 22665 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.872793 17360 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:49.874235 22089 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:49.875808 22786 log.cc:927] Time spent T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:49.876492 22089 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.841467 22450 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:49.879735 21956 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.880206 21956 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:49.880570 21956 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.850734 17358 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:49.886279 22738 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:49.886819 22738 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.887190 22738 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.825026 22713 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:49.888661 17435 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 9.
I20260709 12:11:49.887818 22549 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:49.874433 22712 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:49.894586 17365 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:11:49.895457 22745 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:49.896329 17434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 2203) took 2133 ms (client timeout 1684 ms). Trace:
I20260709 12:11:49.900905 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.836298 22040 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.873870 22665 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:49.930557 17174 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1c41ebef06654a43a98e69d0c065bba4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica aaafaad0810b4e95983d2d73ec814346 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:49.904934 17432 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:49.926585 22419 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.933740 22419 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:49.937037 22419 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:49.899749 22646 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:49.901906 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.939249 22776 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260709 12:11:49.940017 17980 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:11:49.905403 17434 rpcz_store.cc:269] 0709 12:11:47.763061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.763723 (+   662us) service_pool.cc:224] Handling call
0709 12:11:49.895901 (+2132178us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540006d954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:49.896125 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233570688}
I20260709 12:11:49.942821 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.943704 17434 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:49.944585 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.945642 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.947288 22590 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:49.947741 22590 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.948065 22590 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.951610 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:49.926146 22412 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:49.907445 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.957736 17440 raft_consensus.cc:2468] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:49.958835 17432 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:49.898005 22734 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.120s	user 0.000s	sys 0.001s
I20260709 12:11:49.925709 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:49.964118 22773 log.cc:927] Time spent T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.437s	user 0.002s	sys 0.000s
I20260709 12:11:49.966871 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:49.967154 22777 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.432s	user 0.000s	sys 0.003s
I20260709 12:11:49.973667 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:49.902241 22713 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:49.982138 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 151406us
W20260709 12:11:49.997478 22724 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 1.622s	user 0.003s	sys 0.000s
W20260709 12:11:50.001861 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 49324.5us
W20260709 12:11:50.003865 18012 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 1134) took 1276 ms (client timeout 1631 ms). Trace:
I20260709 12:11:50.004382 17981 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:50.005406 17981 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:50.006459 22549 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:50.007373 17287 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:50.007607 17433 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:50.009114 22478 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:50.011523 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:50.013195 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:50.014839 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 44662.9us
I20260709 12:11:49.997885 17441 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
I20260709 12:11:50.020076 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.016448 17440 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:11:50.004384 18012 rpcz_store.cc:269] 0709 12:11:48.727557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.728013 (+   456us) service_pool.cc:224] Handling call
0709 12:11:50.003602 (+1275589us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54005f2dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:50.003773 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682528128}
I20260709 12:11:50.032094 17361 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.028707 17365 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:11:50.045478 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:50.048908 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.058514 17438 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:50.060479 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:50.062952 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:50.065392 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 292558us
I20260709 12:11:50.035045 22549 raft_consensus.cc:697] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:50.066237 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.067473 17980 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:50.068776 17436 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:50.069921 22549 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.066169 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.073374 17436 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:50.075695 17433 raft_consensus.cc:2393] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:50.085939 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.100226 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.092092 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:50.105229 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.111860 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.081017 22524 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.147956 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:50.151319 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 59310.7us
I20260709 12:11:50.152256 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.158234 17980 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:50.159582 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:50.161170 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.161871 17292 raft_consensus.cc:1275] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:11:50.162313 17292 pending_rounds.cc:85] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 9
I20260709 12:11:50.162377 22788 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.163314 17292 pending_rounds.cc:107] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:11:50.170598 17292 raft_consensus.cc:2889] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:50.173331 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 83160.8us
I20260709 12:11:50.165035 17438 raft_consensus.cc:2368] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
I20260709 12:11:50.167608 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.167831 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.168428 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:50.178216 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.179808 17284 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:50.144008 22524 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:50.180946 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.190474 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.151528 22419 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:50.197239 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.199910 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.200739 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.201323 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.206231 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.207226 17285 raft_consensus.cc:2410] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:50.209045 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.206995 17291 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:50.179872 22685 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.204893 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.204325 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.194470 22720 raft_consensus.cc:2804] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:50.192734 22524 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:50.220000 22426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.806s	user 0.018s	sys 0.033s
I20260709 12:11:50.222666 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.222626 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:50.226783 17333 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:50.227228 17288 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:50.228193 17333 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:50.229034 17284 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:50.229568 22412 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.229964 22412 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:50.230412 22412 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.234568 22598 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.235042 22598 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:50.235409 22598 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.237102 22282 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.199894 22666 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:11:50.204051 22163 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:50.240903 22605 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:50.241928 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.243882 22255 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:50.229166 22726 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:50.247958 22726 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:50.249051 22726 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:50.254920 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:50.257061 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.192041 22771 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:50.257947 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:50.259662 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 45543.8us
W20260709 12:11:50.225415 22426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.851s	user 0.019s	sys 0.034s
I20260709 12:11:50.263443 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.264786 17285 raft_consensus.cc:2410] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:50.216063 22685 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:50.269743 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.271258 17285 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:50.265915 22646 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:50.280150 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.268071 22685 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.222306 22788 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:50.285378 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.287585 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.288843 17333 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:50.270503 22727 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:50.273739 22666 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:11:50.295284 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.294699 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.283377 22646 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:50.264175 22738 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:50.326013 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.313973 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:50.323915 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:50.312498 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:50.336827 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.327508 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:50.329968 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:50.338608 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:50.327181 17333 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:50.343653 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:50.344206 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:50.345060 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:50.347492 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 255424us
I20260709 12:11:50.348421 17981 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:50.300062 22255 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.366460 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.369524 17359 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:50.334198 22646 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:50.328816 22795 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.429s	user 0.003s	sys 0.005s
I20260709 12:11:50.363854 22255 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:50.384325 22255 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.388562 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.380029 22670 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.327183 22727 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.405808 17358 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:50.418732 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.401147 22670 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:50.387706 22713 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.429186 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.412061 22282 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:50.433705 22637 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:50.436131 22412 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:50.397374 22598 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:50.438687 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.438930 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:50.439090 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.439703 22598 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:50.440024 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.439891 17291 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 15: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:50.451375 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.451707 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.441319 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.457211 17285 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:50.452188 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.452349 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.452525 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.438557 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.452771 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.459194 17283 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:50.467392 17292 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:50.467799 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.428629 22670 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.471195 17284 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:50.485697 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:50.442404 22800 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:11:50.495340 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.495961 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.503756 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:50.504856 22590 consensus_meta.cc:287] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
I20260709 12:11:50.503746 22524 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.507702 22524 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:50.497193 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.509917 17285 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:50.510217 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.511901 22646 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.505342 22590 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.515398 18014 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 11: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:50.516384 17362 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:50.518412 22646 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:50.518707 22788 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:50.520828 22733 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:50.512116 22727 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:50.534739 18010 raft_consensus.cc:1240] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:50.535292 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.539099 17283 raft_consensus.cc:2410] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:11:50.546274 17361 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 12:11:50.546828 17361 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:50.570967 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.571300 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.572010 17289 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:50.572453 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.573134 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.573745 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.574525 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.573962 17283 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:50.575984 22738 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:50.577241 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.578433 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.591428 22738 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:50.596653 22738 raft_consensus.cc:3055] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:50.597185 22738 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:50.599472 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:50.600328 17435 raft_consensus.cc:2368] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
I20260709 12:11:50.562562 22412 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:50.602519 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.603874 17439 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:50.604655 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.605561 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.533681 22685 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:50.607478 22040 consensus_meta.cc:287] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.001s
I20260709 12:11:50.631810 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:50.657596 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:50.652904 17332 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:50.667999 22728 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:50.668517 22728 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:50.682540 22634 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:50.688431 22163 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:50.688907 22163 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:50.681787 22590 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:50.598137 22738 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.640599 22040 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:50.720739 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 67950us
I20260709 12:11:50.639137 22412 consensus_queue.cc:1048] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
W20260709 12:11:50.724828 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.724993 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 110681us
I20260709 12:11:50.689807 22163 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:50.717929 22282 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:50.718271 22478 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.712668 22634 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:11:50.715878 22720 raft_consensus.cc:697] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:11:50.740736 17404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.024s	sys 0.039s
W20260709 12:11:50.747571 17404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.024s	sys 0.039s
W20260709 12:11:50.748561 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.736662 22738 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.798270 17406 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:50.801116 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:50.751482 22163 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.726810 22255 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:50.808904 22687 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.809549 22040 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:50.814343 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 65313.2us
I20260709 12:11:50.815471 22634 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.826877 22720 consensus_queue.cc:237] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.836164 22713 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:50.814437 21956 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.933s	user 0.014s	sys 0.000s
W20260709 12:11:50.855345 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 105151us
I20260709 12:11:50.856639 22426 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:50.857105 22426 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:50.858028 22426 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:50.858503 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.859323 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.881670 17288 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 9.
I20260709 12:11:50.884145 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.884886 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.840483 22807 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.840538 22255 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:50.889317 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:50.886417 17333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.025s
I20260709 12:11:50.891207 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.841796 22163 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.891302 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:50.894028 17333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.007s	sys 0.026s
I20260709 12:11:50.893448 17284 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.895984 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:50.896302 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 534214us
I20260709 12:11:50.901655 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:50.904475 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.915109 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:50.908093 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 451706us
I20260709 12:11:50.896500 22426 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:50.898859 17366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.016s	sys 0.019s
I20260709 12:11:50.912321 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:50.919207 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.882887 21956 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:50.914466 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.917846 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.924407 17288 raft_consensus.cc:2468] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
W20260709 12:11:50.920207 17366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.016s	sys 0.019s
I20260709 12:11:50.917397 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:50.932726 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.934077 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.934250 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:50.935235 17364 raft_consensus.cc:2368] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
I20260709 12:11:50.935969 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.937098 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.937616 17289 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.925988 22815 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.939081 22815 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:50.939553 22815 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.941769 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:50.946904 17361 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:50.948192 22728 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:50.949301 22728 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.951812 17361 raft_consensus.cc:1240] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:50.953316 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:50.953959 17290 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.935369 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:50.958243 17285 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:50.960876 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:50.970775 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.978147 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 60804.8us
I20260709 12:11:50.981439 17284 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:50.959656 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:50.994987 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:50.998180 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:50.998842 17440 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.003934 17434 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:50.906411 22670 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.006204 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:51.006175 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:51.009657 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:51.012252 17331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.010s	sys 0.026s
W20260709 12:11:51.012691 17331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.010s	sys 0.027s
I20260709 12:11:51.012956 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:51.013716 18014 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:51.014238 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 285407us
I20260709 12:11:51.015578 17332 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.016885 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.018872 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:51.019433 21956 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:51.020228 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:51.022979 17362 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.012897 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:51.026208 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.907603 22807 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.027868 18011 raft_consensus.cc:2393] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 11: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:50.916680 22163 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.028307 17366 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:51.019594 22670 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:51.014025 18014 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:51.032265 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:51.043586 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:50.999610 22569 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.999476 22726 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:51.075783 17286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.019s
I20260709 12:11:51.030792 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:50.910841 22811 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:11:51.032598 17290 raft_consensus.cc:2468] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:51.044938 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:51.096469 17441 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:51.047024 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:51.092350 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:51.047297 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 44003.3us
I20260709 12:11:51.063027 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:51.091269 17286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.010s	sys 0.019s
W20260709 12:11:51.092796 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.062582 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:51.030529 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:51.066139 17433 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:51.061486 17434 raft_consensus.cc:1240] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:51.094084 17285 raft_consensus.cc:3055] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:51.100332 17285 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:51.094908 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:51.099716 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:51.049124 22637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.031s	sys 0.049s
I20260709 12:11:51.028354 22806 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.029883 22713 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.111686 17366 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:51.112865 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:51.116899 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:51.117602 17359 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.107941 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:51.109661 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.030124 22634 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:11:51.126370 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:51.121224 22598 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.127369 22598 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.129595 22598 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:51.130434 22255 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.130833 22255 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:51.131170 22255 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.097379 22733 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.135299 22733 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:51.135917 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 117809us
I20260709 12:11:51.136749 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.137660 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:51.138568 18011 raft_consensus.cc:1240] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:51.139084 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:51.140340 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:51.105345 22637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.031s	sys 0.050s
I20260709 12:11:51.141299 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:51.122049 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:51.126605 17287 raft_consensus.cc:1240] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:51.124720 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 92521.1us
I20260709 12:11:51.143838 17436 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.099495 22282 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.119014 17285 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.155622 22040 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:51.045799 22208 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.191s
I20260709 12:11:51.147648 17404 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:51.161574 17367 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:51.157589 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.108945 22806 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:51.164924 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:51.110941 22604 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.040452 22549 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 12:11:51.118638 22745 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.168286 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:51.184237 17287 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:51.093847 22569 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.153712 17440 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:51.196940 17289 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
W20260709 12:11:51.162251 22665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.017s	sys 0.011s
W20260709 12:11:51.221729 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 83805us
I20260709 12:11:51.223119 17258 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.148078 22637 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:51.145423 22634 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:51.226415 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 63148.1us
I20260709 12:11:51.226436 17285 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:51.227520 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 3099) took 1056 ms. Trace:
I20260709 12:11:51.169437 17433 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:51.230486 17365 rpcz_store.cc:276] 0709 12:11:50.170888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.171050 (+   162us) service_pool.cc:224] Handling call
0709 12:11:50.171370 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.202396 (+ 31026us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:50.700721 (+498325us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.225909 (+525188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.225959 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:51.226000 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.226068 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.227463 (+  1395us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24137,"prepare.queue_time_us":61100,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":61695,"thread_start_us":898321,"threads_started":2}
I20260709 12:11:51.183843 22806 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:51.279997 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 122574us
I20260709 12:11:51.283397 17360 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:51.222469 22665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.018s	sys 0.011s
I20260709 12:11:51.286773 18009 raft_consensus.cc:1275] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:51.195757 22282 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.301719 17255 leader_election.cc:400] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
I20260709 12:11:51.302479 17255 leader_election.cc:403] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:51.303483 22634 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
I20260709 12:11:51.304821 22634 consensus_queue.cc:1059] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:51.306201 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 77859.5us
I20260709 12:11:51.313638 17978 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.283703 22478 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:51.323227 17285 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:51.309468 17359 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
W20260709 12:11:51.343022 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.343356 17285 pending_rounds.cc:85] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 7
W20260709 12:11:51.343022 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 120000us
I20260709 12:11:51.343824 17285 pending_rounds.cc:107] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:51.345244 17285 raft_consensus.cc:2889] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.346771 17358 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:51.351881 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.359561 21956 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:51.344302 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 43522.8us
I20260709 12:11:51.299712 22412 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:51.367924 22685 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:51.368988 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 1132) took 1019 ms. Trace:
I20260709 12:11:51.371526 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:51.372815 21956 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.229820 22604 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.379070 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:51.387204 22549 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.387277 22823 consensus_queue.cc:1059] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:11:51.389149 22823 raft_consensus.cc:3055] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.389590 22823 raft_consensus.cc:740] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:51.390441 22823 consensus_queue.cc:260] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.390990 22163 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:51.389215 22604 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:51.391690 22823 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.392081 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.394732 17978 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.369381 18008 rpcz_store.cc:276] 0709 12:11:50.349922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.350201 (+   279us) service_pool.cc:224] Handling call
0709 12:11:50.374018 (+ 23817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.391745 (+ 17727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.391779 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.413443 (+ 21664us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.913241 (+499798us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:51.006411 (+ 93170us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.023612 (+ 17201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.023678 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.368692 (+345014us) raft_consensus.cc:1685] finished
0709 12:11:51.368711 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.368898 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54477,"prepare.queue_time_us":90331,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":149669,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":13169,"thread_start_us":479008,"threads_started":1,"wal-append.queue_time_us":944805}
I20260709 12:11:51.370700 22478 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:51.385380 22820 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:51.428151 17363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.009s	sys 0.025s
I20260709 12:11:51.416612 22634 raft_consensus.cc:3055] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:51.421377 17436 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:51.431733 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:51.433531 22282 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:51.434070 22825 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.434651 22815 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.435017 22819 consensus_queue.cc:1059] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:11:51.436074 22819 raft_consensus.cc:3055] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:51.436406 22819 raft_consensus.cc:740] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:51.436950 22815 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:51.437247 22819 consensus_queue.cc:260] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:51.438603 22830 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:11:51.425077 22813 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.442770 22813 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.444957 22813 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:51.450829 22826 log.cc:927] Time spent T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:11:51.451221 17287 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:51.452466 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 1149) took 1075 ms. Trace:
I20260709 12:11:51.452536 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:51.452298 22478 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:51.454275 22807 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:51.455356 22816 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:11:51.456111 17980 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:51.458889 22825 raft_consensus.cc:2804] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:51.459466 22825 raft_consensus.cc:697] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:51.460318 22825 consensus_queue.cc:237] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.462872 22720 consensus_queue.cc:1059] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:51.464298 22604 raft_consensus.cc:3055] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:51.452998 18006 rpcz_store.cc:276] 0709 12:11:50.376935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.377095 (+   160us) service_pool.cc:224] Handling call
0709 12:11:50.385738 (+  8643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.400503 (+ 14765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.400537 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.415276 (+ 14739us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.907510 (+492234us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:50.907550 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.907620 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.452276 (+544656us) raft_consensus.cc:1685] finished
0709 12:11:51.452294 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.452409 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":865,"raft.queue_time_us":115982,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":59,"thread_start_us":436203,"threads_started":1,"wal-append.queue_time_us":709073}
I20260709 12:11:51.465339 17980 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:51.453267 17289 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:51.422549 22803 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.464697 22604 raft_consensus.cc:740] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:51.475391 22732 consensus_queue.cc:1059] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 12:11:51.431356 22634 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:51.420023 22827 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.293s
I20260709 12:11:51.486819 22732 raft_consensus.cc:2764] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:11:51.491470 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 59820.7us
W20260709 12:11:51.493283 22828 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:11:51.482704 22569 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:51.416796 22637 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.495625 18014 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.496661 18014 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.484148 22590 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:51.498890 17438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33816 (request call id 2039) took 1415 ms. Trace:
I20260709 12:11:51.499228 22604 consensus_queue.cc:260] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.500598 22604 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.482307 22813 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:51.499279 17438 rpcz_store.cc:276] 0709 12:11:50.083449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.184881 (+101432us) service_pool.cc:224] Handling call
0709 12:11:50.201332 (+ 16451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.706276 (+504944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.706311 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.723921 (+ 17610us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.234722 (+510801us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:51.234766 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.234871 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.498615 (+263744us) raft_consensus.cc:1685] finished
0709 12:11:51.498637 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.498804 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10163,"raft.queue_time_us":47578,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":9935,"thread_start_us":941390,"threads_started":2,"wal-append.queue_time_us":703308}
I20260709 12:11:51.508782 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:51.498227 22831 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
I20260709 12:11:51.427172 22820 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:51.514089 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.489038 22819 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:51.543401 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.547323 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:51.510078 22590 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:51.540089 22419 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:51.538125 22813 raft_consensus.cc:697] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:51.513303 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:51.558007 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:51.557989 18011 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 18.
I20260709 12:11:51.565871 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:51.566747 17438 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:11:51.536689 22608 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:11:51.585932 17407 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:51.593434 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 84724.4us
I20260709 12:11:51.594398 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.553534 22731 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:11:51.596087 22163 consensus_queue.cc:1048] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:51.596520 22687 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:51.596917 22687 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.597234 22687 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:51.591012 22419 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.600654 22419 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:51.601270 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:51.583653 22810 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:11:51.616890 17433 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:51.616081 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:51.578732 22569 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.554903 22812 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:51.625444 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:51.624730 17978 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:51.606081 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 458480us
I20260709 12:11:51.583232 22815 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:51.627614 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 612094us
W20260709 12:11:51.630585 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 238563us
I20260709 12:11:51.630750 17332 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.632817 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:51.557920 22590 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.607363 22685 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.637158 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.641933 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:51.626626 22846 raft_consensus.cc:3055] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:51.650581 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:51.651460 18013 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.626358 22713 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.656625 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:51.658748 17332 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.647337 22815 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.660264 22419 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.660964 22843 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.661423 22841 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.662084 22815 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:51.663199 17332 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.664480 17332 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:51.508011 22803 consensus_queue.cc:1175] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "33539b233c2044afa31017244f6cc0d1" responder_term: 15 status { last_received { term: 14 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:51.665200 22841 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:51.628377 22731 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:11:51.666008 22841 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:51.667398 17332 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:51.670300 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:51.622972 22827 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:11:51.651263 22733 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:51.669497 22255 consensus_meta.cc:287] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
I20260709 12:11:51.655079 22846 raft_consensus.cc:740] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:51.658733 22812 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:11:51.675303 22837 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 12:11:51.674090 22732 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.739534 22815 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:51.756664 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:51.778793 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 103819us
I20260709 12:11:51.735853 22163 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:51.633554 22634 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.785913 17404 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:51.794236 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:51.794951 17365 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:11:51.798472 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:51.808835 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:51.813354 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 1153) took 1361 ms. Trace:
W20260709 12:11:51.815080 17255 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.024s
W20260709 12:11:51.815515 17255 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.006s	sys 0.024s
W20260709 12:11:51.736326 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 66094.3us
I20260709 12:11:51.777624 22812 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:51.829643 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 179725us
I20260709 12:11:51.865396 22040 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:51.866011 22040 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:51.815830 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 510615us
I20260709 12:11:51.871196 18010 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.859158 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 1027) took 1538 ms. Trace:
I20260709 12:11:51.813959 17286 rpcz_store.cc:276] 0709 12:11:50.452248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.470940 (+ 18692us) service_pool.cc:224] Handling call
0709 12:11:50.535996 (+ 65056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.536226 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:51.103389 (+567163us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.813016 (+709627us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.813070 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:51.813113 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.813174 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.813283 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":822381,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"thread_start_us":1245334,"threads_started":3,"wal-append.queue_time_us":490471}
W20260709 12:11:51.878988 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 254340us
I20260709 12:11:51.784855 22815 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:51.742957 22255 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:51.883556 22040 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:51.872529 17363 rpcz_store.cc:276] 0709 12:11:50.320761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.378657 (+ 57896us) service_pool.cc:224] Handling call
0709 12:11:50.391181 (+ 12524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.889363 (+498182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.889399 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.897917 (+  8518us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.428622 (+530705us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:51.812205 (+383583us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.812505 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.812585 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.812627 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:51.812638 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.859080 (+ 46442us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4568,"raft.queue_time_us":109072,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"thread_start_us":1321136,"threads_started":3,"wal-append.queue_time_us":649449}
W20260709 12:11:51.864024 22806 consensus_meta.cc:287] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 12:11:51.863535 22841 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.834554 22845 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:51.736758 22813 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:51.904376 18014 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:51.871132 22812 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:11:51.910894 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.869836 22598 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:51.944229 22836 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
W20260709 12:11:52.051381 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 419950us
I20260709 12:11:52.124522 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:52.050275 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.887763 22634 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:52.130028 17292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2966) took 1215 ms. Trace:
I20260709 12:11:52.130488 17292 rpcz_store.cc:276] 0709 12:11:50.914281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.918153 (+  3872us) service_pool.cc:224] Handling call
0709 12:11:50.929082 (+ 10929us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.932147 (+  3065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.932174 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.932730 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.412588 (+479858us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:51.412628 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.412689 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.129711 (+717022us) raft_consensus.cc:1685] finished
0709 12:11:52.129741 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.129908 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1064,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"thread_start_us":479466,"threads_started":1,"wal-append.queue_time_us":605049}
I20260709 12:11:52.056460 17360 raft_consensus.cc:1240] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.893496 22815 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.886269 22825 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.142s
W20260709 12:11:52.062140 22837 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.173s	user 0.005s	sys 0.024s
I20260709 12:11:52.135474 17291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 2962) took 1241 ms. Trace:
I20260709 12:11:52.135885 17291 rpcz_store.cc:276] 0709 12:11:50.894402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.894602 (+   200us) service_pool.cc:224] Handling call
0709 12:11:50.895016 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.903746 (+  8730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.903784 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.917086 (+ 13302us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.426392 (+509306us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:51.481553 (+ 55161us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.672236 (+190683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.672331 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.135241 (+462910us) raft_consensus.cc:1685] finished
0709 12:11:52.135262 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.135412 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54538,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":309812,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":54361,"thread_start_us":612864,"threads_started":2,"wal-append.queue_time_us":572359}
W20260709 12:11:52.063055 22852 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:11:51.967666 22820 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:51.911288 22806 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:52.073987 22604 consensus_meta.cc:287] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 12:11:52.028836 22846 consensus_queue.cc:260] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.087788 22687 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:52.100630 22426 consensus_meta.cc:287] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 1.178s	user 0.012s	sys 0.000s
I20260709 12:11:52.089854 22255 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:52.106681 22842 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.468s	user 0.000s	sys 0.005s
W20260709 12:11:52.112077 22819 consensus_meta.cc:287] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.006s
I20260709 12:11:52.055358 18014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 1146) took 1044 ms. Trace:
I20260709 12:11:52.060024 22845 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:52.140362 22855 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.141254 22812 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.141984 22851 consensus_queue.cc:1059] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:52.129838 22807 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:52.151437 22841 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.119451 22598 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.203867 17432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 1082) took 1248 ms. Trace:
I20260709 12:11:52.225311 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:52.216379 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 57904.6us
W20260709 12:11:52.230906 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 399421us
W20260709 12:11:52.232205 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.139604 22590 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:52.233856 18014 rpcz_store.cc:276] 0709 12:11:51.010975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.012704 (+  1729us) service_pool.cc:224] Handling call
0709 12:11:51.495248 (+482544us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54003ce9a0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225a9906f 00007f1225b11f60 00007f1225b137de 00007f1225b1f27c 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2
0709 12:11:51.940058 (+444810us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348665472}
I20260709 12:11:52.243564 17441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 1087) took 1100 ms. Trace:
I20260709 12:11:52.252578 17332 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:52.243808 17436 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:52.205392 22825 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:11:52.256778 17438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.007s
W20260709 12:11:52.244586 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 120189us
W20260709 12:11:52.257392 17438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.005s	sys 0.007s
I20260709 12:11:52.258496 17332 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:52.249809 22860 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.249115 17432 rpcz_store.cc:276] 0709 12:11:50.955773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.956863 (+  1090us) service_pool.cc:224] Handling call
0709 12:11:51.004338 (+ 47475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.004551 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:51.471372 (+466821us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.203507 (+732135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.203555 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:52.203603 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.203663 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.203800 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4111,"prepare.queue_time_us":627567,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":87157,"spinlock_wait_cycles":61476608,"thread_start_us":1088275,"threads_started":3,"wal-append.queue_time_us":428342}
I20260709 12:11:52.252759 17441 rpcz_store.cc:276] 0709 12:11:51.143186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.143297 (+   111us) service_pool.cc:224] Handling call
0709 12:11:51.166312 (+ 23015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:51.584391 (+418079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.584426 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:51.594898 (+ 10472us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.868085 (+273187us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:51.868124 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.869691 (+  1567us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.243316 (+373625us) raft_consensus.cc:1685] finished
0709 12:11:52.243341 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.243496 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3635,"raft.queue_time_us":55737,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":44087,"thread_start_us":637060,"threads_started":2,"wal-append.queue_time_us":525009}
I20260709 12:11:52.243171 22426 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:11:52.263954 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:52.265766 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.276532 17363 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.279757 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:52.263198 22819 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:52.271672 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:52.291839 17440 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:52.293756 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:52.256716 22851 consensus_queue.cc:1059] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:52.272128 22255 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.333237 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:52.337205 22873 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:52.358088 17288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 1164) took 1309 ms. Trace:
I20260709 12:11:52.252107 22807 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.254930 22855 consensus_queue.cc:1059] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:11:52.283396 22819 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:52.291088 22208 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.266526 22825 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.293212 22860 raft_consensus.cc:3055] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:52.358536 17288 rpcz_store.cc:276] 0709 12:11:51.048663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.191934 (+143271us) service_pool.cc:224] Handling call
0709 12:11:51.225830 (+ 33896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:51.633662 (+407832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.633696 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:51.651215 (+ 17519us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.162162 (+510947us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:52.162204 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.162274 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.357859 (+195585us) raft_consensus.cc:1685] finished
0709 12:11:52.357879 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.358022 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30722,"raft.queue_time_us":54876,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":19543,"thread_start_us":738677,"threads_started":2,"wal-append.queue_time_us":530629}
I20260709 12:11:52.338795 22845 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.365691 22208 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:52.369232 22866 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:11:52.369421 22208 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.369767 22598 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:52.370842 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 99240.1us
I20260709 12:11:52.372454 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:52.338253 22851 consensus_queue.cc:1059] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:52.368762 22687 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:52.366317 22819 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:52.379675 22807 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:52.371559 22860 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:52.387084 22812 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:52.395344 22825 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:52.403708 22815 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:52.417757 22255 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.410261 22820 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.413038 22426 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.451911 22868 raft_consensus.cc:3055] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:52.472923 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 100521us
W20260709 12:11:52.463404 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 199567us
I20260709 12:11:52.452461 22825 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:52.472242 22713 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:52.479557 22807 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:52.490593 22872 log.cc:927] Time spent T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
I20260709 12:11:52.506238 21956 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:52.487655 22868 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
W20260709 12:11:52.508898 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.511801 22877 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:52.512269 22877 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:52.512398 22868 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:52.513242 22877 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.514055 22876 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:52.514472 22876 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:52.514832 22827 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:52.508822 22605 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.515394 22876 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.516014 22605 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:52.516799 22876 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.503687 22713 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.528301 22713 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:52.529083 17332 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:52.530527 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:52.531201 22803 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:52.531605 22803 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:52.531828 22877 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.532053 22598 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.532447 22605 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:52.532738 22598 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.515348 22827 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.535115 22827 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:52.535919 22815 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:52.513692 22868 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.508229 22738 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:52.542773 22738 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.544852 22738 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:52.552743 22687 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:52.553516 22687 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:52.555994 22881 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:52.556507 22687 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:52.559321 22806 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:52.570469 22817 log.cc:927] Time spent T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.077s	user 0.009s	sys 0.003s
I20260709 12:11:52.578401 18010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 1157) took 1062 ms. Trace:
I20260709 12:11:52.578860 18010 rpcz_store.cc:276] 0709 12:11:51.516124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.664446 (+148322us) service_pool.cc:224] Handling call
0709 12:11:51.664791 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.881074 (+216283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.578091 (+697017us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400613854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:52.578334 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474262400}
I20260709 12:11:52.506367 22208 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.583611 22208 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:52.503932 22825 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.586784 17436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 1090) took 1034 ms. Trace:
I20260709 12:11:52.587218 17436 rpcz_store.cc:276] 0709 12:11:51.552792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.557948 (+  5156us) service_pool.cc:224] Handling call
0709 12:11:51.558248 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.257331 (+699083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.586525 (+329194us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b5400115154. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:52.586710 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557670656}
I20260709 12:11:52.509472 22807 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.595697 22807 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:52.596730 18013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52232 (request call id 1133) took 2216 ms. Trace:
I20260709 12:11:52.597157 18013 rpcz_store.cc:276] 0709 12:11:50.380253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.380480 (+   227us) service_pool.cc:224] Handling call
0709 12:11:50.390126 (+  9646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.658087 (+1267961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.596458 (+938371us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54005f2dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:52.596645 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2900344064}
W20260709 12:11:52.600033 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:52.600503 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:52.600787 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:52.601066 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.602631 17288 raft_consensus.cc:3055] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:52.603055 17288 raft_consensus.cc:740] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:52.603957 17288 consensus_queue.cc:260] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.604426 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:52.604739 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:52.604956 17288 raft_consensus.cc:3060] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:52.605404 17364 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:11:52.609995 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:52.610746 17359 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:52.611665 17365 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:52.602767 22803 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.613513 17288 raft_consensus.cc:1275] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:52.613842 22803 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.614945 17980 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:52.616365 22608 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.616770 22608 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.617125 22608 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.587699 22825 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:52.617671 22860 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:52.618748 22860 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.604471 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 1156) took 1088 ms. Trace:
I20260709 12:11:52.623325 18007 rpcz_store.cc:276] 0709 12:11:51.515811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.538000 (+ 22189us) service_pool.cc:224] Handling call
0709 12:11:51.538357 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.670052 (+131695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.670087 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.670148 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:51.670187 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.604242 (+934055us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54001eafd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:52.604286 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.604409 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302303488}
I20260709 12:11:52.624176 22855 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:52.624580 22855 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:52.627493 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:52.629940 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:52.630816 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:52.631620 18014 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 19: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:52.632011 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:52.632335 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:52.633496 22282 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.634001 22282 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:52.634445 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:52.635037 17435 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:52.610976 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:52.636193 22282 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:52.638789 22849 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:52.639889 17363 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:52.640789 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:52.633430 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:52.631484 22726 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:52.642141 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:52.644449 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:52.637713 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:52.651748 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:52.625442 22855 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:52.646057 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:52.656761 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:52.657048 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:52.657771 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:52.660225 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:52.663039 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.663724 17432 raft_consensus.cc:2368] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 18. Current term is 19.
I20260709 12:11:52.657742 18008 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
W20260709 12:11:52.660868 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 160007us
I20260709 12:11:52.673069 17258 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:52.704555 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:52.705446 17366 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:52.707401 17406 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.551s (SENT)
I20260709 12:11:52.672227 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:52.709105 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:52.673914 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:52.713423 17358 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 17: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:52.654599 22208 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.709385 17286 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:52.714759 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:52.718088 17364 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 19.
I20260709 12:11:52.721621 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:52.726923 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:52.708017 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:52.730177 17364 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:52.728977 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:52.661489 22726 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.735193 17362 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:52.736164 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:52.736843 17283 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:52.737812 18010 raft_consensus.cc:2368] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 18. Current term is 19.
I20260709 12:11:52.726754 22208 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:52.738489 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:11:52.738929 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:52.736856 22726 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:52.740329 22208 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:52.741199 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:52.741900 17285 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:52.739261 17283 raft_consensus.cc:2393] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:52.743968 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:52.744299 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:52.745067 17358 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 19: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:52.745260 17289 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:52.745823 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:52.746577 17358 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:52.746994 22846 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.747457 17358 raft_consensus.cc:3055] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:52.747839 17358 raft_consensus.cc:740] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:52.750766 22848 log.cc:927] Time spent T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.881s	user 0.000s	sys 0.011s
I20260709 12:11:52.750967 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:52.752065 22524 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.752522 22524 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:52.752898 22524 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.663738 22813 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:11:52.747200 22825 consensus_queue.cc:1048] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:52.744189 17284 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:52.757047 17333 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:52.760305 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.748641 17358 consensus_queue.cc:260] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.762563 17980 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:52.763362 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:52.765621 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 235171us
I20260709 12:11:52.768203 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:52.769557 17358 raft_consensus.cc:3060] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.724596 22745 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:52.728155 22855 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.771658 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:52.780550 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:52.762988 22820 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.775905 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:52.768755 22849 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.770253 22419 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:52.790832 17978 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:52.771270 22733 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.796368 22732 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:52.771358 22282 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.799861 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:52.802485 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 129487us
I20260709 12:11:52.806672 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:52.787420 17332 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:52.814945 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:52.817852 17333 leader_election.cc:400] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 18. Current term is 19.
I20260709 12:11:52.818327 17333 leader_election.cc:403] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.769450 22841 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:11:52.821090 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:52.820526 17362 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:52.775754 22813 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:52.772147 22819 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:52.830987 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:52.843788 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 136408us
I20260709 12:11:52.777841 22745 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:52.844552 17406 leader_election.cc:336] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.631s (SENT)
I20260709 12:11:52.848731 17406 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:52.789054 22720 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:11:52.816604 22670 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.813702 22732 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:52.847565 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:52.850222 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.845018 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:52.811136 22733 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:52.821113 22665 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:52.826426 22419 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:52.923269 17365 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:52.844995 22849 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.939296 22885 consensus_queue.cc:1059] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:11:52.946892 22208 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.846817 22282 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 18. Current term is 19.
I20260709 12:11:52.856535 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:52.942046 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 97101.9us
I20260709 12:11:52.948313 22255 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.853223 22670 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:52.883745 22522 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 12:11:53.013384 17367 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:53.013581 22670 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:52.991879 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.882963 22608 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:52.942323 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 97804.7us
W20260709 12:11:53.015641 17406 leader_election.cc:336] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.688s (SENT)
I20260709 12:11:53.016064 17406 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:53.016676 22608 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:52.884698 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.017333 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:53.017702 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.018008 17286 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:53.005779 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 201037us
W20260709 12:11:52.867661 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.022354 17332 connection.cc:256] RPC call timeout handler was delayed by -1.342960248000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 12:11:53.023212 17332 leader_election.cc:336] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.561s (SENT)
I20260709 12:11:53.009127 22733 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.025430 17286 raft_consensus.cc:2468] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:11:53.007710 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 189980us
I20260709 12:11:53.026357 22670 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.027081 17980 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:52.853125 22878 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.931107 22868 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.028461 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:52.853231 22806 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.881291 22728 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.931977 22598 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.030802 22728 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:53.031445 22825 raft_consensus.cc:2804] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:53.013746 17404 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:52.883625 17258 leader_election.cc:400] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
W20260709 12:11:53.037307 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 153809us
I20260709 12:11:53.037958 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.031955 22728 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:53.041949 17332 leader_election.cc:336] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.168s (SENT)
I20260709 12:11:52.853256 22877 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.032817 22814 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.032399 22825 raft_consensus.cc:697] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:53.034554 22687 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:11:53.060076 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 46391.6us
W20260709 12:11:53.052489 22883 log.cc:927] Time spent T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 12:11:53.065349 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:53.059216 22889 log.cc:927] Time spent T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:11:53.082839 22886 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.086920 22825 consensus_queue.cc:237] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.088485 22608 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:53.089068 22608 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.090896 22819 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:53.092231 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:53.094205 22524 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.098079 22608 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:53.100348 22873 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.078713 22549 raft_consensus.cc:3055] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:53.101504 22549 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:53.102142 22524 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:53.103371 22208 raft_consensus.cc:3055] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:53.103801 22208 raft_consensus.cc:740] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:53.104657 22208 consensus_queue.cc:260] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.105835 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.107317 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.108649 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:53.076851 17332 leader_election.cc:336] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.375s (SENT)
I20260709 12:11:53.052137 22868 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.112934 22868 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.115119 22868 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:53.116154 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.116621 22687 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 19 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:53.065008 22845 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.117760 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:53.118443 17359 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:53.117784 22845 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.119546 22845 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.122628 22255 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.123893 22255 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:53.126665 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:53.102360 22549 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.128326 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:53.103281 22745 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:53.010392 22419 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.132644 17437 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:53.127388 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:53.134882 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:53.135457 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 62298.7us
W20260709 12:11:53.124065 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.136307 17258 leader_election.cc:400] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 11. Current term is 12.
I20260709 12:11:53.135218 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:53.127496 17359 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:53.137811 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:53.136751 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.139796 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.140033 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.109380 17367 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:53.109892 18014 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:11:53.139319 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.142149 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:53.032471 22670 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:53.106326 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:11:53.112388 22890 log.cc:927] Time spent T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:53.060029 22732 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.129179 17364 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:53.105928 22208 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.144855 17358 raft_consensus.cc:1275] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:53.110486 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.146333 17333 leader_election.cc:400] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 18. Current term is 19.
I20260709 12:11:53.150341 22868 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.158072 22727 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.128697 22549 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.192160 17285 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
W20260709 12:11:53.154712 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 92162.8us
I20260709 12:11:53.155153 17407 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:53.163640 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.062124 22877 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.176788 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.143975 17255 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:53.179982 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.148869 22745 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.189994 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:53.154556 22901 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:53.202392 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.197269 17366 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:11:53.197269 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:53.205392 17363 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 12:11:53.208401 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 64511.9us
I20260709 12:11:53.195932 17434 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:53.196646 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:11:53.195380 22876 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.003s
W20260709 12:11:53.212662 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 197044us
I20260709 12:11:53.218055 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.220203 17288 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:53.117590 22687 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.196628 22847 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.198813 22745 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.198921 22522 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:53.225849 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 45969.3us
I20260709 12:11:53.202530 22732 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.238652 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.215680 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.211786 22868 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.219151 22478 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:53.240001 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 163199us
I20260709 12:11:53.244920 17404 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:53.248884 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.249577 17432 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:53.218267 22727 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.241215 17437 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:53.255875 21956 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:53.245504 17287 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:53.236115 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:53.258630 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:53.234876 17407 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:53.236680 22745 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.209342 22820 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.215947 22282 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.259465 21956 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:53.231455 22847 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.224577 22590 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:53.233026 22886 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.248137 22868 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:53.237331 22812 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:53.250577 22876 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:53.285940 17434 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:53.289211 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:53.230944 22803 consensus_queue.cc:1048] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:11:53.305943 17981 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.308146 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.309263 17981 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:53.285154 22847 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.252964 22478 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:53.290755 17258 connection.cc:256] RPC call timeout handler was delayed by -2.0485402009999234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 12:11:53.301792 18006 raft_consensus.cc:1240] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:53.303297 22903 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:11:53.304152 22904 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:53.290032 22811 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:53.338300 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 47340.5us
W20260709 12:11:53.339505 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.331664 17258 connection.cc:256] RPC call timeout handler was delayed by -2.0251402009998856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 12:11:53.299194 22720 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:53.299703 22868 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:53.301625 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.318908 21956 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.294842 18010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:59534
I20260709 12:11:53.340407 22569 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:11:53.346643 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:53.289295 22590 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.344995 18010 raft_consensus.cc:606] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:53.330813 22478 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:53.341012 17258 connection.cc:256] RPC call timeout handler was delayed by -1.9477402009999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 12:11:53.340271 22855 consensus_meta.cc:287] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
W20260709 12:11:53.359975 17258 connection.cc:256] RPC call timeout handler was delayed by -1.6939402010000322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 12:11:53.339581 22811 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.367779 22811 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.376230 22811 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.379971 22811 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:53.380664 22855 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:53.381218 22876 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:53.381680 17258 connection.cc:256] RPC call timeout handler was delayed by -1.544540201000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 12:11:53.382761 22868 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.383101 22865 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:53.381785 22745 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.310552 22812 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.390967 22886 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.391440 22873 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:11:53.398813 22905 log.cc:927] Time spent T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:11:53.401012 22903 log.cc:927] Time spent T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:53.335487 22608 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:53.404194 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 139665us
W20260709 12:11:53.405565 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.317178 22900 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 12:11:53.440026 17258 connection.cc:256] RPC call timeout handler was delayed by -1.495040200999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 12:11:53.480623 17258 connection.cc:256] RPC call timeout handler was delayed by -1.2160402009999416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24880000000000002s for a response
I20260709 12:11:53.333189 22598 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:53.480904 17363 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:53.443495 22865 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:53.454016 22877 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:53.482996 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 173792us
W20260709 12:11:53.481029 17258 connection.cc:256] RPC call timeout handler was delayed by -1.0352075109999532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 12:11:53.494117 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.495018 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.491909 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.497471 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.498353 17283 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:11:53.502501 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 289200us
I20260709 12:11:53.443665 22876 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.511376 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.512087 17290 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:53.499346 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.502383 17291 raft_consensus.cc:1240] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:53.513125 17284 raft_consensus.cc:2468] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:53.514343 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.506475 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:53.456894 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 222082us
W20260709 12:11:53.506693 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.507678 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.517452 22868 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:53.520007 22701 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:53.520524 22701 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:53.520885 22701 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.494361 22598 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.527267 22745 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:53.532735 22876 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:53.457051 22855 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:53.515322 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 175061us
I20260709 12:11:53.539371 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:53.540486 17360 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.540544 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:53.507433 17406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.797s (SENT) [suppressed 23 similar messages]
I20260709 12:11:53.537451 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.537446 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.541675 17291 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.542148 17284 raft_consensus.cc:2368] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12.
W20260709 12:11:53.546470 17406 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.812s (SENT)
I20260709 12:11:53.546514 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.543104 17287 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:53.546711 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:53.505157 22901 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.547367 17290 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:53.548062 17366 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:53.472381 22873 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.548046 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.550287 17287 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:53.545008 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.550529 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:53.502050 22825 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:11:53.469211 22886 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.562248 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:53.547549 22608 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:53.570147 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 63729.5us
I20260709 12:11:53.571671 17258 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:53.574512 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.578267 17284 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
W20260709 12:11:53.564098 22733 consensus_meta.cc:287] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.002s
W20260709 12:11:53.581518 17406 leader_election.cc:336] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 1.951s (SENT)
I20260709 12:11:53.582288 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:53.582803 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.540998 22478 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.588054 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.592721 22812 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:53.594848 22886 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:53.596555 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.597078 22873 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:53.598034 22590 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:53.582041 22876 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.599772 22876 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.599682 22590 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:53.600297 22876 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.584398 22846 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.557262 22728 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.605520 22728 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:53.564239 22845 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.606238 17440 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:53.574334 22720 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:53.572651 22608 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:53.612210 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:53.612933 17366 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 9.
I20260709 12:11:53.608930 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:53.609299 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.609719 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:53.617641 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.588491 22745 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:53.606091 22855 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:53.611277 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.606635 22864 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:53.624270 17433 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:53.629580 17441 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:53.628168 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.630720 17292 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:53.627532 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.616952 22608 raft_consensus.cc:3060] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:53.636878 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 55384.8us
I20260709 12:11:53.566661 22865 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.588179 22733 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.692011 22733 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:53.623795 22701 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.616151 22886 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:53.662985 17406 leader_election.cc:336] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Timed out: RequestConsensusVote RPC to 127.15.191.65:43395 timed out after 2.006s (SENT)
I20260709 12:11:53.622475 22549 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:53.665215 22865 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.630489 22860 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.650873 22720 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.666252 22847 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:53.676306 17291 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:53.679531 17360 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:53.680938 22598 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.685283 17289 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
W20260709 12:11:53.689126 22924 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
W20260709 12:11:53.698573 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.698678 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 72901.6us
I20260709 12:11:53.700349 17283 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:53.720834 17364 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:53.711242 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:53.722510 17359 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 9: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:53.717845 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:53.723662 17358 raft_consensus.cc:2393] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:11:53.719882 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.708513 22549 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:11:53.734171 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 225132us
W20260709 12:11:53.727445 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 64511.7us
I20260709 12:11:53.730787 22478 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:53.732517 22419 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:53.733493 17366 raft_consensus.cc:1240] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:53.733623 17288 raft_consensus.cc:1240] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:53.711848 22900 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:53.720583 22913 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:11:53.814345 17258 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:53.814662 17406 connection.cc:256] RPC call timeout handler was delayed by -1.0294459239999014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2385s for a response
W20260709 12:11:53.817123 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 79878us
W20260709 12:11:53.824607 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 89096.7us
I20260709 12:11:53.826977 17258 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:53.831532 17406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.837710 17364 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:53.839779 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:53.850257 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.854193 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.854043 18009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:59534
I20260709 12:11:53.855409 18009 raft_consensus.cc:606] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.855753 18009 raft_consensus.cc:614] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:53.856950 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.857369 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.857295 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.858006 17287 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:11:53.858183 17286 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:53.857640 17291 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:53.821113 22886 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.859365 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:53.859979 17360 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.823601 22900 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:53.868057 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 45785us
I20260709 12:11:53.868189 22900 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:53.868818 22900 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:11:53.869444 22847 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:53.871685 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:53.874024 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:53.874672 17255 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:53.856549 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.876859 17283 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:53.886343 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:53.887027 17364 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.888021 17283 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:53.889822 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.890584 17283 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.869863 22900 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:53.897145 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:53.898260 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.898404 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.901821 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:53.899071 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.908862 17286 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.899142 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.899480 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.899762 22864 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.915748 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:53.900581 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.901473 17332 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.901861 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:53.898083 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:53.904876 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:53.920300 17292 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.906139 17283 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:53.912636 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:53.822165 22876 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.922441 17360 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:53.816107 22419 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.927615 22886 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:53.933698 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.934372 22841 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.934690 17407 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:53.934952 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:53.930817 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:53.903810 22847 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:53.846463 22608 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:53.927655 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.928445 17332 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:53.942852 18010 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:53.954242 18010 pending_rounds.cc:85] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Aborting all ops after (but not including) 9
I20260709 12:11:53.954552 18010 pending_rounds.cc:107] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:11:53.954747 18010 raft_consensus.cc:2889] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:53.927552 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.959872 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.913784 22728 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.896764 22208 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:11:53.974969 17364 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:53.905467 22900 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:53.871908 22885 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:11:53.950446 22847 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.989202 18013 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:53.965857 17286 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:53.949481 17292 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:53.932808 22865 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:53.983603 17258 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:53.981453 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:53.984536 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 56188.9us
W20260709 12:11:53.994592 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 60000.4us
I20260709 12:11:54.004976 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:54.004441 18014 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:54.005208 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 65849.8us
I20260709 12:11:54.005198 17332 leader_election.cc:400] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12.
I20260709 12:11:54.004381 17363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:54.006512 17332 leader_election.cc:403] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:54.006814 17363 raft_consensus.cc:606] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:54.008371 17286 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:53.967027 22745 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:53.969004 22860 raft_consensus.cc:2764] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:11:53.966430 22733 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.901863 22901 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:11:54.014230 22732 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:54.025038 22929 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:53.967226 22886 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:54.031589 22608 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:54.016897 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:54.031736 22886 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:54.033763 22932 log.cc:927] Time spent T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:54.017308 17332 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:54.020215 22670 raft_consensus.cc:3060] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.007093 22855 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.994746 22841 raft_consensus.cc:2804] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:54.008945 22701 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:54.004760 22847 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.007773 22666 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:54.037216 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:54.039955 18014 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:54.018391 22208 raft_consensus.cc:3055] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:54.048625 22841 raft_consensus.cc:697] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 15 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:54.049201 22933 log.cc:927] Time spent T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:54.050536 22940 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:54.051034 22940 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:54.051389 22940 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.054788 17332 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.056089 22807 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:54.056206 17404 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:54.056710 22807 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:54.057686 22807 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.058535 22666 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:54.061043 22865 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:54.040483 22255 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:54.036893 22598 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.073050 22845 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:54.075119 22876 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.077466 22419 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.078264 22419 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.078470 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:54.079110 17360 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.027993 22733 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.071801 22917 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:54.047896 22208 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:11:54.088294 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 94360.4us
I20260709 12:11:54.089924 22930 consensus_queue.cc:1059] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:54.090461 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:54.094568 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:54.102453 17360 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:11:54.112546 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:54.113262 18014 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
I20260709 12:11:54.073798 22900 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.101133 22917 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:54.137395 22917 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.140141 22847 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:53.925901 22864 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.059537 22666 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:54.149504 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 182123us
I20260709 12:11:54.150487 17363 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:54.049738 22841 consensus_queue.cc:237] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:54.167104 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 112393us
I20260709 12:11:54.144994 22720 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:54.169407 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:37206
I20260709 12:11:54.170044 17360 raft_consensus.cc:606] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.170473 17360 raft_consensus.cc:614] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:54.174904 22549 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.176358 22549 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.154546 22900 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.179720 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.150264 22899 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:54.155589 22255 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:54.194156 17440 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:54.180205 22720 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.144924 22208 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.197402 22733 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:54.210763 17332 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.212502 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:54.213182 17360 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.213565 17332 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:54.202642 22687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.009s	sys 0.005s
I20260709 12:11:54.188778 22701 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:54.203497 22864 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.229178 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:54.230319 17439 raft_consensus.cc:2368] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15.
I20260709 12:11:54.230633 22901 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:54.231629 17439 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:54.219960 22819 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:54.224445 22687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.010s	sys 0.005s
I20260709 12:11:54.242218 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:54.220779 22670 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12.
I20260709 12:11:54.243312 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:54.220510 22945 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:54.226331 22208 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.270650 17981 leader_election.cc:400] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15.
I20260709 12:11:54.241714 17360 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 10.
W20260709 12:11:54.262866 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 112226us
I20260709 12:11:54.279770 17981 leader_election.cc:403] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:54.285701 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.235407 22847 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.286549 17289 raft_consensus.cc:2368] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10.
I20260709 12:11:54.235682 22901 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:54.294377 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.278741 22604 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.269476 22733 raft_consensus.cc:3055] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:54.236073 22953 consensus_queue.cc:1059] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:11:54.228679 22701 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.298513 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:54.304473 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:54.305030 17286 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.304750 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:54.281101 22930 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.273085 22569 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:54.308033 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:54.299110 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 111387us
I20260709 12:11:54.321135 17407 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:54.309803 17980 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:54.314877 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 79769.7us
I20260709 12:11:54.317162 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:54.324147 17289 raft_consensus.cc:2368] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15.
I20260709 12:11:54.309792 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:54.319080 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:54.291147 22899 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15.
I20260709 12:11:54.282771 22945 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:54.326830 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:54.327450 17287 raft_consensus.cc:2393] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:54.317597 22803 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:54.304622 22733 raft_consensus.cc:740] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:54.329906 22814 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.327673 22569 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:54.344252 22949 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:54.346696 22803 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.289033 22255 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:54.345242 22950 log.cc:927] Time spent T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:54.302647 22925 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:54.310917 22847 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:54.355973 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 48033.4us
I20260709 12:11:54.357489 17407 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:54.361917 22701 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:54.377775 22819 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:54.361687 22959 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:54.367888 22687 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:54.359823 17332 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:54.373047 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:54.346138 22947 log.cc:927] Time spent T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:11:54.375138 17286 raft_consensus.cc:2468] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:54.307252 22604 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.348362 22943 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:54.385442 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.398705 17283 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:11:54.399495 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.399654 22670 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:54.399969 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:54.389568 22860 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:54.400722 22860 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.394523 22943 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.401448 22569 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:54.402220 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:54.402818 22860 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.389034 22687 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:54.403553 22687 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.402997 17441 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:54.406481 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.407137 17360 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:54.409431 22920 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:54.395872 22803 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:54.387843 22847 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.394658 18013 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:54.420855 17285 raft_consensus.cc:2393] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 17: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:54.421190 22945 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.394609 22720 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:54.394440 22733 consensus_queue.cc:260] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.374647 22953 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:54.428686 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46576.5us
W20260709 12:11:54.428810 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 71494.6us
I20260709 12:11:54.433770 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:54.435827 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.376214 22901 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.434471 18009 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:54.369421 22940 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.437213 17258 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.325980 22930 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.409897 22920 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:54.439777 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:54.444878 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:54.448690 17433 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:54.447667 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.423491 22942 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.457171 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:54.458472 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.435493 22876 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:54.403097 22943 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:54.439779 22909 log.cc:927] Time spent T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:54.449952 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:54.442766 22955 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:54.461907 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 138574us
I20260709 12:11:54.436401 22965 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.463263 22886 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:54.469120 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:54.454299 22855 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:54.466449 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 323397us
I20260709 12:11:54.462873 22953 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.490741 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:54.491950 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.492772 17285 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 16: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:54.468297 22208 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.473455 22877 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.472980 22946 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.476262 22847 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.501116 17283 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:54.504555 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.492151 17980 leader_election.cc:400] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10.
I20260709 12:11:54.502257 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.505846 17288 raft_consensus.cc:2393] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 13: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:54.507095 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:54.508854 17980 leader_election.cc:403] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:54.510468 17980 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:54.511335 22608 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.516160 17980 leader_election.cc:400] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15.
I20260709 12:11:54.515618 22920 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.519546 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:54.520648 22812 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.522301 17980 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.523769 17980 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:54.524819 22608 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:54.525238 22608 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.525589 22608 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.523910 22927 raft_consensus.cc:2804] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:54.535758 22927 raft_consensus.cc:697] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:54.536875 22927 consensus_queue.cc:237] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.541096 22807 raft_consensus.cc:3055] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:54.541603 22807 raft_consensus.cc:740] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:54.544269 18006 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 14: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:54.482481 22604 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:54.481053 22955 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:54.494300 22916 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.553977 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.554852 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.474639 22876 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.497822 22208 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.563596 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.463794 22942 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.573670 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.545234 22913 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.498932 22841 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:54.583093 17362 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:54.582998 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:54.560257 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 92208.2us
I20260709 12:11:54.576084 17358 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 16: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:54.577600 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.578753 17361 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:54.580682 17364 raft_consensus.cc:1275] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:11:54.589408 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 76672.8us
I20260709 12:11:54.590029 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.590708 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:54.590692 17366 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:54.545182 22670 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 15 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:54.593958 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.595552 17289 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:54.589308 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:54.598116 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 107438us
I20260709 12:11:54.558986 22732 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.602324 17437 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:54.603302 17437 pending_rounds.cc:85] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 6
I20260709 12:11:54.598927 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:54.561259 22946 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.493105 22819 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.603552 17437 pending_rounds.cc:107] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:54.603545 17363 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:54.572854 22745 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:54.574198 22208 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.606112 17437 raft_consensus.cc:2889] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.482643 22965 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.575699 22847 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:54.613616 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:54.614434 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.619916 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:54.559381 22963 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:11:54.632023 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:54.642527 22940 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.643301 22940 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.647764 22965 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.595288 22803 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:11:54.675210 17287 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:54.621803 22959 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:54.656615 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.691298 17290 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:54.624517 22899 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.605245 22960 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:11:54.700726 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 74853.1us
I20260709 12:11:54.592959 22841 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.693589 17980 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:54.618997 22745 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.648257 22954 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:54.702261 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46136.8us
I20260709 12:11:54.706959 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:54.691334 22965 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.696183 22604 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.697186 22959 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:54.742434 22959 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.743618 22942 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.744877 22876 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:54.725430 22972 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:54.729595 22814 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.705355 22670 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.627645 22955 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.626757 22969 consensus_queue.cc:1059] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:11:54.731056 22980 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:54.733328 22968 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:11:54.736595 17290 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:11:54.737552 22900 consensus_meta.cc:287] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.002s
I20260709 12:11:54.741447 22965 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.746549 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:54.746786 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.623899 22847 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.747905 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:54.749120 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:54.750036 17287 raft_consensus.cc:1240] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:54.768553 18010 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:54.724032 22930 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:54.772686 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:54.764351 22980 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:54.793726 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 173840us
W20260709 12:11:54.809902 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 317289us
W20260709 12:11:54.765863 22598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.002s	sys 0.016s
I20260709 12:11:54.812096 17978 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:54.772419 22608 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.767887 22969 consensus_queue.cc:1243] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:11:54.812686 22598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.004s	sys 0.017s
I20260709 12:11:54.830585 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:54.831965 17978 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:54.826572 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 213010us
I20260709 12:11:54.748404 22687 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.795590 22819 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.836970 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:54.830085 22604 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.778899 22812 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
W20260709 12:11:54.864241 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 52662.4us
I20260709 12:11:54.881126 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:54.881002 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.836256 22899 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.881942 17290 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:54.811002 22980 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.847867 22972 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.844367 22940 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.825783 22937 consensus_queue.cc:1059] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:11:54.886461 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 44683us
I20260709 12:11:54.881358 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.842988 22819 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.891983 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:54.893190 22986 consensus_queue.cc:1048] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 12:11:54.893819 22973 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:11:54.894243 22803 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:54.876626 22900 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.896306 17360 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:11:54.902408 22841 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.902827 22977 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.897387 22524 consensus_queue.cc:1059] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:11:54.903365 22977 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:54.897928 22819 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.926158 22687 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.926980 22608 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:54.927369 22937 raft_consensus.cc:3055] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:54.927788 22937 raft_consensus.cc:740] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:54.928743 22937 consensus_queue.cc:260] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.929735 22847 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.895260 22940 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:54.935060 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:54.935798 17436 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:54.929919 22937 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.968070 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:54.930315 22806 consensus_queue.cc:1175] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaafaad0810b4e95983d2d73ec814346" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 12 index: 9 } }
I20260709 12:11:54.971238 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:54.933831 22940 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.972394 22965 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:54.984400 17366 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:54.985064 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:54.898924 22972 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:54.989480 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:54.992762 17292 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:54.991834 17362 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:11:54.983958 22967 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:11:54.990872 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:54.998485 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.003826 17332 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:54.996227 22985 log.cc:927] Time spent T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:55.013006 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:54.992296 22965 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.999761 22969 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.026716 22965 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.005894 22847 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:55.024590 22969 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:55.044044 22982 log.cc:927] Time spent T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:11:55.065932 22208 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.067600 17441 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 16: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:55.073623 22208 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.054265 22969 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:55.086404 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 80347.7us
I20260709 12:11:55.089263 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:55.094750 17367 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:55.097406 18010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:59534
I20260709 12:11:55.098150 18010 raft_consensus.cc:606] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Received request to transfer leadership to TS 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:55.099509 17255 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:55.103582 22994 log.cc:927] Time spent T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:55.106508 22877 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:55.108453 22976 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:11:55.110296 22981 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
I20260709 12:11:55.110790 22885 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:55.112306 22885 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:55.114943 22972 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:55.116007 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:55.122615 22990 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 12:11:55.126449 22988 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:11:55.092105 22959 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.137143 22959 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.093343 22999 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.140048 22999 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:55.148972 22913 consensus_meta.cc:287] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.000s
I20260709 12:11:55.149509 22913 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for earlier term 9. Current term is 10.
I20260709 12:11:55.155256 22965 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.161692 22604 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.162683 22962 raft_consensus.cc:993] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:55.186844 22962 raft_consensus.cc:1081] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:55.171509 22977 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.036533 22847 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.190659 22847 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.204056 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:55.210278 22999 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:55.101644 17255 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:55.214924 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 113433us
I20260709 12:11:55.222599 22733 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.234843 22942 raft_consensus.cc:3055] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:55.235357 22942 raft_consensus.cc:740] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:55.236163 22942 consensus_queue.cc:260] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:55.242867 22930 raft_consensus.cc:3055] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:55.243448 22930 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:55.243798 22899 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.244429 22930 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.218317 22847 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.252137 22847 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:55.252593 22847 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:55.257441 22827 consensus_queue.cc:1175] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e860f7e876b74ec589f447737822a4f6" responder_term: 13 status { last_received { term: 12 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:55.264565 22980 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.266026 18006 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 15: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:55.270785 22900 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.184077 22819 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.273375 22819 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.275977 22937 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.276615 22937 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:55.278981 22937 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:55.282267 22946 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:55.265704 22745 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:55.284085 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 192827us
I20260709 12:11:55.316129 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:55.284813 22901 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.329931 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.288305 22980 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:55.333087 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.338675 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.161967 22940 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:55.357101 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:55.360158 17359 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.357782 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.361181 17366 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:11:55.358654 17365 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:55.329792 22665 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:55.369151 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:55.373183 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:55.374197 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:55.303270 22946 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:55.362566 22745 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:55.378998 22745 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:55.380095 22940 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:55.381104 22745 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:55.360508 22877 raft_consensus.cc:697] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:55.383190 22877 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.375138 22665 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.390596 22665 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.390966 22930 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.395393 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:55.397078 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1c41ebef06654a43a98e69d0c065bba4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:11:55.408208 22969 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.410032 17359 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
W20260709 12:11:55.440750 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 43727.2us
I20260709 12:11:55.419576 17434 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:55.431967 18006 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:11:55.436160 17978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.437770 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.445632 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:55.401319 22807 consensus_queue.cc:260] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.447242 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:55.447808 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:55.448060 18008 raft_consensus.cc:2410] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:11:55.448408 18014 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.449204 18012 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:55.442500 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 83763.8us
I20260709 12:11:55.451997 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:55.454988 17438 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:55.445266 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:55.446420 18013 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
W20260709 12:11:55.471413 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 467654us
I20260709 12:11:55.445606 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:55.475239 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:55.475370 18014 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:55.475893 18010 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:55.477463 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:55.478525 18007 raft_consensus.cc:2368] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 17. Current term is 18.
I20260709 12:11:55.482578 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.485953 17978 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:55.487351 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:55.493332 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.494149 17365 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:55.498548 17440 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 13: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:55.498136 17363 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:55.499425 17358 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 15: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:11:55.478341 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.470041 22732 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.480841 22986 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:55.518638 22986 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.519065 22986 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.484686 22807 raft_consensus.cc:3060] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.526847 22720 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:55.527498 22720 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.485105 22745 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.533664 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:55.535300 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.506467 22930 raft_consensus.cc:2804] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:55.474858 22971 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:11:55.497781 22976 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:55.513854 22946 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:55.554631 17365 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.557092 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:55.560293 18015 raft_consensus.cc:2393] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:55.514886 22732 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.574128 18015 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:11:55.579312 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 62545.1us
I20260709 12:11:55.580482 22732 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.582643 17440 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.547602 22930 raft_consensus.cc:697] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:55.550143 22720 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:55.582051 22945 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:55.597103 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:55.542295 22745 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:55.607714 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:55.604187 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.610661 18006 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:55.614881 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:55.615092 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.582458 23012 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:55.621536 17333 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:55.629019 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:55.637694 18007 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:55.638165 17440 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:55.640388 17333 leader_election.cc:400] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 17. Current term is 18.
I20260709 12:11:55.641027 17333 leader_election.cc:403] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:11:55.618456 22943 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.618041 23004 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:11:55.645421 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.606863 23014 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:11:55.639071 22959 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:55.634691 23012 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.644172 23004 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:55.662746 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 59269.4us
I20260709 12:11:55.664620 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 2213) took 1064 ms. Trace:
W20260709 12:11:55.662487 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 85173.7us
I20260709 12:11:55.655295 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.645315 22965 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 17. Current term is 18.
W20260709 12:11:55.681842 23006 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
I20260709 12:11:55.645339 22991 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:55.745810 22986 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.733966 22971 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.747008 18010 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:55.748306 22986 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:55.750839 23015 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:55.747035 22971 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.757396 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:55.757678 17291 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:55.758081 17285 raft_consensus.cc:3060] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.758317 22885 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.758808 22885 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:55.760456 17287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:36408
I20260709 12:11:55.760891 22885 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:55.761055 17287 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:55.761466 17287 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.756487 22971 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.672240 22745 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:55.646739 22877 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.735116 22608 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.767071 22877 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:55.767536 22608 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.769734 22608 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:55.677369 22920 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.783371 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:55.738065 23004 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.739393 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:55.734345 17284 rpcz_store.cc:276] 0709 12:11:54.599859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.599980 (+   121us) service_pool.cc:224] Handling call
0709 12:11:54.600258 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:54.600570 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:54.600599 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:54.601061 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.403713 (+802652us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b180024f460. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:55.543388 (+139675us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:55.543442 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.543510 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:55.664298 (+120788us) raft_consensus.cc:1685] finished
0709 12:11:55.664319 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.664551 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4185,"spinlock_wait_cycles":4110592,"thread_start_us":139493,"threads_started":1,"wal-append.queue_time_us":1011712}
I20260709 12:11:55.777930 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.651392 22966 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:55.744431 22208 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:55.645789 22943 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.787657 22208 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.782841 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:55.676182 22969 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.662863 22917 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:55.673095 22959 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:55.785526 17287 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.794144 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:55.799592 22916 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:55.799957 22917 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:55.800612 22208 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.791738 22971 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:55.801956 22971 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.803674 22917 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:55.803944 22971 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.805392 22943 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.648981 22930 consensus_queue.cc:237] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.783049 22931 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.807171 22931 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.647951 22977 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.138s
I20260709 12:11:55.646378 22976 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.810324 22966 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:55.811326 17978 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:55.812688 22923 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.815351 22923 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:55.817847 23012 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.818328 17287 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.809425 22931 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:55.823618 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:55.825150 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 85806.6us
I20260709 12:11:55.824462 18007 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 15: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:55.827265 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:55.827867 18009 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
I20260709 12:11:55.827770 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:55.806339 22608 raft_consensus.cc:993] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: : Instructing follower 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:55.829357 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:55.829833 17285 raft_consensus.cc:2468] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:11:55.832584 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:55.844823 18009 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:11:55.844023 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:55.809579 22877 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:55.809593 22847 consensus_meta.cc:287] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:11:55.795440 22959 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.905789 22847 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.906579 22255 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:55.908025 22847 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:55.910008 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.910595 17292 raft_consensus.cc:3060] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.910701 17366 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:55.913317 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:11:55.914501 23020 log.cc:927] Time spent T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.260s	user 0.000s	sys 0.003s
W20260709 12:11:55.916075 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 86660.2us
I20260709 12:11:55.916191 23012 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:55.917030 23012 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.917385 23012 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.921635 22917 consensus_queue.cc:1059] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:55.922820 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.923480 17361 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:55.924439 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.811213 22966 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:55.938977 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 114464us
I20260709 12:11:55.941028 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.926436 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.942584 17438 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:55.927366 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:55.927681 17332 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:55.943845 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.928804 18013 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:55.924381 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.945541 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.946008 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.937525 17292 raft_consensus.cc:2468] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:55.910533 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.921741 17407 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:55.946734 17404 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:55.953315 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.954068 17432 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:55.956200 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.958031 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:55.963385 17439 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.958132 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.964511 17438 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:11:55.958715 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:55.968483 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.955406 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.977398 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:55.978219 17291 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
W20260709 12:11:55.978756 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.929268 22811 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.926878 22916 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.944836 22745 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.944242 22806 raft_consensus.cc:3055] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:11:55.993796 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 66193.7us
I20260709 12:11:55.988519 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:11:55.990694 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44114.9us
I20260709 12:11:55.967911 22986 raft_consensus.cc:1081] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Signalling peer 33539b233c2044afa31017244f6cc0d1 to start an election
I20260709 12:11:55.992413 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:55.971472 22971 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.984516 22916 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.952415 22847 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:55.971062 22732 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:56.009545 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:55.998302 17362 raft_consensus.cc:2368] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15.
I20260709 12:11:55.981060 23010 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.974725 22569 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.986332 22955 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:56.006788 22972 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.046343 22972 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.046746 22972 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:56.009107 23021 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 12:11:55.986796 23009 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:56.020061 17439 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:56.045435 22943 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.999825 22665 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:56.075907 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.999459 22598 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:56.091173 17255 leader_election.cc:400] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15.
W20260709 12:11:56.044118 23015 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:56.049757 22955 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:56.049468 22569 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.050493 22732 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:56.104887 23004 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.044970 22916 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.052223 22847 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:55.994212 22806 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:56.116050 17436 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.125355 17255 leader_election.cc:403] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:55.998657 22745 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:56.047955 22971 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:56.256026 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.115715 22665 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:56.170895 22955 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:56.053010 23010 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:56.118245 22877 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:56.264859 17363 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:56.171145 22569 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:56.280128 22732 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:56.281165 22732 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:56.120000 22959 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.307751 17436 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:56.266142 22665 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:56.172437 22598 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:56.345734 17288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.043s	sys 0.034s
W20260709 12:11:56.348505 17288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.043s	sys 0.034s
I20260709 12:11:56.124954 23009 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.281683 22732 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:56.352984 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:56.354192 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:56.354929 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:56.355232 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:56.357283 17291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
 from {username='slave'} at 127.0.0.1:36408
I20260709 12:11:56.362298 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:56.362905 18009 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:56.362406 17291 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:56.363734 17291 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.364588 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:56.361865 18011 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:56.363202 18009 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:56.367040 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:56.369596 18011 raft_consensus.cc:2368] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15.
I20260709 12:11:56.300381 22877 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.372288 18009 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.388784 18009 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:56.383416 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 426199us
I20260709 12:11:56.395100 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:56.363300 22976 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15.
I20260709 12:11:56.341737 22943 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 12:11:56.368629 22930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.017s	sys 0.038s
I20260709 12:11:56.396541 17291 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.402314 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:56.403039 17283 raft_consensus.cc:2368] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 17. Current term is 18.
I20260709 12:11:56.406219 17283 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:56.408888 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:56.333901 22806 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:56.410632 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 319523us
I20260709 12:11:56.416565 17283 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.418637 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:56.399618 22930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.018s	sys 0.038s
I20260709 12:11:56.419389 17359 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:11:56.420110 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:56.420544 17288 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:56.426579 17291 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:56.428411 17362 raft_consensus.cc:2393] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 13: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:56.429020 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:56.429833 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.396907 23014 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:56.434070 17980 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:56.439667 17288 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:56.438304 17283 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:56.441277 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:56.442224 17285 raft_consensus.cc:2393] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 15: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:56.423277 22976 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.453336 17291 raft_consensus.cc:1275] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:56.434306 17255 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:56.486424 17283 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:56.505255 17290 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:56.563126 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:56.507041 17436 raft_consensus.cc:1275] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:56.522073 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:56.569980 17291 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.571044 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:56.550653 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:56.571848 17283 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:56.572569 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:56.572832 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:56.573570 17283 raft_consensus.cc:2393] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:56.574126 17285 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:56.575487 17285 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:56.451601 22806 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.580817 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:56.562740 22976 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:56.594295 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 165347us
W20260709 12:11:56.600088 17332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.579658 22827 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:56.503757 23039 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:56.560694 22969 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.503384 22745 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:56.503626 22807 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:56.443259 23014 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.682962 17283 raft_consensus.cc:1240] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:56.697484 17291 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:56.511158 22940 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:56.503851 22845 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:56.581431 23004 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:56.751482 17290 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:11:56.761171 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.658051 22971 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:56.764956 22598 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:56.683329 23039 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:56.771257 23039 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:56.772027 23039 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:56.765583 23043 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 12:11:56.730990 23017 log.cc:927] Time spent T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:56.767341 22745 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.731146 22807 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:56.773409 22812 raft_consensus.cc:2804] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:56.808312 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 374647us
W20260709 12:11:56.810734 17434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.008s	sys 0.004s
W20260709 12:11:56.811712 17434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.008s	sys 0.004s
I20260709 12:11:56.773294 22923 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:56.763312 23010 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:56.759092 22959 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:56.823675 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 160868us
W20260709 12:11:56.830396 17367 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.017s	sys 0.008s
W20260709 12:11:56.830938 17367 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.018s	sys 0.009s
I20260709 12:11:56.713946 22969 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.802002 22745 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:56.840400 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 406156us
I20260709 12:11:56.843101 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:56.845717 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:56.849116 23016 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 1.193s	user 0.000s	sys 0.003s
I20260709 12:11:56.850622 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:56.829849 22812 raft_consensus.cc:697] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:56.852643 22812 consensus_queue.cc:237] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:56.854537 23028 log.cc:927] Time spent T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 12:11:56.851588 17362 raft_consensus.cc:2393] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:56.855825 17286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 1234) took 1080 ms. Trace:
I20260709 12:11:56.856196 17286 rpcz_store.cc:276] 0709 12:11:55.775755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.777881 (+  2126us) service_pool.cc:224] Handling call
0709 12:11:55.778213 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.787798 (+  9585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.787830 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.792046 (+  4216us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.183672 (+391626us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:56.183723 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.183814 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.855614 (+671800us) raft_consensus.cc:1685] finished
0709 12:11:56.855636 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.855766 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10828,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":18524,"thread_start_us":373226,"threads_started":1,"wal-append.queue_time_us":555768}
I20260709 12:11:56.813985 22666 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:56.825294 23048 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:56.858492 22666 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.859128 23048 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:56.863870 23009 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:56.865064 22665 consensus_meta.cc:287] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.003s
I20260709 12:11:56.841176 22732 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:56.865792 22976 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:56.866873 23041 log.cc:927] Time spent T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:11:56.867542 22877 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:56.868294 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:56.871665 22807 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:56.871913 22942 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.874956 17363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48992 (request call id 3192) took 1138 ms. Trace:
I20260709 12:11:56.878630 23014 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:56.763790 22845 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:56.893257 23040 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.323s	user 0.000s	sys 0.000s
W20260709 12:11:56.872480 22920 consensus_meta.cc:287] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 1.082s	user 0.008s	sys 0.002s
I20260709 12:11:56.911731 17365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 1087) took 1006 ms. Trace:
W20260709 12:11:56.964874 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 384130us
I20260709 12:11:56.983891 17363 rpcz_store.cc:276] 0709 12:11:55.736441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.737581 (+  1140us) service_pool.cc:224] Handling call
0709 12:11:55.737843 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.287556 (+549713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.874690 (+587134us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54002913d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:56.874879 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211607936}
I20260709 12:11:57.021644 17365 rpcz_store.cc:276] 0709 12:11:55.905442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.910197 (+  4755us) service_pool.cc:224] Handling call
0709 12:11:56.910938 (+1000741us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b5800211598. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f6eee 000000000036eb39 00007f122aa6a1e0 00007f122ab330c4 00007f122ab33131 00007f122aaf4fc0 00007f122aadf929 00007f122aadf3d2 00007f1224056bd4
0709 12:11:56.911137 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.911352 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.911381 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:56.911435 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:56.911468 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.911525 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.911651 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40622080}
I20260709 12:11:56.958086 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:56.968684 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:56.892247 22969 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:56.986284 17978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.010s	sys 0.017s
I20260709 12:11:57.025915 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 2283) took 1081 ms. Trace:
W20260709 12:11:57.031611 17978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.011s	sys 0.017s
I20260709 12:11:56.943197 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:56.929039 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 2370) took 1008 ms. Trace:
I20260709 12:11:56.921732 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 1208) took 1089 ms. Trace:
I20260709 12:11:56.987941 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:11:56.989953 18009 consensus_meta.cc:287] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
I20260709 12:11:56.764164 22940 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.992955 17362 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
W20260709 12:11:56.895318 22569 consensus_meta.cc:287] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.002s
I20260709 12:11:56.994586 18008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 1192) took 1164 ms. Trace:
W20260709 12:11:56.964447 22670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.002s	sys 0.009s
W20260709 12:11:56.904255 23045 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:11:56.978015 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.027434 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:56.844935 22745 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:56.978955 22916 consensus_meta.cc:287] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.000s
I20260709 12:11:57.032732 18015 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:57.032395 17364 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:57.040006 22732 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:57.054543 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33826 (request call id 2280) took 1118 ms. Trace:
I20260709 12:11:57.065059 17437 rpcz_store.cc:276] 0709 12:11:55.935631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.935755 (+   124us) service_pool.cc:224] Handling call
0709 12:11:55.969587 (+ 33832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.990850 (+ 21263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.990894 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.991416 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.288408 (+296992us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:56.288453 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.288528 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.892639 (+604111us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:57.054196 (+161557us) raft_consensus.cc:1685] finished
0709 12:11:57.054220 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.054471 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20809,"raft.queue_time_us":27188,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":27351,"spinlock_wait_cycles":62143360,"thread_start_us":296574,"threads_started":1,"wal-append.queue_time_us":429391}
I20260709 12:11:57.025602 22807 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:57.031715 17434 rpcz_store.cc:276] 0709 12:11:55.944299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.944427 (+   128us) service_pool.cc:224] Handling call
0709 12:11:55.944723 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.945076 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:55.945106 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.945534 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.033042 (+ 87508us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b18004db900. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:56.812307 (+779265us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:56.812355 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.812426 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.992238 (+179812us) raft_consensus.cc:1685] finished
0709 12:11:56.992257 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.025846 (+ 33589us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15047,"raft.queue_time_us":196,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":18635,"spinlock_wait_cycles":10824960,"thread_start_us":779047,"threads_started":1,"wal-append.queue_time_us":972439}
I20260709 12:11:56.939630 23053 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:57.035843 18009 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
W20260709 12:11:57.032764 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 599538us
W20260709 12:11:56.911233 23012 consensus_meta.cc:287] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.993s	user 0.009s	sys 0.002s
W20260709 12:11:56.938815 22955 consensus_meta.cc:287] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.648s	user 0.005s	sys 0.005s
W20260709 12:11:56.926934 22972 consensus_meta.cc:287] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.826s	user 0.014s	sys 0.000s
I20260709 12:11:57.033068 18007 rpcz_store.cc:276] 0709 12:11:55.832471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.832584 (+   113us) service_pool.cc:224] Handling call
0709 12:11:55.909095 (+ 76511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.948566 (+ 39471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.948598 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.949050 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.108697 (+159647us) spinlock_profiling.cc:243] Waited 876 us on lock 0x7b18004711c0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122b8f6ab1 00007f122b903281 00007f1222a10e07 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b 00007f12256bad23 00007f12256bb0d1 00007f1225ad6a0f
0709 12:11:56.400422 (+291725us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:56.400466 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.400543 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.921416 (+520873us) raft_consensus.cc:1685] finished
0709 12:11:56.921449 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.921658 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39126,"raft.queue_time_us":46937,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":12827,"spinlock_wait_cycles":2015104,"thread_start_us":291514,"threads_started":1,"wal-append.queue_time_us":970889}
I20260709 12:11:56.907065 22864 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.978703 23058 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:56.909581 22847 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:56.928437 23048 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:56.903494 22917 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.994045 22665 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:56.991186 23033 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.032824 17360 rpcz_store.cc:276] 0709 12:11:55.921017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.953727 (+ 32710us) service_pool.cc:224] Handling call
0709 12:11:55.954051 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.985424 (+ 31373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.985455 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.094991 (+109536us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.403798 (+308807us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:56.403840 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.403903 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.851663 (+447760us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b480027e358. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:11:56.928669 (+ 77006us) raft_consensus.cc:1685] finished
0709 12:11:56.928696 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.928962 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25846,"raft.queue_time_us":35104,"raft.run_cpu_time_us":6411,"raft.run_wall_time_us":854477,"spinlock_wait_cycles":29467008,"thread_start_us":307430,"threads_started":1,"wal-append.queue_time_us":742571}
I20260709 12:11:57.075382 18008 rpcz_store.cc:276] 0709 12:11:55.831277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.831415 (+   138us) service_pool.cc:224] Handling call
0709 12:11:55.831713 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.373519 (+541806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.373550 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.390980 (+ 17430us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.833123 (+442143us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:56.833167 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.834197 (+  1030us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.890048 (+ 55851us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b480027c6d8. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f122aa44aa1 00007f122aa3bb37 00007f122aa3b9ca 00007f122ab3326f 00007f122ab32f37 00007f122ab4755c 00007f122ab47508 00007f122ab47488 00007f122ab47443 00007f122ab466ec 00007f1229a70a96
0709 12:11:56.990375 (+100327us) raft_consensus.cc:1685] finished
0709 12:11:56.990398 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.994522 (+  4124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137675,"raft.queue_time_us":174786,"raft.run_cpu_time_us":31340,"raft.run_wall_time_us":883393,"spinlock_wait_cycles":64405888,"thread_start_us":857509,"threads_started":2,"wal-append.queue_time_us":551089}
I20260709 12:11:57.024154 22953 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.111572 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 84220.4us
I20260709 12:11:57.037591 23014 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:57.024127 22608 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:57.115288 17288 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:56.749413 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:57.058442 22806 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:11:57.042420 23042 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:57.042258 22945 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:57.055935 22940 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.121662 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:57.079576 22720 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.071359 22670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.003s	sys 0.009s
I20260709 12:11:57.108059 22732 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.131409 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:57.140061 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:57.067987 22807 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.128614 23014 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.121282 22917 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.123241 23033 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.117998 22864 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.110603 22972 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.110301 22955 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.111145 23012 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.123273 22953 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.084012 22569 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.125438 23060 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.163655 22807 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.165792 22917 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:57.169690 18006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.008s	sys 0.032s
W20260709 12:11:57.170051 18006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.008s	sys 0.032s
I20260709 12:11:57.144443 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:57.135157 23048 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:57.142725 22847 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.113189 22916 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.098971 23053 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:57.174772 17287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.012s	sys 0.031s
I20260709 12:11:57.175020 17358 raft_consensus.cc:2368] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18.
W20260709 12:11:57.176210 17287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.012s	sys 0.031s
I20260709 12:11:57.151908 22845 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.154989 23068 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:57.147656 22665 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:57.176815 22966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.021s	sys 0.010s
I20260709 12:11:57.174127 23048 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:57.117753 23058 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.130693 22608 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.185017 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:57.172946 23063 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.137427 22720 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.136359 22945 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.181874 23068 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:57.187019 22966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.022s	sys 0.010s
I20260709 12:11:57.134502 23042 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.187927 23048 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.172569 23060 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.187697 22847 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:57.208876 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.191749 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:57.211545 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:57.211371 22732 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.226337 22864 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.234809 22953 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.235450 23042 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.209043 22847 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.239796 22847 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.243647 23060 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.244856 17359 raft_consensus.cc:2410] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:57.249774 22943 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.250366 22943 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.251742 23033 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.192930 23068 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.253398 22666 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.254904 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 3194) took 1328 ms. Trace:
I20260709 12:11:57.255331 17358 rpcz_store.cc:276] 0709 12:11:55.926316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.929610 (+  3294us) service_pool.cc:224] Handling call
0709 12:11:57.254667 (+1325057us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002909d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:57.254812 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2787903872}
I20260709 12:11:57.192626 23063 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.191334 23057 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.279417 23063 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.244863 23014 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.276935 22916 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.274456 22976 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:57.280905 23053 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:57.289625 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 211928us
I20260709 12:11:57.290426 22976 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:57.293483 22976 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.296262 23048 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.298878 23014 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:57.290302 22733 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.620s	user 0.014s	sys 0.039s
W20260709 12:11:57.300729 22733 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.630s	user 0.014s	sys 0.039s
I20260709 12:11:57.300974 23014 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:57.301223 22965 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:57.301808 22959 consensus_queue.cc:1048] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:57.302897 23008 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:57.303692 18006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52238 (request call id 1189) took 1482 ms. Trace:
I20260709 12:11:57.304117 18006 rpcz_store.cc:276] 0709 12:11:55.820833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.830604 (+  9771us) service_pool.cc:224] Handling call
0709 12:11:55.830974 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.393057 (+562083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.393092 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.407749 (+ 14657us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.171600 (+763851us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:57.171637 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.171694 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.303461 (+131767us) raft_consensus.cc:1685] finished
0709 12:11:57.303482 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.303631 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129891,"raft.queue_time_us":158844,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":42333,"thread_start_us":1154470,"threads_started":2,"wal-append.queue_time_us":766037}
I20260709 12:11:57.300870 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:11:57.303754 18015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52238 (request call id 1185) took 1696 ms (client timeout 1920 ms). Trace:
W20260709 12:11:57.306663 18015 rpcz_store.cc:269] 0709 12:11:55.607288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.607450 (+   162us) service_pool.cc:224] Handling call
0709 12:11:57.303586 (+1696136us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400573fd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:57.303693 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3264195456}
I20260709 12:11:57.310743 22965 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:11:57.327829 22665 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.328455 22665 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.338851 22608 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.344417 23068 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.312237 23012 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.356633 17366 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:57.312104 22972 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.359836 17287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36408 (request call id 1241) took 1407 ms. Trace:
I20260709 12:11:57.308966 22969 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.360853 17289 raft_consensus.cc:1240] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:57.367093 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:57.360275 17287 rpcz_store.cc:276] 0709 12:11:55.962245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.962378 (+   133us) service_pool.cc:224] Handling call
0709 12:11:55.967616 (+  5238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.404113 (+436497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.404143 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.411931 (+  7788us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.176616 (+764685us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:57.176656 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.176722 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.359603 (+182881us) raft_consensus.cc:1685] finished
0709 12:11:57.359625 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.359774 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7049,"raft.queue_time_us":312863,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1188760,"threads_started":2,"wal-append.queue_time_us":872437}
I20260709 12:11:57.382382 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:57.357466 22847 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:57.388077 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 366366us
I20260709 12:11:57.388780 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.390599 17363 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:57.395844 17258 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:57.399771 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.400593 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.402451 17258 leader_election.cc:400] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15.
I20260709 12:11:57.400516 17363 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:57.401315 17365 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:57.383652 23057 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:57.380473 22972 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:57.408004 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.408756 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.411855 22478 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:57.401023 23055 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:57.416083 23025 log.cc:927] Time spent T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 1.082s	user 0.002s	sys 0.000s
W20260709 12:11:57.400095 23054 log.cc:927] Time spent T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.627s	user 0.004s	sys 0.000s
W20260709 12:11:57.424191 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 426862us
I20260709 12:11:57.419621 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.419956 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.389688 22608 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.420519 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.420615 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:57.419092 23055 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.425037 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:57.411110 17406 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:57.430581 17290 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:57.403751 23064 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.432046 17292 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:57.431221 17365 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.418251 23048 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.416550 22478 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.450147 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:57.483341 22966 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:57.483999 22966 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.484472 22687 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:11:57.485273 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 74240.1us
I20260709 12:11:57.485513 22916 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.486313 22916 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:57.486743 22916 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.487660 17404 leader_election.cc:400] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18.
I20260709 12:11:57.489099 22954 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:57.486398 23053 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:57.490481 23053 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:57.491329 23053 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.486119 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:57.495563 22916 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.497776 22666 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.499253 17406 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:57.502004 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 72843.3us
I20260709 12:11:57.504519 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.506282 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.508528 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.511057 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.513443 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.513902 17286 raft_consensus.cc:2393] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:57.434520 23031 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:57.422698 22972 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.432355 23055 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.516232 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:57.518400 17291 raft_consensus.cc:2393] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:57.518757 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.520154 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.517350 22885 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:11:57.467363 23068 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.513871 23057 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:57.523392 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:57.428288 22608 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.526731 17433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 1136) took 2108 ms. Trace:
I20260709 12:11:57.531144 17290 raft_consensus.cc:3060] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.532756 22478 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.532730 22917 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:57.526743 23073 log.cc:927] Time spent T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:57.521965 22916 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.518880 22666 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.517781 22966 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.520203 23058 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.544494 17433 rpcz_store.cc:276] 0709 12:11:55.418053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.439560 (+ 21507us) service_pool.cc:224] Handling call
0709 12:11:55.439885 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.440245 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.440274 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.683778 (+243504us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b2c0015be28. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1224414a11 00007f1224424372 00007f1225b56a01 00007f1225b1b43a 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2
0709 12:11:55.684207 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.825017 (+140810us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:55.825049 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.825122 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.415493 (+1590371us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:11:57.526508 (+111015us) raft_consensus.cc:1685] finished
0709 12:11:57.526529 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.526662 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3682,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8242,"spinlock_wait_cycles":144216832,"thread_start_us":140428,"threads_started":1,"wal-append.queue_time_us":557709}
I20260709 12:11:57.565711 22943 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.540661 22939 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:57.566295 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.568307 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.569265 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:57.528291 23031 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.537449 23014 consensus_queue.cc:1059] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:57.569831 17288 raft_consensus.cc:2376] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16. Re-sending same reply.
I20260709 12:11:57.551541 23057 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.539198 22969 consensus_queue.cc:1059] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:11:57.578776 17362 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:57.578125 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:57.585714 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:57.578130 17366 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:57.581643 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.582686 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:57.584935 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.579468 17404 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:57.590457 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:57.591073 17286 raft_consensus.cc:2376] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12. Re-sending same reply.
I20260709 12:11:57.592311 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.592988 17286 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:11:57.594018 17290 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:57.578138 22939 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.597158 22939 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.599699 23057 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.602455 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:57.604107 23031 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.572342 23077 consensus_queue.cc:1059] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:11:57.606801 23055 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.609282 23055 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:57.611346 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 52289.6us
I20260709 12:11:57.611685 17283 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:11:57.615409 22955 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.616150 22972 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.618484 22608 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.619155 22954 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:57.619752 22954 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.584681 22745 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.619439 23053 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.622078 22954 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.622394 22847 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.641847 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.642853 17433 raft_consensus.cc:2368] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14.
I20260709 12:11:57.643626 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.646003 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.646061 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:57.646883 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.647289 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.647921 18008 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:11:57.648854 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.650087 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.626703 22720 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.631059 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.653906 18014 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:11:57.654247 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.655673 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:57.655980 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.656276 17433 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.656651 17434 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:11:57.632809 17287 raft_consensus.cc:2368] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14.
I20260709 12:11:57.632507 22745 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.658749 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.633726 22687 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:57.638155 23077 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:57.660187 23077 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:57.661055 23077 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:57.633358 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 53971.2us
I20260709 12:11:57.662771 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:57.663631 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:57.664295 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.665333 22917 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.665733 22917 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.666119 22917 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.666311 22806 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.666713 22806 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.667053 22806 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.659665 22687 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:57.668329 22687 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.671240 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:57.675758 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.675983 22569 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.676458 17288 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:57.679354 17289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53674 (request call id 3001) took 1174 ms. Trace:
I20260709 12:11:57.679785 17289 rpcz_store.cc:276] 0709 12:11:56.504871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.505039 (+   168us) service_pool.cc:224] Handling call
0709 12:11:57.360682 (+855643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.380215 (+ 19533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.679150 (+298935us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54002017d0. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1a8ad 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:57.679286 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967031040}
I20260709 12:11:57.687386 22945 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.687664 23056 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:57.692816 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.692701 23056 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.690456 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.694139 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.695168 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:57.690877 22827 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:57.752699 23060 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:57.752771 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:57.698499 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.753558 17439 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:11:57.755446 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.758035 17435 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:57.758452 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:57.753221 23060 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:57.760200 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:57.760830 17441 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.760301 23060 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.761188 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.761822 17432 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:57.764626 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.768498 17441 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:57.769295 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:57.770587 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.771003 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.769935 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.771806 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.704490 17365 raft_consensus.cc:2468] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:57.769039 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.772908 18015 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:57.773402 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.773406 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.774536 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.695768 17291 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:57.775290 17365 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 11: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:11:57.712478 22942 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.775821 22942 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.776677 23060 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.777869 22942 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.714499 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.778817 17437 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:11:57.697638 17286 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:57.718267 22255 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:57.779944 22255 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:57.780695 22255 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.781766 22255 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.718696 22940 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.718693 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.782382 22940 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.783094 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.719115 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:57.719179 22670 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:57.783603 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.771309 17435 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:57.784031 22670 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.784536 22940 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.717060 17980 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:11:57.720655 17332 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:57.785593 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 68644.2us
W20260709 12:11:57.786170 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 65590.2us
I20260709 12:11:57.785570 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:57.721192 22943 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.721051 22732 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:57.721889 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:57.722543 22969 raft_consensus.cc:3055] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:57.723278 22945 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.723798 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.724517 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.726799 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:57.857081 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.727043 23012 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:57.727733 23014 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:57.727802 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:57.730997 22745 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:57.737004 23077 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.739993 22963 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.740672 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:57.873400 18011 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 18: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:57.741734 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:57.741902 22720 consensus_queue.cc:1048] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:57.741739 17433 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:57.742039 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:57.872396 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 85179.4us
I20260709 12:11:57.743172 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.843122 22608 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:57.746872 17187 catalog_manager.cc:5697] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 7 to 9, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 9 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:11:57.748574 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.886066 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:57.886283 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.886615 17366 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
W20260709 12:11:57.749509 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.888093 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:57.888715 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.888837 18011 raft_consensus.cc:2368] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17.
I20260709 12:11:57.695621 17288 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:57.697187 23056 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:57.760196 17183 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55932 (request call id 330) took 23162 ms (client timeout 15000 ms). Trace:
I20260709 12:11:57.705250 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.708127 22665 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:57.839026 17360 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.850001 22969 raft_consensus.cc:740] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:57.839087 18008 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:57.839638 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:57.912456 17290 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.788347 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:57.842692 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 76922us
I20260709 12:11:57.846410 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:57.847393 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:57.857782 17359 raft_consensus.cc:2368] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18.
I20260709 12:11:57.859673 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.913986 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.863803 17434 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:57.751044 22917 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:57.868216 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.870505 23083 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:57.870568 22670 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.873893 18014 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.876183 17364 raft_consensus.cc:1275] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:57.882895 18007 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:11:57.747318 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:57.883314 17440 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:57.844482 22419 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:57.884507 17258 leader_election.cc:400] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14.
I20260709 12:11:57.885151 17332 leader_election.cc:400] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14.
I20260709 12:11:57.882332 17367 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:57.889669 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:57.915172 18015 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.916179 17407 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:57.916035 17365 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:11:57.752893 22687 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.982069 17332 leader_election.cc:403] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:57.982625 17258 leader_election.cc:403] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:57.986460 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 102102us
W20260709 12:11:57.986449 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 70321.9us
I20260709 12:11:57.987836 17407 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:57.987964 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:57.986850 17436 raft_consensus.cc:2410] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:11:57.988607 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 103613us
I20260709 12:11:57.936319 18013 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
W20260709 12:11:57.932154 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 88221.3us
I20260709 12:11:57.917542 17404 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:57.984385 18008 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:57.996361 17290 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:11:57.999343 17358 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 10.
I20260709 12:11:58.001144 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:58.001562 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:57.939322 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 151027us
I20260709 12:11:58.011708 18014 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:11:58.011866 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:58.007694 17978 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:58.013520 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:57.889729 22608 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.882781 22916 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:57.851069 22806 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.015596 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:58.016290 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:58.048703 17434 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.012477 23057 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14.
W20260709 12:11:58.052347 17285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.030s	sys 0.045s
W20260709 12:11:58.052652 17285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.030s	sys 0.045s
W20260709 12:11:58.052584 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44988.9us
I20260709 12:11:58.019709 22687 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:57.982717 22937 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:58.036917 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 45117us
I20260709 12:11:57.920881 23055 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:58.070425 23055 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.072813 23055 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:57.844579 22943 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.022537 17366 consensus_queue.cc:237] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.082056 17433 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 14: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:57.896184 23036 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:58.002043 22665 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:58.041306 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 123835us
I20260709 12:11:58.012641 22728 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:58.046207 17360 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:58.112219 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:58.059437 22745 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:58.013971 23068 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:58.018070 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:58.048946 18010 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:58.050599 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:58.161239 18008 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.866468 23014 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:57.866165 22945 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.035513 17432 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 14: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:11:57.866870 23012 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.030673 22847 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:58.033213 22885 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:58.055783 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:58.170621 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:58.171183 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 115471us
I20260709 12:11:58.035426 22877 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:58.061489 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:58.174678 17435 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:11:58.102547 22812 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:58.060956 22986 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.047982 22972 raft_consensus.cc:2804] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:57.885923 22963 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.021373 22940 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:11:58.052141 22608 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.000595 23083 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.113068 17255 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:58.058286 22991 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:57.910746 23031 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 12:11:58.164965 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.206673 17440 raft_consensus.cc:2368] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14.
I20260709 12:11:58.207633 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.208292 17440 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:58.209163 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:58.216948 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.115296 17361 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:11:57.896186 17183 rpcz_store.cc:269] 0709 12:11:34.597493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.597867 (+   374us) service_pool.cc:224] Handling call
0709 12:11:35.513436 (+915569us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b5400002210. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f7640 00007f122b8ce846 00007f122b9d890e 00007f1229e992a4 00007f1229e99232 00007f1229e99161 00007f1229e990dc 00007f1229e98392 00007f1223e5648c 00007f1223e558c6
0709 12:11:57.760078 (+22246642us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:50.330630 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:50.331313 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:50.331364 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:11:50.331398 (+    34us) tablet.cc:662] Decoding operations
0709 12:11:50.439936 (+108538us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:50.440033 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:50.440061 (+    28us) tablet.cc:685] Acquiring locks for 32 operations
0709 12:11:50.558598 (+118537us) tablet.cc:701] Row locks acquired
0709 12:11:50.558647 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:11:50.558830 (+   183us) write_op.cc:270] Start()
0709 12:11:50.559005 (+   175us) write_op.cc:276] Timestamp: P: 1783599110558767 usec, L: 0
0709 12:11:50.559042 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:11:50.559847 (+   805us) log.cc:844] Serialized 12717 byte log entry
0709 12:11:52.386348 (+1826501us) op_driver.cc:464] REPLICATION: finished
0709 12:11:52.510993 (+124645us) write_op.cc:301] APPLY: starting
0709 12:11:52.551046 (+ 40053us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:53.600954 (+1049908us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:53.601079 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:53.841612 (+240533us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:53.842117 (+   505us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=0,mrs_lookups=0
0709 12:11:53.842190 (+    73us) write_op.cc:312] APPLY: finished
0709 12:11:53.867414 (+ 25224us) log.cc:844] Serialized 276 byte log entry
0709 12:11:53.967159 (+ 99745us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:53.975956 (+  8797us) write_op.cc:454] Released schema lock
0709 12:11:53.976053 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:53.976575 (+   522us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:53.976606 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1343126,"reported_tablets":48,"spinlock_wait_cycles":64856832,"child_traces":[["op",{"apply.queue_time_us":98909,"apply.run_cpu_time_us":68587,"apply.run_wall_time_us":1474587,"cfile_cache_hit":130,"cfile_cache_hit_bytes":137823,"num_ops":32,"prepare.queue_time_us":456077,"prepare.run_cpu_time_us":26920,"prepare.run_wall_time_us":674674,"raft.queue_time_us":681971,"raft.run_cpu_time_us":10066,"raft.run_wall_time_us":48239,"replication_time_us":1815394,"thread_start_us":967740,"threads_started":5,"wal-append.queue_time_us":813215,"wal-append.run_cpu_time_us":25380,"wal-append.run_wall_time_us":2842445}]]}
W20260709 12:11:58.174873 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 113468us
I20260709 12:11:58.219264 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:58.061487 22916 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.188539 17362 raft_consensus.cc:3060] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.191658 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.239925 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.116016 22965 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:58.112741 22670 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14.
I20260709 12:11:58.163259 22666 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:58.196154 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:58.197242 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 84262.8us
I20260709 12:11:58.047732 18007 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:58.182690 22728 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.202068 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.203577 17439 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.113256 23036 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.182956 22885 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:58.221771 17406 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:58.197482 22972 raft_consensus.cc:697] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:58.223039 22745 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:58.179577 22877 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.240404 22966 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:58.127331 22969 consensus_queue.cc:260] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.272939 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.274255 23036 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:58.274892 22478 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:58.275616 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 53927.9us
I20260709 12:11:58.276986 22665 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:58.297190 17435 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.243196 22940 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:11:58.285095 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.187497 22812 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.298506 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:58.231407 22991 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.300101 22940 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:58.332667 22728 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.333448 22940 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.334818 22940 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.332055 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:58.338762 22812 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:58.339324 22728 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:58.340418 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.288434 22966 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:58.340041 22728 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:58.342598 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:58.291039 22745 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:58.267338 22666 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.316274 22665 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:58.351589 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.356884 17406 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:58.372165 17333 leader_election.cc:400] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14.
I20260709 12:11:58.373210 17333 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:58.375599 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:58.377663 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 320617us
I20260709 12:11:58.382766 18015 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 18.
I20260709 12:11:58.347316 22917 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:58.349435 22969 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.385699 17333 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:58.387454 17437 raft_consensus.cc:1240] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:58.389146 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:58.350368 22806 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:58.345227 22812 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:58.379712 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.384948 17981 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:58.351006 22966 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.357662 22955 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:58.384043 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 330405us
I20260709 12:11:58.392216 17434 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
W20260709 12:11:58.396000 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 382523us
W20260709 12:11:58.424463 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.445200 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:58.446646 17441 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 12:11:58.441511 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 57898.4us
I20260709 12:11:58.377302 22478 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.454226 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:58.455045 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:58.456619 22255 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:58.458364 22255 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.460084 22255 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.459448 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:58.475334 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:58.476811 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:58.479872 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:11:58.486508 17331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.001s	sys 0.032s
W20260709 12:11:58.486866 17331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.001s	sys 0.032s
I20260709 12:11:58.487372 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:58.471329 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:58.488816 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:58.491947 18008 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:11:58.447937 23031 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:58.458364 23060 consensus_meta.cc:287] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260709 12:11:58.449651 22955 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:58.508620 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:58.445071 22419 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:58.508033 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:58.455405 23068 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:58.496255 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:58.510061 18010 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 10.
I20260709 12:11:58.446305 22847 consensus_queue.cc:1059] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:58.467803 22732 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:58.541419 23086 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:11:58.542558 22419 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.486398 23014 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:58.546892 22666 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:58.547681 22916 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:58.549707 22877 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:58.490675 22965 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.553525 23012 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:58.493355 22980 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:58.385037 22885 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.479388 22945 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:58.380574 22972 consensus_queue.cc:237] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.484951 23055 raft_consensus.cc:2764] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:11:58.449452 22812 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.540174 23083 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:11:58.557915 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 61868.3us
I20260709 12:11:58.559132 17362 raft_consensus.cc:2468] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
W20260709 12:11:58.625089 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.511634 23031 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.512633 22569 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:58.700549 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:58.512944 22955 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.508008 22986 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:58.517081 23068 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:11:58.643042 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.004s	sys 0.012s
W20260709 12:11:58.671036 23091 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.118s	user 0.001s	sys 0.002s
W20260709 12:11:58.723021 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.010s	sys 0.017s
I20260709 12:11:58.728544 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 2239) took 1299 ms. Trace:
I20260709 12:11:58.519980 23036 consensus_queue.cc:1059] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.204s
I20260709 12:11:58.668572 22732 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:58.632527 23057 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:58.733201 17285 rpcz_store.cc:276] 0709 12:11:57.429367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.429483 (+   116us) service_pool.cc:224] Handling call
0709 12:11:57.429815 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:57.468181 (+ 38366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.468219 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:57.468737 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.053150 (+584413us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:58.053193 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.081274 (+ 28081us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b540007c954. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:58.081338 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:58.722312 (+640974us) raft_consensus.cc:1685] finished
0709 12:11:58.722333 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.728465 (+  6132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9080,"raft.queue_time_us":9992,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":14075,"spinlock_wait_cycles":66168192,"thread_start_us":513349,"threads_started":1,"wal-append.queue_time_us":722867}
I20260709 12:11:58.712586 22569 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.729306 22255 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.675203 23014 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:58.683491 22670 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:58.753836 22255 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:58.627254 22980 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:58.715399 23031 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.674304 23097 consensus_queue.cc:1048] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:11:58.676239 23095 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:11:58.674711 22847 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:11:58.720324 23089 log.cc:927] Time spent T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.457s	user 0.011s	sys 0.002s
I20260709 12:11:58.695236 22991 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:58.718696 22986 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.726969 23068 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.755275 23034 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:58.758440 22813 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.626883 22963 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:58.765991 17362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34702 (request call id 1100) took 1015 ms. Trace:
I20260709 12:11:58.788187 17362 rpcz_store.cc:276] 0709 12:11:57.750846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.785343 (+ 34497us) service_pool.cc:224] Handling call
0709 12:11:58.765824 (+980481us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54003c5854. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:58.765934 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921757952}
I20260709 12:11:58.768639 17439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 1151) took 1014 ms. Trace:
I20260709 12:11:58.748669 22569 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.519984 22745 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.519380 22728 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:58.758394 22608 consensus_meta.cc:287] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.005s
I20260709 12:11:58.754603 23057 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:58.763638 22980 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.789438 17439 rpcz_store.cc:276] 0709 12:11:57.754364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.754501 (+   137us) service_pool.cc:224] Handling call
0709 12:11:57.754781 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.263572 (+508791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.768412 (+504840us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001a09d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:58.768580 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031637760}
W20260709 12:11:58.794250 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 338503us
W20260709 12:11:58.794466 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 305718us
W20260709 12:11:58.800323 17332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.019s	sys 0.006s
W20260709 12:11:58.804497 17332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.019s	sys 0.007s
I20260709 12:11:58.804728 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:11:58.801755 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 412642us
I20260709 12:11:58.779452 22986 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.810773 23055 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.812768 17258 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:58.815570 23055 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:58.785409 22687 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.824990 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:58.825800 17285 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:11:58.777269 23095 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.816126 23055 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:58.801216 23058 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:58.777465 22847 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.834450 17404 leader_election.cc:400] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18.
W20260709 12:11:58.835616 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.806706 22980 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:58.805720 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:58.796234 22813 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.849982 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:58.853386 17362 raft_consensus.cc:2368] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14.
W20260709 12:11:58.855525 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.856763 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:58.795574 23034 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.818436 22608 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.867148 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:58.869063 23034 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:11:58.857390 23077 consensus_meta.cc:287] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.975s	user 0.003s	sys 0.009s
I20260709 12:11:58.872450 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:58.848865 22943 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:58.876405 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:11:58.877257 17361 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:11:58.877638 23099 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:11:58.881402 18012 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:11:58.874837 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:58.887805 22943 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:58.888994 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 83345.7us
I20260709 12:11:58.894534 22813 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:58.900509 22943 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:58.901702 23110 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:58.902139 23110 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
W20260709 12:11:58.902235 22665 consensus_meta.cc:287] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.003s
I20260709 12:11:58.902737 22665 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.903178 23110 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.904482 22812 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:58.905179 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:58.907248 22847 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:58.907682 23110 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.908744 22971 raft_consensus.cc:3055] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:58.909133 22971 raft_consensus.cc:740] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:11:58.909963 22971 consensus_queue.cc:260] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:58.911043 22971 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.917320 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:58.853541 22827 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.922363 17438 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:58.926545 18009 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:11:58.849937 23058 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:58.931985 17330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.936328 18012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52232 (request call id 1164) took 1050 ms. Trace:
I20260709 12:11:58.936875 18012 rpcz_store.cc:276] 0709 12:11:57.885487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.885825 (+   338us) service_pool.cc:224] Handling call
0709 12:11:58.936167 (+1050342us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54005f2dd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:58.936271 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440866176}
I20260709 12:11:58.938386 17366 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.936643 18009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52246 (request call id 1224) took 1051 ms. Trace:
I20260709 12:11:58.942958 17404 leader_election.cc:400] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14.
I20260709 12:11:58.943329 17404 leader_election.cc:403] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:58.946152 22665 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:58.946523 22687 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.942469 18009 rpcz_store.cc:276] 0709 12:11:57.884784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.884909 (+   125us) service_pool.cc:224] Handling call
0709 12:11:57.885240 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.927038 (+1041798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.936402 (+  9364us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540045fbd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:11:58.936586 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2394119424}
W20260709 12:11:58.950990 17438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52714 (request call id 1158) took 1185 ms (client timeout 1577 ms). Trace:
W20260709 12:11:58.951484 17438 rpcz_store.cc:269] 0709 12:11:57.765837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.771558 (+  5721us) service_pool.cc:224] Handling call
0709 12:11:58.950782 (+1179224us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000ff354. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:58.950906 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644375936}
I20260709 12:11:58.954717 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:11:58.925079 23090 log.cc:927] Time spent T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.430s	user 0.000s	sys 0.003s
I20260709 12:11:58.960273 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:58.964699 17978 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:58.932554 23117 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:58.925792 22827 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.982604 17366 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:11:58.982857 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.985090 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.871766 23057 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:58.993942 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:11:58.994339 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:58.988041 22940 consensus_meta.cc:287] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.000s
I20260709 12:11:58.979292 23034 raft_consensus.cc:2804] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:58.973075 22963 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.996088 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.008997 17286 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:59.010166 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.010850 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.011359 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:58.935235 23055 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:59.013159 17981 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.191.67:34917 timed out after 1.577s (SENT) [suppressed 7 similar messages]
I20260709 12:11:59.019353 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.033838 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:59.036942 17286 raft_consensus.cc:2393] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 17: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:59.043789 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:59.052894 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.054731 17286 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:11:58.994405 22980 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.037176 23034 raft_consensus.cc:697] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:58.978485 23117 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:59.071864 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:59.073184 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.015865 23083 consensus_queue.cc:1059] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 12:11:59.075155 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.016162 22963 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.079670 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:59.080610 17358 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:11:59.081476 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:59.083963 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:59.084842 17333 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:59.086448 17333 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:59.088239 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:11:59.100889 17286 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:59.077775 23095 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:59.104631 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:59.086787 22608 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.105198 17438 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:11:59.092453 22665 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.088909 22943 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.107467 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.108108 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.108781 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.109556 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.116355 17290 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:59.109756 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.111728 17404 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:59.113363 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:59.113942 17284 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:11:59.119784 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:59.120431 17292 raft_consensus.cc:3060] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.121019 17286 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:11:59.119963 17333 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:59.128887 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:59.129030 17333 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:59.129573 17286 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.129988 17333 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:59.130249 23110 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:11:59.132122 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 118985us
I20260709 12:11:59.113758 22419 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:59.099179 23122 consensus_queue.cc:1059] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:11:59.114034 22969 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:59.117352 23058 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.127300 22665 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:59.130728 22940 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:59.165516 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:59.123893 22885 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:59.166388 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:11:59.177501 23132 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:59.177680 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:59.132225 23110 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:59.167410 18009 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:59.167989 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:59.168519 17290 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:59.181665 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:59.183359 17286 raft_consensus.cc:2468] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:11:59.170202 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.170867 17292 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:11:59.170917 17433 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:11:59.182940 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47348.3us
I20260709 12:11:59.172408 17432 raft_consensus.cc:1240] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:59.175084 18012 raft_consensus.cc:1275] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:59.127786 22812 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:59.187950 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.188153 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:59.115779 23034 consensus_queue.cc:237] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:59.186988 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 61623.7us
I20260709 12:11:59.143452 22991 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:59.186576 17978 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:59.193394 22980 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:11:59.193681 23130 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:59.192444 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:59.196223 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.197000 17292 raft_consensus.cc:2393] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:11:59.197103 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.198724 17289 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 12:11:59.198988 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.202461 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:59.202879 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:59.204782 17289 raft_consensus.cc:2368] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14.
W20260709 12:11:59.190641 23120 log.cc:927] Time spent T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:11:59.211393 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.210319 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.201617 22665 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:11:59.200392 22569 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.211549 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:11:59.188308 22885 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:11:59.219151 18007 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 14: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:59.215884 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.195940 22745 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:59.221294 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.194600 22827 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.195312 22991 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:11:59.209563 17332 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:59.224480 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:11:59.227208 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:59.227861 17362 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:11:59.195571 22986 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.230774 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.231972 22986 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:59.232445 22569 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.217450 22665 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.229507 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:11:59.211714 23122 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:59.231909 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.231110 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:59.238597 18015 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:11:59.215979 23056 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:59.237802 17258 leader_election.cc:400] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17.
I20260709 12:11:59.240049 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:11:59.240600 17258 leader_election.cc:403] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:59.236266 17439 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:11:59.194854 22812 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.223352 22969 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:59.252099 23095 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17.
I20260709 12:11:59.231101 22885 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.260946 17332 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:59.241865 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:59.267464 17981 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:11:59.264147 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.268693 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:59.305261 22963 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:59.261236 22940 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.306849 22940 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:59.307235 22940 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.314834 23095 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.251832 23031 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:59.316524 22966 consensus_meta.cc:287] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.859s	user 0.006s	sys 0.005s
W20260709 12:11:59.263953 22955 consensus_meta.cc:287] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.002s
I20260709 12:11:59.316975 22966 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.317111 18010 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 13: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:11:59.318140 17365 raft_consensus.cc:1240] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:59.318678 22955 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.319628 22812 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.250654 22687 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14.
I20260709 12:11:59.320798 22955 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:59.225931 22745 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:59.268953 22255 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.269835 17433 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:11:59.324203 22745 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.324306 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:59.225912 22991 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:59.327961 17441 raft_consensus.cc:2468] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
W20260709 12:11:59.254830 23129 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:11:59.293116 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 51323.2us
I20260709 12:11:59.331444 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:59.242080 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49864.4us
I20260709 12:11:59.268796 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:11:59.237495 23126 log.cc:927] Time spent T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 12:11:59.343924 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 75200.6us
I20260709 12:11:59.352579 17332 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:11:59.346937 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:59.233673 23101 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:59.355685 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:59.356381 17258 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:11:59.249753 23135 log.cc:927] Time spent T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:11:59.242067 23056 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.364645 17980 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:11:59.242551 23058 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.367835 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:59.366768 22255 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.259119 23060 raft_consensus.cc:3055] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:59.341091 23122 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.386588 17980 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:11:59.449247 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 256853us
I20260709 12:11:59.351715 22745 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.354669 22969 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.446854 17407 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:59.369552 23095 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:59.233342 23014 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
W20260709 12:11:59.455313 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 68809.3us
I20260709 12:11:59.470494 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:59.452111 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:11:59.367980 23056 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:59.472544 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:59.380602 22732 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.387101 23058 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:59.481503 17434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 1166) took 1030 ms. Trace:
I20260709 12:11:59.255355 23110 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.457464 22813 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.454053 23122 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.502465 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:11:59.448503 23060 raft_consensus.cc:740] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:59.379136 23140 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.462780 22969 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:59.380012 22971 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.116s
I20260709 12:11:59.563870 22670 consensus_queue.cc:1048] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:59.496760 17434 rpcz_store.cc:276] 0709 12:11:58.451452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.452693 (+  1241us) service_pool.cc:224] Handling call
0709 12:11:58.453070 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.774511 (+321441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.774540 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.775018 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:11:59.007380 (+232362us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:59.133488 (+126108us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.138846 (+  5358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.138922 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.481288 (+342366us) raft_consensus.cc:1685] finished
0709 12:11:59.481309 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.481438 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6957,"prepare.queue_time_us":203403,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2598,"raft.queue_time_us":86948,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":4434,"thread_start_us":665280,"threads_started":3,"wal-append.queue_time_us":297540}
I20260709 12:11:59.551123 23031 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.498545 23058 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.545118 22939 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.566457 22939 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:59.513538 22813 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:11:59.553159 23060 consensus_queue.cc:260] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.558918 22940 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:59.574278 22940 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.458199 23098 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.575417 22939 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:59.575907 23060 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.465549 23139 raft_consensus.cc:2804] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:59.495658 22827 raft_consensus.cc:2764] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:59.572160 22813 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.545765 23122 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.581538 22966 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:59.577543 22991 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.569249 22969 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:59.595481 23068 consensus_meta.cc:287] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: Time spent flushing consensus metadata: real 0.803s	user 0.003s	sys 0.008s
I20260709 12:11:59.601257 23068 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:59.602836 22813 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.603446 23068 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.587698 23139 raft_consensus.cc:697] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:11:59.604888 23139 consensus_queue.cc:237] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:11:59.593374 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 114175us
I20260709 12:11:59.605294 22813 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:11:59.571815 22885 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:59.667019 23108 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:59.667639 23108 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.669735 23108 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.664099 23098 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:59.663882 22827 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:11:59.696089 22827 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.706661 22827 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.694964 23098 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.709502 23098 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.718705 22969 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:59.721964 22991 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:11:59.702432 23056 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.731801 23056 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.745379 22969 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.741612 23058 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:11:59.749903 23058 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.754804 23122 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.770890 23122 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:11:59.931610 22991 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.932638 22991 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:11:59.935948 23131 log.cc:927] Time spent T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.812s	user 0.000s	sys 0.034s
I20260709 12:11:59.936435 22938 consensus_queue.cc:1059] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:59.807081 17284 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:59.807412 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 441752us
W20260709 12:11:59.847234 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 400292us
I20260709 12:11:59.849814 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.851670 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.852731 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:59.859766 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.862178 17362 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:59.861951 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:11:59.863063 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:59.863541 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:59.865556 17440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33826 (request call id 2299) took 1692 ms. Trace:
I20260709 12:11:59.940603 17440 rpcz_store.cc:276] 0709 12:11:58.173223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.208902 (+ 35679us) service_pool.cc:224] Handling call
0709 12:11:59.865024 (+1656122us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540015fed4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:59.865324 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945744128}
W20260709 12:11:59.867738 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.868270 17366 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:59.868884 23161 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:59.879402 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:11:59.881323 17359 raft_consensus.cc:1240] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:59.885183 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 404942us
W20260709 12:11:59.890679 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.898396 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:11:59.902661 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:11:59.902863 18007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52246 (request call id 1230) took 1419 ms. Trace:
I20260709 12:11:59.905087 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:11:59.915817 17257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.005s
I20260709 12:11:59.953608 17441 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:59.989419 23143 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:11:59.992731 23138 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.675s	user 0.012s	sys 0.004s
I20260709 12:11:59.997247 23110 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.998065 23110 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:11:59.998462 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:00.001060 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:00.003168 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:00.005403 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:00.006467 17291 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.011365 22938 raft_consensus.cc:3055] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:00.011893 22938 raft_consensus.cc:740] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:00.013232 22938 consensus_queue.cc:260] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.015182 22940 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.019538 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:00.022557 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:00.023298 23117 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:00.026281 17257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.007s	sys 0.010s
I20260709 12:11:59.954253 18007 rpcz_store.cc:276] 0709 12:11:58.482912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.483039 (+   127us) service_pool.cc:224] Handling call
0709 12:11:59.902334 (+1419295us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400573fd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:11:59.902665 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1632048896}
W20260709 12:12:00.043171 23128 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.863s	user 0.008s	sys 0.053s
I20260709 12:11:59.985929 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.044113 17435 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:00.045375 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 59694.8us
I20260709 12:12:00.046411 23117 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:00.046761 18009 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 11: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:00.046995 23117 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:00.048449 23117 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.049831 22954 raft_consensus.cc:3055] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:00.050398 22954 raft_consensus.cc:740] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:00.051216 17288 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:00.043304 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 122689us
I20260709 12:12:00.043577 22940 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.043030 17365 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 18.
I20260709 12:12:00.059955 17440 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:00.073390 22940 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.058311 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:00.084118 17286 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:00.059716 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:00.059182 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:00.092135 17407 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:00.095919 22916 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:00.096115 23156 consensus_queue.cc:1059] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:00.097093 22916 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:00.097432 23156 raft_consensus.cc:3055] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:00.097932 23156 raft_consensus.cc:740] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:00.057828 22986 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:00.099252 22986 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.099431 23156 consensus_queue.cc:260] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.101115 17286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:00.101567 23156 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.102017 17286 raft_consensus.cc:606] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.102461 17286 raft_consensus.cc:614] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:00.106305 17436 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:12:00.058065 22419 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:00.108330 22419 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:00.110967 17440 raft_consensus.cc:1240] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:00.114630 22938 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.119328 22986 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.051824 22954 consensus_queue.cc:260] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.120602 22954 raft_consensus.cc:3060] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.097499 22916 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:00.123587 22916 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.125145 22916 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:00.126304 23124 log.cc:927] Time spent T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 1.042s	user 0.023s	sys 0.053s
W20260709 12:12:00.126521 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 62846.5us
I20260709 12:12:00.127542 17258 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.129714 17359 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:00.130858 17360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48990 (request call id 2400) took 1431 ms. Trace:
I20260709 12:12:00.131240 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:00.131760 22670 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:00.132824 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:00.135677 17332 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:00.137166 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.137593 23107 raft_consensus.cc:2804] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.138720 23107 raft_consensus.cc:697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:00.139982 23107 consensus_queue.cc:237] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.140489 22991 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.141295 22847 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.131284 17360 rpcz_store.cc:276] 0709 12:11:58.699493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.701548 (+  2055us) service_pool.cc:224] Handling call
0709 12:11:58.701925 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.702345 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.702376 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.717645 (+ 15269us) log.cc:844] Serialized 26 byte log entry
0709 12:11:59.004882 (+287237us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:59.004929 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.005017 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:00.125402 (+1120385us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:12:00.130325 (+  4923us) raft_consensus.cc:1685] finished
0709 12:12:00.130349 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.130676 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10838,"raft.queue_time_us":1626,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":16425,"spinlock_wait_cycles":12255488,"thread_start_us":254976,"threads_started":1,"wal-append.queue_time_us":316177}
I20260709 12:12:00.150852 22687 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:00.151659 22687 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:00.154488 23145 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.575s	user 0.007s	sys 0.020s
I20260709 12:12:00.156400 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.158282 22955 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.161772 17441 raft_consensus.cc:2468] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:12:00.100423 17367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34702 (request call id 1110) took 1017 ms. Trace:
I20260709 12:12:00.135865 17435 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:00.167327 17291 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:12:00.174700 17288 raft_consensus.cc:2468] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:12:00.176813 22687 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:00.177284 23113 consensus_queue.cc:1059] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:00.190508 23113 consensus_queue.cc:1243] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer aaafaad0810b4e95983d2d73ec814346 log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:00.191134 23113 raft_consensus.cc:3055] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:00.191495 23113 raft_consensus.cc:740] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:00.192548 23113 consensus_queue.cc:260] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.194125 23113 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.180269 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:00.182508 22980 consensus_queue.cc:1059] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:12:00.195776 23148 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:00.184047 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.197909 22687 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.184047 17360 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:00.184826 22972 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:00.185344 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 67780.6us
I20260709 12:12:00.185905 17283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4466b54543584a9898797997087d10f1"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:00.163301 17367 rpcz_store.cc:276] 0709 12:11:59.083379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.083493 (+   114us) service_pool.cc:224] Handling call
0709 12:11:59.083799 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.084021 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.084044 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.092772 (+  8728us) log.cc:844] Serialized 26 byte log entry
0709 12:11:59.163458 (+ 70686us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:59.163496 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.163578 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.929050 (+765472us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f12256b686e 00007f12256b5bb6 00007f12256b57d8 00007f12256bf221 00007f12256bf1d9 00007f12256bf169
0709 12:12:00.086841 (+157791us) raft_consensus.cc:1685] finished
0709 12:12:00.086862 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.100236 (+ 13374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31665024,"thread_start_us":51056,"threads_started":1,"wal-append.queue_time_us":110214}
W20260709 12:12:00.176901 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.206065 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.203147 17283 raft_consensus.cc:606] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.206890 17283 raft_consensus.cc:614] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:00.205179 17366 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:12:00.171151 23165 raft_consensus.cc:2764] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:00.205986 22955 raft_consensus.cc:2764] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:00.223487 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:00.225054 22419 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.232616 22419 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:00.238149 22608 raft_consensus.cc:3055] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:00.238658 22608 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:00.239692 22608 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.241264 22608 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.201175 22972 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.252676 17360 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:12:00.263672 17406 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:00.266571 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:00.270960 17288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:00.272209 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:00.286492 17439 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:12:00.287955 17360 raft_consensus.cc:2393] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 14: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:12:00.270124 22938 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.289441 17358 pending_rounds.cc:85] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 8
I20260709 12:12:00.285418 17288 raft_consensus.cc:606] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.291987 17288 raft_consensus.cc:614] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:00.283797 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:00.294479 23014 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.291535 17358 pending_rounds.cc:107] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:12:00.295105 23014 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.295732 17358 raft_consensus.cc:2889] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.277982 23110 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:00.295356 17365 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:00.295456 22972 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:00.302138 23161 consensus_queue.cc:1059] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:00.313149 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.306455 22728 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:12:00.315831 23148 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:00.316470 23148 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:00.317812 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:00.318742 18009 raft_consensus.cc:2393] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 19: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:00.318408 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:00.355254 17288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:00.317551 23148 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.357878 17288 raft_consensus.cc:606] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.358332 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:00.343211 17980 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:12:00.363480 17364 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.364374 18010 raft_consensus.cc:1240] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:00.369071 18006 raft_consensus.cc:1240] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:00.370693 17360 raft_consensus.cc:1240] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:00.375850 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 85238.6us
I20260709 12:12:00.376173 23034 raft_consensus.cc:2804] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.376930 23034 raft_consensus.cc:697] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:00.378147 23034 consensus_queue.cc:237] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.379172 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:00.376562 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 129840us
I20260709 12:12:00.383468 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53688 (request call id 2267) took 1226 ms. Trace:
I20260709 12:12:00.383842 17284 rpcz_store.cc:276] 0709 12:11:59.136780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.136934 (+   154us) service_pool.cc:224] Handling call
0709 12:11:59.137301 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.982454 (+845153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.359300 (+376846us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54002cfbd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1be01 00007f1225b1a83e 00007f122aadf419 00007f1224056bd4 00007f1224056b62 00007f1224056a91 00007f1224056a0c 00007f1224055cc2 00007f1223e5648c 00007f1223e558c6
0709 12:12:00.363347 (+  4047us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1538492288}
I20260709 12:12:00.390133 17435 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:00.391438 22938 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.395350 22938 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.397909 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:00.399205 18008 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:12:00.399454 17406 leader_election.cc:400] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Vote denied by peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395) with higher term. Message: Invalid argument: T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 13. Current term is 14.
I20260709 12:12:00.401850 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.402539 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.402766 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:00.402453 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.404206 17362 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 19.
I20260709 12:12:00.406320 23068 raft_consensus.cc:3055] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:00.406839 23068 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:00.407974 18015 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:12:00.409225 23068 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.412056 23068 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:00.410015 23170 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:12:00.418303 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:00.423022 23014 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:00.437198 22847 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.438585 17288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:00.439226 17288 raft_consensus.cc:606] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.439594 17288 raft_consensus.cc:614] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:00.443254 18009 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:00.449860 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49115.5us
I20260709 12:12:00.449395 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:12:00.454778 17979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.461071 17365 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.456097 17981 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
W20260709 12:12:00.464359 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 46814.8us
I20260709 12:12:00.435973 22938 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:00.479234 23053 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:12:00.480326 17292 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:00.480541 18009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:59534
I20260709 12:12:00.481158 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:00.482478 17283 raft_consensus.cc:1275] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:00.479102 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:00.479113 23127 consensus_queue.cc:1059] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:12:00.485357 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.479087 18013 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:00.481226 18009 raft_consensus.cc:606] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.487104 18009 raft_consensus.cc:614] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:00.495298 17406 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.497159 17406 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.498909 22938 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:00.499735 22938 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.500022 22939 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:00.501915 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.502533 17364 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
W20260709 12:12:00.503347 17256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.507068 17365 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 19.
I20260709 12:12:00.508785 22986 raft_consensus.cc:2804] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:00.509395 22986 raft_consensus.cc:697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:00.510449 22986 consensus_queue.cc:237] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.512673 22827 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.514219 22813 raft_consensus.cc:3055] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:00.514605 22813 raft_consensus.cc:740] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:00.514897 17360 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:12:00.515514 22813 consensus_queue.cc:260] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.516801 22813 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.518038 22917 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:00.518705 22917 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.520874 22917 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:00.522624 23176 log.cc:927] Time spent T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:12:00.513190 22827 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.437954 22847 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:00.526525 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 70676.7us
I20260709 12:12:00.522214 17181 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 15, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 15 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:00.531685 22916 consensus_queue.cc:1059] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:12:00.541239 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:12:00.543519 17405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.543707 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:00.565388 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:00.566287 17439 raft_consensus.cc:2393] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:12:00.568714 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.570731 22916 raft_consensus.cc:3055] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:00.571656 17367 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:12:00.578326 17441 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:00.583663 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:00.584008 18006 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:00.584491 17435 raft_consensus.cc:2393] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:12:00.582407 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:00.575750 22916 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:00.604527 23101 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:00.604717 22963 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.605340 22963 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.609448 17284 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.610623 17435 raft_consensus.cc:1275] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:12:00.604559 22807 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:00.612128 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:00.612025 22807 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.597967 23053 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.614637 18013 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:12:00.611975 18009 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:00.611047 17435 pending_rounds.cc:85] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 11
I20260709 12:12:00.618325 17435 pending_rounds.cc:107] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:12:00.618588 17435 raft_consensus.cc:2889] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:00.623268 23173 log.cc:927] Time spent T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:12:00.623909 23095 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.624527 23095 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.627166 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:00.628901 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:00.630519 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:00.632519 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:00.633168 17290 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:12:00.637930 17360 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:12:00.638397 17360 pending_rounds.cc:85] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 11
I20260709 12:12:00.638651 17360 pending_rounds.cc:107] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:12:00.638877 17360 raft_consensus.cc:2889] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.606704 23096 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:00.640977 23096 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.646345 23113 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:00.647092 23113 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.647852 22847 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.648717 22807 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:00.649479 23113 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:00.656430 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:12:00.662483 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 67380.9us
I20260709 12:12:00.663313 22963 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:00.666247 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.666819 18006 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:00.668531 22827 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.672555 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:00.614537 23053 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.674310 17181 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 14, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:00.607393 23127 consensus_queue.cc:1048] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 12:12:00.676110 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:00.676343 22720 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:12:00.680150 22916 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.681357 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.684064 17367 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:00.685309 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:00.686772 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:00.687844 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:00.688407 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.688949 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:00.690762 17287 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:00.605258 23101 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.691592 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.709066 17358 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:12:00.718405 17436 raft_consensus.cc:2410] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:12:00.727434 23055 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:12:00.729127 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.730010 23160 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.730938 23160 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.731613 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.713188 23053 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.724843 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:00.737896 17286 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:12:00.737074 23161 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:12:00.749495 22939 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:00.748557 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:00.757149 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 141381us
I20260709 12:12:00.761161 17407 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:00.736984 23117 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:00.779667 23161 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:00.782512 22963 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:00.782872 23161 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.783437 23161 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.784319 23095 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.786273 22916 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:00.787308 17187 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55928 (request call id 326) took 53315 ms (client timeout 15000 ms). Trace:
I20260709 12:12:00.788972 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:00.789707 17435 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:12:00.790537 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:00.790836 17439 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 12:12:00.790911 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:00.791282 17439 pending_rounds.cc:85] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 14
I20260709 12:12:00.791551 17439 pending_rounds.cc:107] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 12:12:00.791813 17439 raft_consensus.cc:2889] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.762941 23068 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:00.805503 23068 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.807626 23068 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.774843 23107 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.810400 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:00.811101 23161 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.813373 23161 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.814524 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:00.815995 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.817404 17978 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.818351 23097 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.771261 22608 consensus_queue.cc:1048] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:12:00.819196 23097 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:00.821666 17978 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.822544 22813 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:00.803814 18012 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
W20260709 12:12:00.787719 17187 rpcz_store.cc:269] 0709 12:11:07.471688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.472002 (+   314us) service_pool.cc:224] Handling call
0709 12:12:00.787041 (+53315039us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:58.827624 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:58.883709 (+ 56085us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:58.883746 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:11:58.883764 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:58.884114 (+   350us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:58.884172 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:58.884205 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:58.884419 (+   214us) tablet.cc:701] Row locks acquired
0709 12:11:58.884448 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:11:58.884603 (+   155us) write_op.cc:270] Start()
0709 12:11:58.884709 (+   106us) write_op.cc:276] Timestamp: P: 1783599118884553 usec, L: 0
0709 12:11:58.884730 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:58.885465 (+   735us) log.cc:844] Serialized 541 byte log entry
0709 12:11:59.728894 (+843429us) op_driver.cc:464] REPLICATION: finished
0709 12:11:59.773328 (+ 44434us) write_op.cc:301] APPLY: starting
0709 12:11:59.773425 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:59.774560 (+  1135us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:59.774685 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:59.775368 (+   683us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:59.775580 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:11:59.775625 (+    45us) write_op.cc:312] APPLY: finished
0709 12:11:59.775826 (+   201us) log.cc:844] Serialized 25 byte log entry
0709 12:11:59.777668 (+  1842us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:59.777751 (+    83us) write_op.cc:454] Released schema lock
0709 12:11:59.777786 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:59.778332 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:59.778361 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":252574,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":44149,"apply.run_cpu_time_us":3333,"apply.run_wall_time_us":4980,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":446020,"prepare.run_cpu_time_us":38420,"prepare.run_wall_time_us":306883,"raft.queue_time_us":397345,"raft.run_cpu_time_us":5207,"raft.run_wall_time_us":48943,"replication_time_us":843969,"thread_start_us":1052259,"threads_started":4,"wal-append.queue_time_us":278217,"wal-append.run_cpu_time_us":21508,"wal-append.run_wall_time_us":1635419}]]}
I20260709 12:12:00.824270 17978 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.804070 23117 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:00.826233 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.827065 22720 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.810467 23034 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:00.827946 23034 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:00.825184 22813 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:00.830577 22813 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:00.830993 22813 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:00.832767 23110 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:00.834594 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:00.835345 17287 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:12:00.780256 23014 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:12:00.780103 22847 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:00.843331 17181 catalog_manager.cc:5697] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 12, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 12 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:00.844419 23034 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.849068 18006 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:00.779692 23165 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:00.851110 23165 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.851485 23165 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.827157 23117 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:00.857180 17291 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:12:00.811237 18009 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 17: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:00.866797 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.868255 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:00.859565 17437 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:12:00.942456 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:00.943157 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:00.943845 18012 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:12:00.922811 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:00.864193 22986 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:00.950577 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 154777us
I20260709 12:12:00.868974 22608 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.946640 23034 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.982856 17407 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:01.000460 22917 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.978210 23097 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:01.001037 22917 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:01.016499 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 291729us
I20260709 12:12:01.025027 17435 raft_consensus.cc:1275] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:12:01.033587 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 73521.6us
I20260709 12:12:01.038415 17181 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 13, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 13 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.040601 17181 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:01.043403 17288 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 12:12:01.044595 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 176411us
I20260709 12:12:01.013262 22939 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:01.045374 17978 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:12:01.044581 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 313003us
I20260709 12:12:01.052507 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.053431 17366 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:01.055083 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:01.055682 17358 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.060974 17258 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:01.006875 22813 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.064023 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.064679 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:01.065332 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:01.066565 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:01.067137 23160 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.035662 23097 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:01.015237 23034 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.052060 22847 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:01.082616 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:01.047037 22939 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:01.085650 17366 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:12:01.089393 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 82825.2us
I20260709 12:12:01.094164 18014 raft_consensus.cc:1240] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:01.095151 23060 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:01.095443 22847 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.090764 23160 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:12:01.100584 23117 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.094980 23108 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:01.092865 22939 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:01.101553 23097 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.111176 18006 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
W20260709 12:12:01.140393 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.145120 23160 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.044164 17181 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 14 to 17, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:01.156423 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 89927.9us
W20260709 12:12:01.159170 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 76647.6us
W20260709 12:12:01.156356 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 91157.9us
I20260709 12:12:01.092670 23127 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:12:01.175640 17181 catalog_manager.cc:5697] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 15, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 15 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.177614 18015 raft_consensus.cc:1240] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.179428 17358 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:12:01.178757 17181 catalog_manager.cc:5697] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 6 to 12, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 12 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:01.182301 23096 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:01.145455 23060 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:01.196696 23125 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.197324 23125 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.197541 22847 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:01.207631 22917 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.207906 23101 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.214512 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.218784 23060 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.220016 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.220993 17360 raft_consensus.cc:2393] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:01.232391 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.234759 17360 raft_consensus.cc:2393] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 16: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:01.230456 17255 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:01.164211 23165 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.181375 17181 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.240669 22969 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.241834 23053 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.244238 23053 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:01.254143 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 47735.2us
I20260709 12:12:01.227133 22847 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:12:01.255678 23193 raft_consensus.cc:993] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: : Instructing follower aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:12:01.301486 17436 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:01.258399 23101 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:12:01.259912 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 63897.9us
I20260709 12:12:01.239014 23192 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.268122 23034 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:01.272042 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.310501 17292 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:12:01.273094 17286 raft_consensus.cc:3055] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:01.311515 17286 raft_consensus.cc:740] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:01.284698 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:01.312232 17364 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.285495 22813 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 20 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:01.287393 22728 consensus_queue.cc:1059] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:01.228477 23117 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 12:12:01.292518 23189 log.cc:927] Time spent T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:12:01.298242 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:01.297456 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:01.346335 18014 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 11.
I20260709 12:12:01.305375 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:01.305130 23101 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.351780 23101 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.319018 17286 consensus_queue.cc:260] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.352659 17286 raft_consensus.cc:3060] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.319332 23034 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:01.322803 22728 raft_consensus.cc:3055] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:01.354961 22728 raft_consensus.cc:740] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:01.356134 22728 consensus_queue.cc:260] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.324230 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.325085 23192 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:01.359689 23192 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.330449 23117 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.360997 23117 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.363226 23117 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:01.333168 17364 raft_consensus.cc:2468] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:12:01.309703 23161 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:01.365437 23161 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.366080 17359 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:12:01.365991 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.366775 23125 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:01.368929 17333 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:01.369387 23107 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:01.369606 22969 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:01.370805 23014 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:01.316320 23055 raft_consensus.cc:1081] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Signalling peer aaafaad0810b4e95983d2d73ec814346 to start an election
I20260709 12:12:01.373809 23161 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:01.378315 17404 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:01.379745 22954 raft_consensus.cc:2804] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:01.380319 22954 raft_consensus.cc:697] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:01.381235 22954 consensus_queue.cc:237] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.382885 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:12:01.383365 17364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:48990
I20260709 12:12:01.383881 23108 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:01.384321 23108 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.384670 23108 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:01.385293 23055 consensus_queue.cc:1059] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:01.386531 23055 raft_consensus.cc:3055] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:01.386953 23055 raft_consensus.cc:740] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:01.387781 23055 consensus_queue.cc:260] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.389609 23055 raft_consensus.cc:3060] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.342904 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:01.402380 18013 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.401799 17407 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:01.392071 23110 consensus_meta.cc:287] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.006s
I20260709 12:12:01.340973 23165 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.384032 17364 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.408977 17364 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.406378 17333 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:01.394835 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.357834 22728 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:01.418704 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:01.422253 17333 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:01.426163 17292 raft_consensus.cc:1275] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:01.407424 17286 raft_consensus.cc:1275] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:12:01.434675 17181 catalog_manager.cc:5697] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 9 to 15, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 15 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.436699 17181 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:01.403546 23014 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:01.448242 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.428938 17286 pending_rounds.cc:85] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 11
I20260709 12:12:01.451854 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:01.454849 17286 pending_rounds.cc:107] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:12:01.455210 17286 raft_consensus.cc:2889] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:01.456956 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.457779 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.460588 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.460932 22969 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:12:01.461359 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.462150 17366 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:12:01.462994 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.464488 17291 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:01.460634 17283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.465677 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.466452 17284 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:01.466545 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.467394 17285 raft_consensus.cc:2393] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 15: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:01.467481 23195 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.467994 23195 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.468335 23195 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.470645 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.428025 23121 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:12:01.468415 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.481767 17362 raft_consensus.cc:3055] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:01.428617 23101 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.482309 17362 raft_consensus.cc:740] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:01.485324 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.486778 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:01.487603 17441 raft_consensus.cc:2393] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:12:01.404174 22939 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.501389 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:01.515355 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:01.490140 23101 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:01.534017 17364 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.539669 17441 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 18.
I20260709 12:12:01.496932 18007 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:01.543985 17364 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.556914 17978 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:01.558419 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 163879us
I20260709 12:12:01.549360 17362 consensus_queue.cc:260] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.561184 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:01.537358 23101 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.565879 17978 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:01.570914 17978 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:01.550196 23161 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.576344 17362 raft_consensus.cc:3060] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.582172 22885 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:01.582823 22885 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.583211 22885 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:01.584479 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:01.588020 23014 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.571692 23107 raft_consensus.cc:2764] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:01.566836 22720 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:01.593802 23205 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:01.594622 23060 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:01.596159 23034 consensus_queue.cc:1048] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:01.616700 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:01.573617 22955 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:01.629119 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:01.448071 17181 catalog_manager.cc:5697] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 16 to 17, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 17 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:01.637104 23121 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:01.650982 23121 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.651437 23121 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:01.651098 17181 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 12, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 12 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.599169 23096 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 12:12:01.656682 23113 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:01.657255 23113 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.642625 22955 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.660478 23113 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:01.643091 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44313.1us
I20260709 12:12:01.653167 17181 catalog_manager.cc:5697] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 15, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 15 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:01.675475 17290 raft_consensus.cc:2410] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 12:12:01.688654 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.691884 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
W20260709 12:12:01.689433 23206 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:12:01.705654 17404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.628332 23161 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.711668 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:01.712215 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:12:01.715757 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 86656.8us
I20260709 12:12:01.697463 22939 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.723559 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:01.736080 17291 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:12:01.741402 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.741752 23195 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.744048 23195 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:01.745131 23213 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:01.748183 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.766655 18013 raft_consensus.cc:2468] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
W20260709 12:12:01.769734 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 50996us
I20260709 12:12:01.769068 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:01.773233 17434 raft_consensus.cc:2410] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:01.739593 22939 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.775111 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:01.776031 17436 raft_consensus.cc:1217] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 14.11->[15.12-15.12]   Dedup: 15.12->[]
I20260709 12:12:01.784948 17436 raft_consensus.cc:1240] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:01.773408 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:01.784277 17435 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:12:01.785645 17438 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:12:01.769457 22955 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:01.812474 22963 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:01.813185 22963 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.816026 22963 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.822278 23113 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.823026 23113 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.825516 23113 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:01.764245 22969 consensus_queue.cc:1059] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:12:01.827474 23161 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.773696 17181 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 13, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 13 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:01.831213 22885 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.835372 23108 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.836215 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.837021 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.854525 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:01.854664 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:01.855158 17435 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.843619 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:01.856045 17436 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.802258 22939 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.857142 17362 raft_consensus.cc:1275] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:01.863456 17406 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:01.864723 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:12:01.865728 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 64975.9us
I20260709 12:12:01.849419 18006 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:12:01.827355 23112 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:01.837774 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.872632 17365 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:12:01.872922 17439 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:12:01.853766 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:01.853240 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:01.874045 18013 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.874927 17362 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:12:01.875921 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 134802us
I20260709 12:12:01.877771 17406 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:01.880859 17363 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:01.884155 17292 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:01.853123 22955 consensus_queue.cc:1048] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:12:01.860661 22728 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.870639 22938 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.861723 22917 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:01.944387 22917 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.946657 22917 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:01.893056 17432 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:12:01.947469 17432 pending_rounds.cc:85] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 11
I20260709 12:12:01.947721 17432 pending_rounds.cc:107] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:12:01.947945 17432 raft_consensus.cc:2889] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.875634 22813 consensus_queue.cc:1048] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:12:01.948027 17364 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:01.875648 23199 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.953508 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:01.954373 17432 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:12:01.897082 17434 raft_consensus.cc:1240] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.956044 17441 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:12:01.900657 23121 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:01.957410 23208 log.cc:927] Time spent T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.277s	user 0.004s	sys 0.000s
I20260709 12:12:01.886570 23112 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.915211 23108 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:01.915828 17437 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: [11.13-11.13]
I20260709 12:12:01.960191 17181 catalog_manager.cc:5697] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:01.961741 23121 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.923766 17407 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:01.962955 17407 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:01.965837 23199 raft_consensus.cc:2804] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.966629 23199 raft_consensus.cc:697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:01.967623 23199 consensus_queue.cc:237] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.924511 22608 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:12:01.966203 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 68045.2us
I20260709 12:12:01.906491 23192 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:12:01.972035 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:01.925483 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:01.927165 23107 raft_consensus.cc:3055] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:01.928817 23205 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:01.973515 23096 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.933797 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:01.974289 17291 raft_consensus.cc:3060] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:01.938442 22939 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.940191 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:01.893061 23150 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.984110 23112 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:01.961958 17181 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:01.984555 23150 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:01.986781 23150 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:01.856724 23101 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:01.987905 17360 raft_consensus.cc:1240] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.989024 23101 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:01.976943 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:01.990440 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:01.981036 17436 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:12:01.991369 23165 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.993155 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:01.997166 17435 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:12:02.008471 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:02.010123 17291 raft_consensus.cc:2468] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
W20260709 12:12:02.011821 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 61379.4us
W20260709 12:12:02.021862 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.981943 18013 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
I20260709 12:12:02.031957 18006 raft_consensus.cc:1240] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:02.033921 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.034690 17366 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 19.
I20260709 12:12:02.025077 17980 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:12:02.037747 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:12:02.041271 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 161416us
I20260709 12:12:02.045269 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:12:02.048729 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47775us
I20260709 12:12:01.974504 23107 raft_consensus.cc:740] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:02.053200 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:02.009769 22963 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:02.011096 23193 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.054795 17288 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:12:02.056651 17407 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:02.035624 23112 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:01.985844 17181 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 14 to 16, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 16 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:02.042833 23125 raft_consensus.cc:2804] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:01.973901 23205 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.065338 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:02.038904 22885 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:02.103423 17332 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:02.054171 23161 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.034001 22847 consensus_queue.cc:1059] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:02.107498 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:02.075995 17980 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
W20260709 12:12:02.109030 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 43802.5us
W20260709 12:12:02.110642 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 54080us
W20260709 12:12:02.111634 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 219726us
I20260709 12:12:02.044427 23192 consensus_queue.cc:1059] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 12:12:02.113708 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.114336 17258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.062861 23112 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:02.123096 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 47185.8us
I20260709 12:12:02.108461 23234 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:02.105522 23110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37556 (request call id 9) took 4271 ms. Trace:
I20260709 12:12:02.109617 23125 raft_consensus.cc:697] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:02.065452 23193 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.110549 22963 raft_consensus.cc:697] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:02.141296 23205 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:02.147909 22963 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.122586 23112 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.149150 17181 catalog_manager.cc:5697] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 9 to 13, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 13 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:02.150974 17181 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 11, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 11 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:02.118777 22986 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.154453 23055 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:02.155027 23055 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.157352 23055 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:02.111581 23229 consensus_queue.cc:1048] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:12:02.159590 23229 consensus_queue.cc:1243] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer 33539b233c2044afa31017244f6cc0d1 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:12:02.160492 22938 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.157701 23193 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:02.138012 23110 rpcz_store.cc:276] 0709 12:11:57.800672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.887326 (+ 86654us) service_pool.cc:224] Handling call
0709 12:11:58.165301 (+277975us) log.cc:844] Serialized 501 byte log entry
0709 12:12:02.062159 (+3896858us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"raft.queue_time_us":145970,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":525,"thread_start_us":516984,"threads_started":2,"wal-append.queue_time_us":569844,"wal-append.run_cpu_time_us":1805,"wal-append.run_wall_time_us":1001826}
I20260709 12:12:02.142597 23117 raft_consensus.cc:3055] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:02.135325 22885 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.166111 23117 raft_consensus.cc:740] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:02.167174 23117 consensus_queue.cc:260] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.168434 17360 raft_consensus.cc:1240] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:02.128171 23161 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.169783 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.126374 23107 consensus_queue.cc:260] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.139789 23125 consensus_queue.cc:237] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.138366 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.139585 22569 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:02.171933 23161 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:02.173856 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 43623.9us
I20260709 12:12:02.171329 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.193132 17358 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:12:02.176433 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:02.190537 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.196864 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:02.197602 17438 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:12:02.198678 17436 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:12:02.199107 17436 pending_rounds.cc:85] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Aborting all ops after (but not including) 8
I20260709 12:12:02.199321 17436 pending_rounds.cc:107] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:12:02.199550 17436 raft_consensus.cc:2889] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:02.168457 23117 raft_consensus.cc:3060] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.203179 23234 raft_consensus.cc:697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:02.207218 23234 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.153131 17181 catalog_manager.cc:5697] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:02.209861 17181 catalog_manager.cc:5697] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 9 to 12, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 12 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.211779 17181 catalog_manager.cc:5697] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 6, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 6 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:02.191656 22569 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:02.223146 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 112311us
I20260709 12:12:02.193727 23055 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:02.214607 23107 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.213462 17181 catalog_manager.cc:5697] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 13, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 13 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:02.224331 22569 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.290887 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:12:02.290910 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 74158.6us
W20260709 12:12:02.289101 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 55963us
I20260709 12:12:02.204432 23161 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:12:02.319998 17333 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:12:02.338131 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47318us
I20260709 12:12:02.343159 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.343462 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.344408 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:02.345106 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:02.299273 22885 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:02.342895 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 211799us
I20260709 12:12:02.346692 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.349334 17287 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:12:02.347128 17292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:02.350685 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:02.351046 17292 raft_consensus.cc:3060] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.351269 17285 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.228711 22827 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 12:12:02.352511 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.354864 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:02.355589 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:02.356521 17283 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:02.357007 17366 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:02.357968 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:02.363790 17284 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 18: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:02.337381 23244 raft_consensus.cc:3055] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:02.359351 17407 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:02.346737 22954 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:02.363395 17287 pending_rounds.cc:85] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 6
I20260709 12:12:02.367746 17287 pending_rounds.cc:107] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:12:02.368202 17287 raft_consensus.cc:2889] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:02.368626 23242 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:12:02.368880 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f950276bbbb4642872e9280fad2a766 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:02.370414 22954 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.371095 22954 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:02.371582 17181 catalog_manager.cc:5697] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 14, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.300577 23055 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.361717 23205 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:12:02.382352 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:02.320225 22969 consensus_queue.cc:1059] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:12:02.395279 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.350266 23161 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:12:02.404358 17286 raft_consensus.cc:2468] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
I20260709 12:12:02.386485 17407 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:02.367813 23244 raft_consensus.cc:740] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:02.413883 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:02.419369 23257 raft_consensus.cc:3055] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:02.413877 22938 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.353384 22885 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.352632 23245 consensus_queue.cc:1059] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:12:02.412415 23014 raft_consensus.cc:2804] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:02.401757 23165 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:02.429484 17285 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:12:02.433898 17332 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:02.434494 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:02.439126 17435 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 13.
I20260709 12:12:02.434917 17438 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:02.413172 23055 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:02.449753 17292 raft_consensus.cc:2468] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:12:02.442484 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:02.433898 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:02.428700 23257 raft_consensus.cc:740] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:02.443763 23244 consensus_queue.cc:260] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:02.446448 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 375767us
I20260709 12:12:02.447367 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.414022 22954 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.457697 17436 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:02.456182 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:02.407776 23112 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.443423 23014 raft_consensus.cc:697] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:02.459756 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:02.468456 17406 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:02.456120 23110 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:02.459185 23245 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.459687 22916 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.373443 17181 catalog_manager.cc:5697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 5 to 11, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 11 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:02.482386 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:02.486223 23235 log.cc:927] Time spent T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.338s	user 0.004s	sys 0.000s
I20260709 12:12:02.487897 23250 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:02.476714 23199 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.489660 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:02.491451 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 171534us
I20260709 12:12:02.482827 22916 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.495420 23097 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:02.495729 23161 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:02.496244 23161 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:02.496630 23161 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.497051 22916 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:02.481117 23055 raft_consensus.cc:2764] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:02.501765 17433 raft_consensus.cc:1240] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:02.505831 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:02.498550 23244 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.508813 23245 consensus_queue.cc:1059] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:02.509747 23245 raft_consensus.cc:3055] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:02.509039 17181 catalog_manager.cc:5697] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 11, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 11 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:02.512416 22954 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 20 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:02.507552 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:02.514191 17363 raft_consensus.cc:2393] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 18: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:02.514623 22847 raft_consensus.cc:3055] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:02.515074 22847 raft_consensus.cc:740] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:02.515341 23112 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:02.516077 22847 consensus_queue.cc:260] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.517616 22847 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.516353 23014 consensus_queue.cc:237] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.527287 23055 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:02.510206 23245 raft_consensus.cc:740] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:02.503235 22986 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:02.531585 22569 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.540371 22885 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:02.543120 23097 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:02.545243 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:02.602208 18015 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 12.
I20260709 12:12:02.546507 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:12:02.552516 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 45363.8us
I20260709 12:12:02.554035 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:02.554375 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:02.554546 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.554937 23161 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.559186 17366 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:02.560483 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.561736 17333 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:02.566709 17438 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:02.537274 23257 consensus_queue.cc:260] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:02.577987 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.588594 23239 log.cc:927] Time spent T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.423s	user 0.009s	sys 0.000s
I20260709 12:12:02.603646 17358 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.603613 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:02.647306 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 43761.3us
I20260709 12:12:02.648202 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:02.511027 17181 catalog_manager.cc:5697] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:02.623440 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.612994 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 51341.6us
I20260709 12:12:02.663806 17258 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:02.667258 23251 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:02.584355 23055 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.670131 23055 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:02.673846 23161 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:02.662662 23250 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.675657 23250 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:02.676046 23250 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:02.676467 23250 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.678150 23055 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.678665 23257 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.679430 22986 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:02.659011 23258 raft_consensus.cc:2804] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:02.682772 23258 raft_consensus.cc:697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 17 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:02.683723 23258 consensus_queue.cc:237] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.685011 22569 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:02.686277 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:02.680073 17358 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:12:02.686883 17287 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.675823 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:02.697377 17404 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:02.688985 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:02.699021 17365 raft_consensus.cc:2368] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17.
I20260709 12:12:02.700533 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:02.701872 22963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.016s	sys 0.024s
W20260709 12:12:02.702407 22963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.016s	sys 0.024s
I20260709 12:12:02.712386 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:02.713117 17255 leader_election.cc:400] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17.
I20260709 12:12:02.713402 17255 leader_election.cc:403] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:02.715350 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.716778 23232 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:12:02.718755 23192 raft_consensus.cc:3060] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.647727 23097 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.710695 22885 raft_consensus.cc:2804] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:02.722803 22885 raft_consensus.cc:697] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:02.723794 22885 consensus_queue.cc:237] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.678198 23117 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.728531 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:02.709224 23121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.024s	sys 0.010s
I20260709 12:12:02.716027 17285 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 12.
I20260709 12:12:02.732010 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.732864 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.721838 23097 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:02.746809 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.747686 17288 raft_consensus.cc:2410] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:02.753810 17287 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:12:02.754814 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.708850 23251 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.755606 17284 raft_consensus.cc:1813] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Handling vote request from an unknown peer e860f7e876b74ec589f447737822a4f6
I20260709 12:12:02.755775 17980 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:12:02.756994 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.710283 23193 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.758515 17284 raft_consensus.cc:2410] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:12:02.759135 17289 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:12:02.760329 23097 raft_consensus.cc:2804] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:02.678198 23245 consensus_queue.cc:260] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.773329 17365 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:12:02.747287 23121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.024s	sys 0.010s
I20260709 12:12:02.678694 23055 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.794751 23193 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.794431 23097 raft_consensus.cc:697] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:02.821012 17437 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:12:02.821424 17287 raft_consensus.cc:1275] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:12:02.827746 17287 pending_rounds.cc:85] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 9
I20260709 12:12:02.827998 17287 pending_rounds.cc:107] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:12:02.828238 17287 raft_consensus.cc:2889] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:02.828696 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:02.822398 23192 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for earlier term 16. Current term is 17.
I20260709 12:12:02.768569 23250 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.831482 17434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:02.831913 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:02.823864 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:02.836050 23161 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:02.836414 23251 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:02.836689 23161 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.837422 23251 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.839637 23251 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:02.839648 23161 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:02.840786 23161 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:02.824972 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:02.825987 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:02.842921 17332 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:02.842445 23225 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:02.844164 17332 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:02.846285 23195 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.846338 23161 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.847138 23195 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.824538 17286 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:02.843938 23225 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:02.795533 23108 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:02.857338 17291 raft_consensus.cc:2468] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:12:02.853993 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:02.854359 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:02.884403 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.849800 18013 raft_consensus.cc:1240] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Rejecting Update request from peer 33539b233c2044afa31017244f6cc0d1 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:12:02.873461 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.894698 17406 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:02.827301 23245 raft_consensus.cc:3060] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.854302 22807 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.912637 23225 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:02.919152 17433 raft_consensus.cc:3060] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.922919 17290 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:02.846031 17332 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:02.904613 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:02.926834 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:02.928066 17406 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:02.928490 23240 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:02.928956 23240 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:02.929312 23240 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.930286 22939 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.930466 22938 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.934161 23195 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:02.935195 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 89222.8us
I20260709 12:12:02.937304 17332 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:02.938194 23195 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:02.938721 23195 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:02.939670 23195 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:02.940385 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.941713 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:02.925576 18015 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:12:02.954447 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:02.955183 17437 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 20.
I20260709 12:12:02.828154 23193 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:02.990693 17257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.013399 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: e860f7e876b74ec589f447737822a4f6
W20260709 12:12:03.015949 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.018034 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:03.027616 18006 raft_consensus.cc:1240] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:03.042799 23276 log.cc:927] Time spent T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:12:03.045760 18006 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.048859 17433 raft_consensus.cc:2468] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:12:03.052507 18015 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:03.055788 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:03.062194 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.064029 17287 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:03.024472 22827 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:03.064585 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.057667 17286 raft_consensus.cc:2955] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:03.068109 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:03.072196 18007 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 20: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:03.055365 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:03.078004 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:03.091022 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:03.067603 23283 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:02.965431 23097 consensus_queue.cc:237] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.096889 23283 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.068198 23244 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.079908 23117 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.104681 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:03.106747 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:03.090548 23225 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:03.109185 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:03.109582 18013 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:03.118618 18006 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:03.104262 23283 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.098575 22963 consensus_queue.cc:1048] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 12:12:03.124032 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 61020us
I20260709 12:12:03.103706 23281 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.131786 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:03.094424 23165 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:12:03.082489 22827 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.108387 23225 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:03.138806 17332 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.124038 22916 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.130520 23055 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:03.143738 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.149601 23108 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:03.153098 23140 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:03.138381 23161 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:03.170475 17981 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.140908 23225 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:03.175565 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:03.178521 17407 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:03.144785 23096 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.183001 17407 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:03.195122 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 94206.2us
I20260709 12:12:03.157392 23262 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:12:03.187757 22728 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.186494 23205 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.155844 23240 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:03.184171 23288 consensus_queue.cc:1059] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:12:03.187647 23193 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:03.194607 22939 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:03.203526 23097 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:03.203883 23165 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:12:03.139753 23281 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:03.216275 22969 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:03.230024 22827 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:03.215363 23014 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:12:03.215306 23096 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:12:03.231979 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.153743 23140 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.234867 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:03.245183 23281 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:03.250202 17285 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 12:12:03.250655 17285 pending_rounds.cc:85] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Aborting all ops after (but not including) 13
I20260709 12:12:03.250859 17285 pending_rounds.cc:107] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 12:12:03.251068 17285 raft_consensus.cc:2889] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:03.265183 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.268633 18007 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:03.272759 22569 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.281719 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:03.285048 17291 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:03.290542 18015 raft_consensus.cc:1275] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:03.292510 17290 raft_consensus.cc:1275] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:03.293740 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:03.294507 18007 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:12:03.297613 17291 raft_consensus.cc:1275] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:03.297899 17258 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:03.319433 17440 raft_consensus.cc:1240] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:03.329214 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:03.330847 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:03.291404 23293 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:12:03.338289 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:03.339742 17440 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:12:03.341171 17436 raft_consensus.cc:1275] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:03.333797 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598; no voters: 
I20260709 12:12:03.344969 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:03.226966 23097 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.315742 23055 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.297437 23108 consensus_queue.cc:1059] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:12:03.367892 23299 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:03.368989 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:03.326861 23225 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.346235 23251 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:03.373639 17258 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:03.393697 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:03.399567 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:03.403092 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 66904.4us
I20260709 12:12:03.344051 22813 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.411042 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.343307 23282 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.351147 23161 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:03.425160 17291 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:12:03.395087 23292 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:12:03.430585 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.429883 17255 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.338514 23234 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:12:03.431269 17358 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:12:03.405332 23244 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.413970 23240 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:03.423920 23161 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.449229 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.452345 23250 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:03.454452 17255 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.433495 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.408223 22916 consensus_queue.cc:1048] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:12:03.453560 23161 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.413060 23232 consensus_queue.cc:1059] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:12:03.424093 22813 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.472512 22813 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:03.438882 23244 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.474593 23244 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.440318 23140 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:03.485893 23225 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:03.459187 22847 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.417543 23251 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.491516 23251 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:03.493108 23195 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:03.493368 23223 consensus_queue.cc:1048] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:03.469987 23232 raft_consensus.cc:3055] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:03.494580 23232 raft_consensus.cc:740] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:03.495512 23232 consensus_queue.cc:260] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:03.498829 23284 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.502125 23125 raft_consensus.cc:3055] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:03.498948 17255 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.507413 23125 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:03.508142 17283 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:03.532038 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.538277 23283 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.543131 17292 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:12:03.543897 23097 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:03.567724 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:03.542317 23283 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:03.585698 23195 consensus_queue.cc:1048] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:12:03.615139 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:03.562671 23245 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.617847 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:03.623713 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:03.624675 18006 raft_consensus.cc:2393] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 20: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:03.658164 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.667670 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.668392 17367 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 20.
I20260709 12:12:03.526355 23125 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.678783 23125 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.680639 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.683462 17978 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:03.665637 23283 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:03.698357 23246 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:12:03.694514 23205 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:03.700497 23205 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.700897 23205 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:03.700034 23300 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.705444 23300 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:03.691378 23249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.043s	sys 0.094s
W20260709 12:12:03.710512 23249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.043s	sys 0.094s
I20260709 12:12:03.711470 23249 raft_consensus.cc:3055] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:03.711918 23249 raft_consensus.cc:740] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:03.707690 23300 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:03.718218 23077 consensus_queue.cc:1059] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:12:03.657964 23195 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:12:03.725626 17291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:03.739665 17291 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
W20260709 12:12:03.682587 23288 consensus_queue.cc:1175] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaafaad0810b4e95983d2d73ec814346" responder_term: 13 status { last_received { term: 13 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 13 index: 9 } }
I20260709 12:12:03.774329 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:12:03.722865 23306 log.cc:927] Time spent T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:12:03.777606 23283 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.780349 23283 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.780907 23161 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.782549 23283 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:03.785230 17365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.785751 17286 raft_consensus.cc:1240] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:12:03.817008 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:03.776705 23245 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:03.833153 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 497186us
I20260709 12:12:03.836966 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:03.795764 22916 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.838465 17440 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 20.
W20260709 12:12:03.839130 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 254348us
I20260709 12:12:03.820138 23205 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.843449 17365 raft_consensus.cc:1275] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:03.844255 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:03.843418 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.838757 22916 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.816147 23161 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:03.854035 17291 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:03.856793 17981 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.861665 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:03.862191 17290 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:03.861673 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:03.865455 17437 raft_consensus.cc:1240] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:12:03.861598 22813 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.855687 22916 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:03.873508 23312 log.cc:927] Time spent T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:12:03.846755 22720 consensus_queue.cc:1048] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 12:12:03.877748 17177 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1c41ebef06654a43a98e69d0c065bba4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e860f7e876b74ec589f447737822a4f6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:03.891599 17331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.814379 23244 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:03.904917 23205 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 21 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:03.909571 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.840378 23245 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:03.912742 17981 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:03.912789 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:03.913628 17436 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:03.920408 23311 log.cc:927] Time spent T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:12:03.920554 17288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:03.921581 17288 raft_consensus.cc:606] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:03.921945 17288 raft_consensus.cc:614] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:03.926903 17439 raft_consensus.cc:1275] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:03.928310 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:03.937762 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:03.938520 17360 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:12:03.938412 23249 consensus_queue.cc:260] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.939741 23249 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:03.939972 17255 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:03.941176 23193 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:03.941553 23193 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.941881 23193 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.944010 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:03.944666 17360 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.955046 23315 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:03.948570 22938 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:03.956975 17436 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 21.
I20260709 12:12:03.961380 17360 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:12:03.962930 17255 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:03.956502 22938 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } attrs { replace: true } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.968197 23055 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:03.968726 23055 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:03.970598 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:03.972289 17290 raft_consensus.cc:1240] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:12:03.974516 17981 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:03.984694 23125 raft_consensus.cc:2804] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:03.985388 23125 raft_consensus.cc:697] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:03.985528 23315 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.986301 23315 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.986615 23125 consensus_queue.cc:237] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.989507 23315 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:03.990783 23315 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.991299 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:03.991582 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:03.992131 18006 raft_consensus.cc:2468] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 11.
I20260709 12:12:03.992964 23315 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:03.993451 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:03.995136 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:03.996594 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:03.998904 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:04.002472 17290 raft_consensus.cc:2410] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:03.999351 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:04.000099 18015 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:12:04.005012 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:04.005970 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:03.948230 23244 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:03.979951 23307 log.cc:927] Time spent T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:12:04.052932 17290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:04.053623 17290 raft_consensus.cc:606] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:12:04.053977 17290 raft_consensus.cc:614] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:04.054296 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 51011.1us
I20260709 12:12:04.054739 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:04.051956 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 49038.8us
I20260709 12:12:03.997746 23193 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:04.060515 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:04.061185 17364 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.073935 23193 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:04.076869 17364 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:12:04.007326 23282 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:04.082666 17255 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:03.979434 23299 consensus_queue.cc:1048] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:12:04.050668 22847 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:04.002375 23097 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:12:04.054533 23245 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:04.055527 23315 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:04.102069 17981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.110734 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 51101.6us
I20260709 12:12:04.089511 23161 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.112208 18015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:59534
I20260709 12:12:04.115159 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:04.116521 18015 raft_consensus.cc:606] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:12:04.126801 23161 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:04.139043 17290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:04.101495 23055 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:04.139716 17290 raft_consensus.cc:606] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:04.140064 17290 raft_consensus.cc:614] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:04.131841 23281 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:04.150871 23150 raft_consensus.cc:993] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: : Instructing follower e860f7e876b74ec589f447737822a4f6 to start an election
I20260709 12:12:04.151485 23150 raft_consensus.cc:1081] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Signalling peer e860f7e876b74ec589f447737822a4f6 to start an election
I20260709 12:12:04.153105 23247 raft_consensus.cc:3055] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:04.153533 23247 raft_consensus.cc:740] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:04.154367 23247 consensus_queue.cc:260] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.155369 23247 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.157153 22916 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:04.142419 17288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:04.145610 23161 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:04.159371 17980 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:04.162359 17439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc"
dest_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:52714
I20260709 12:12:04.162951 17439 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.163319 17439 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:04.135800 22938 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:04.166720 22608 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:04.171720 23244 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.172299 23244 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.173365 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:04.134735 23205 consensus_queue.cc:1048] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:12:04.175143 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:04.175355 23244 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:04.175778 17360 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 17.
I20260709 12:12:04.176033 17285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "aaafaad0810b4e95983d2d73ec814346"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:04.176615 17285 raft_consensus.cc:606] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Received request to transfer leadership to TS aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:04.176932 17285 raft_consensus.cc:614] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:04.177819 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:04.180229 17285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427"
dest_uuid: "33539b233c2044afa31017244f6cc0d1"
mode: GRACEFUL
new_leader_uuid: "e860f7e876b74ec589f447737822a4f6"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:12:04.180680 17407 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:04.180842 17285 raft_consensus.cc:606] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Received request to transfer leadership to TS e860f7e876b74ec589f447737822a4f6
I20260709 12:12:04.181074 22847 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:04.181357 17285 raft_consensus.cc:614] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:04.182479 22847 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.182816 22885 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.184244 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:04.185050 22916 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:04.186357 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:04.187315 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.182941 22847 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.193872 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:04.194569 17290 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.194412 17439 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.202163 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:04.225893 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:04.225608 17439 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:04.226714 18015 raft_consensus.cc:3055] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:04.227124 18015 raft_consensus.cc:740] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:04.228395 17285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:04.230336 17285 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:04.247879 17285 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:12:04.231015 23257 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.254969 23257 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.259757 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:04.237798 23320 log.cc:927] Time spent T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:12:04.262584 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:12:04.253921 17333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.268730 17432 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:04.270923 23257 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:04.282410 18015 consensus_queue.cc:260] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.285262 17406 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:04.286413 23199 raft_consensus.cc:2804] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:04.286952 23199 raft_consensus.cc:697] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:04.287846 23199 consensus_queue.cc:237] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.298561 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:04.299187 17437 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.302698 17333 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:04.313555 23316 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:04.326793 17290 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:12:04.327684 17286 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Rejecting Update request from peer aaafaad0810b4e95983d2d73ec814346 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:04.329267 17406 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:04.342180 23232 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.330693 23316 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:12:04.343947 23316 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:04.344324 23316 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:04.345142 23316 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:04.339845 23246 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:04.346573 23246 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:04.347543 23246 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:04.308825 23121 consensus_queue.cc:1059] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:12:04.350147 23121 raft_consensus.cc:3055] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:04.350526 23121 raft_consensus.cc:740] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:04.351374 23121 consensus_queue.cc:260] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.352635 23121 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:04.353763 23107 consensus_queue.cc:1175] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "868a5e341d0a41b4ac0927342c8cd598" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 8 last_received_current_leader { term: 11 index: 10 } }
I20260709 12:12:04.356935 23316 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.359824 18015 raft_consensus.cc:3060] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:04.366436 17437 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 16.
I20260709 12:12:04.376324 18015 raft_consensus.cc:2468] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 10.
I20260709 12:12:04.379549 22847 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.382303 22847 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:04.385218 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:04.385984 17361 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.387980 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:04.388622 17359 raft_consensus.cc:3060] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:04.393348 23247 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:04.394035 23247 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:04.396289 23247 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:04.406566 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:04.407311 18013 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 17.
I20260709 12:12:04.414494 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:04.426209 17359 raft_consensus.cc:2468] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 21.
I20260709 12:12:04.444440 17361 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 18.
I20260709 12:12:04.448459 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:04.449172 18015 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.447065 17255 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346; no voters: 
W20260709 12:12:04.455047 17980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.453450 23251 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:04.486181 18015 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 18.
I20260709 12:12:04.490018 17358 raft_consensus.cc:2468] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 13.
I20260709 12:12:04.488296 23251 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 18 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:04.500109 23251 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.595849 17364 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:04.612004 23246 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:04.611024 23193 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:12:04.633939 23282 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:04.642027 23282 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:04.637005 22827 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.648821 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:04.640815 23246 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.669741 22827 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.678293 23282 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:04.708601 23246 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:04.709072 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
W20260709 12:12:04.716238 23342 log.cc:927] Time spent T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260709 12:12:04.717401 17290 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:12:04.717952 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:04.721098 22827 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:04.723824 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:04.732079 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:04.733037 17359 raft_consensus.cc:2368] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 14. Current term is 15.
W20260709 12:12:04.734951 23340 log.cc:927] Time spent T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:04.736394 17437 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.740253 17406 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:04.742460 17438 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:04.744448 17439 raft_consensus.cc:2393] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 13: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:12:04.748266 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:04.750262 17437 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:04.759207 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:04.766268 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:04.750010 23246 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:04.753417 22847 raft_consensus.cc:3060] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.778373 17439 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:04.760725 23205 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:12:04.782825 23313 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.783473 23313 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.787075 17437 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:12:04.790273 23282 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:04.755066 23244 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 12:12:04.775208 23344 log.cc:927] Time spent T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:12:04.773387 23253 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:04.814778 22969 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:04.817763 22969 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:04.827235 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:04.828107 17366 raft_consensus.cc:2393] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 18: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:04.829119 17359 raft_consensus.cc:1275] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 21 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:04.830732 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:04.831393 17363 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:12:04.834707 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:04.835441 18013 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:12:04.847146 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:04.847864 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:04.848337 17290 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:04.851584 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:04.853639 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:04.854539 18014 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:04.858423 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:04.861743 23205 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:04.862213 23205 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.862560 23205 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.830782 22969 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:04.871443 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:04.855263 23331 consensus_queue.cc:1048] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:12:04.857865 23309 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:04.854187 23107 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:04.876977 23107 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.877360 23107 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.880934 17404 leader_election.cc:400] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 14. Current term is 15.
I20260709 12:12:04.881316 17404 leader_election.cc:403] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:04.907127 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:04.886472 23330 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.016s	sys 0.030s
W20260709 12:12:04.915177 23345 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:12:04.920816 17358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48992 (request call id 3359) took 1353 ms. Trace:
I20260709 12:12:04.921258 17358 rpcz_store.cc:276] 0709 12:12:03.567292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.567426 (+   134us) service_pool.cc:224] Handling call
0709 12:12:04.920612 (+1353186us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b540032ebd4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1f2fa 00007f122aae0b17 00007f122405b6d4 00007f122405b662 00007f122405b591 00007f122405b50c 00007f122405a7c2 00007f1223e5648c 00007f1223e558c6 00007f1223e5526f
0709 12:12:04.920728 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032552832}
I20260709 12:12:04.922437 17363 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:12:04.922842 17363 pending_rounds.cc:85] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Aborting all ops after (but not including) 9
I20260709 12:12:04.923079 17363 pending_rounds.cc:107] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:12:04.923319 17363 raft_consensus.cc:2889] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.889464 23096 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.930970 17283 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:04.892066 23328 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) with higher term. Message: Invalid argument: T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 14. Current term is 15.
I20260709 12:12:04.962505 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:04.965673 18015 raft_consensus.cc:1275] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:12:04.927886 22807 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:04.990394 22807 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:04.925981 23330 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.016s	sys 0.030s
I20260709 12:12:04.974426 23165 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:04.993494 22807 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:04.978392 23316 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:04.981002 22847 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:04.997411 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:05.008689 18013 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:05.013877 17287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:05.014894 17287 raft_consensus.cc:2393] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 14: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:04.994621 23316 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.020776 23316 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:05.024011 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:05.025533 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:05.026221 17433 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:12:05.008138 23165 consensus_queue.cc:1048] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:12:05.031625 23205 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.054006 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:05.063093 17406 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:05.065739 22955 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.071528 17404 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:05.072767 22807 raft_consensus.cc:2804] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:05.073573 22728 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:05.078143 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:05.082490 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:05.087553 23232 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.076079 22807 raft_consensus.cc:697] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:05.089165 22807 consensus_queue.cc:237] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:05.090061 17364 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:05.090456 23232 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:05.091015 23232 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:05.083957 23107 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.093431 17361 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:05.094518 23107 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:05.094729 17286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:05.093324 23232 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:05.102188 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:05.103040 18007 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 13: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:05.103345 23161 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:05.099701 23205 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:05.079604 23096 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.110514 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:05.111634 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:05.113638 17366 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:12:05.124612 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:05.125200 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:05.133204 22955 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.135432 23247 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.138571 17333 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:05.144897 23313 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:05.151204 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:05.152007 18006 raft_consensus.cc:2393] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:05.139504 23247 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.188239 23247 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:05.142529 23229 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.192052 17360 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:05.202301 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:05.207515 23193 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:05.211524 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:05.206249 23140 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.217728 23140 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.219955 23140 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:05.220885 18006 raft_consensus.cc:2410] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:05.224112 23205 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:05.224942 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:05.224721 23205 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.225585 17436 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 20.
I20260709 12:12:05.227056 23205 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:05.239730 17404 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:05.244989 22955 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.261615 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:05.264201 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:05.268350 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:05.271613 17366 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:12:05.272850 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:05.273695 17290 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:05.266485 22608 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.273578 23150 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:05.282953 23150 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.285187 23150 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:05.290907 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:05.301119 23309 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:05.301594 23309 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:05.301968 23309 raft_consensus.cc:3060] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:05.307523 22955 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.317466 23309 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.320990 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:05.321615 17332 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:05.333143 18006 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:05.333520 17284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1" is_pre_election: true
I20260709 12:12:05.336745 17284 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:05.344858 17364 raft_consensus.cc:2468] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
I20260709 12:12:05.346642 17978 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:05.326252 23107 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.326076 23309 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:05.351260 17289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:05.352015 17289 raft_consensus.cc:2393] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 12: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
W20260709 12:12:05.349213 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 74594.9us
I20260709 12:12:05.353720 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:05.359608 17407 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:05.363559 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:05.364324 17437 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:12:05.360569 23287 raft_consensus.cc:2804] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:05.365815 23347 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:05.370519 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:05.360855 23150 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:05.375742 23150 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.376209 23150 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:05.355463 22847 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:12:05.382431 23287 raft_consensus.cc:697] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:05.383494 23287 consensus_queue.cc:237] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.407486 23288 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.407971 23288 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:05.408342 23288 raft_consensus.cc:3060] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.427908 23288 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:05.429255 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 58828.5us
I20260709 12:12:05.440009 23150 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.455186 23150 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 21 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:05.462322 17363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37556
I20260709 12:12:05.462460 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:05.463073 17363 raft_consensus.cc:606] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Received request to transfer leadership
I20260709 12:12:05.463183 17437 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:05.465305 23288 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:05.465911 17290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "33539b233c2044afa31017244f6cc0d1"
I20260709 12:12:05.466719 17290 raft_consensus.cc:2393] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 13: Already voted for candidate 33539b233c2044afa31017244f6cc0d1 in this term.
I20260709 12:12:05.473834 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:05.475100 17437 raft_consensus.cc:2468] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 21.
I20260709 12:12:05.479645 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:05.484498 17981 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:05.485993 23150 raft_consensus.cc:2804] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:05.486560 23150 raft_consensus.cc:697] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:05.487427 23150 consensus_queue.cc:237] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.480255 17366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37556
I20260709 12:12:05.490764 17366 raft_consensus.cc:606] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Received request to transfer leadership
W20260709 12:12:05.492588 17174 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for ee22d4e5e05e423097297625d6158f21 already in progress [suppressed 7 similar messages]
I20260709 12:12:05.519858 17436 raft_consensus.cc:2468] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:12:05.520524 17366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37556
I20260709 12:12:05.521690 17981 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:05.521898 17366 raft_consensus.cc:606] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Received request to transfer leadership
I20260709 12:12:05.524148 23287 raft_consensus.cc:2804] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:05.534829 23287 raft_consensus.cc:697] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:05.535727 23287 consensus_queue.cc:237] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.554563 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:05.568876 17184 catalog_manager.cc:5697] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:05.623857 17184 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 8 to 9, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 9 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:05.626271 17284 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:12:05.628516 17238 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:12:05.628927 17238 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for ee22d4e5e05e423097297625d6158f21 already in progress
W20260709 12:12:05.629208 17238 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for ee22d4e5e05e423097297625d6158f21 already in progress
I20260709 12:12:05.629860 23112 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:05.625440 17184 catalog_manager.cc:5697] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 5 to 10, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 10 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:05.635732 17184 catalog_manager.cc:5697] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 8 to 11, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 11 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 12:12:05.643051 16125 tablet_server.cc:179] TabletServer@127.15.191.65:0 shutting down...
I20260709 12:12:05.642357 17184 catalog_manager.cc:5697] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 9 to 13, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 13 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
W20260709 12:12:05.650836 17174 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 8f950276bbbb4642872e9280fad2a766 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 10 but the committed config has opid_index of 11
I20260709 12:12:05.653908 17366 raft_consensus.cc:1275] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:05.656805 23112 consensus_queue.cc:1048] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:05.659094 17184 catalog_manager.cc:5697] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:05.666543 17184 catalog_manager.cc:5697] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.669291 23251 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.670888 23251 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.673171 23251 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:05.669986 17184 catalog_manager.cc:5697] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 7 to 8, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 8 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:05.674919 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:05.676322 17363 raft_consensus.cc:2410] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:12:05.709376 23369 log.cc:927] Time spent T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:05.709928 17181 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55932 (request call id 331) took 8208 ms. Trace:
W20260709 12:12:05.716048 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 68444.7us
I20260709 12:12:05.719941 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:12:05.728211 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.728782 23096 raft_consensus.cc:993] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: : Instructing follower 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:12:05.729307 23096 raft_consensus.cc:1081] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Signalling peer 868a5e341d0a41b4ac0927342c8cd598 to start an election
I20260709 12:12:05.731910 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:05.732935 18014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21"
dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
 from {username='slave'} at 127.0.0.1:52238
W20260709 12:12:05.733302 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.733543 18014 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.733923 18014 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.735595 23251 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.744949 23282 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.746284 23282 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.749109 23282 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:05.749634 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:05.750401 17436 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:12:05.749552 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:05.754290 17366 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
I20260709 12:12:05.755555 17255 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:05.752714 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:05.756844 18006 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 14.
W20260709 12:12:05.753465 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.758498 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.761945 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.763566 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.714604 17181 rpcz_store.cc:276] 0709 12:11:57.500962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.501225 (+   263us) service_pool.cc:224] Handling call
0709 12:12:05.707152 (+8205927us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:03.129460 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:03.243186 (+113726us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:03.243236 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:12:03.243253 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:03.464125 (+220872us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:03.464222 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:03.464252 (+    30us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:12:03.506043 (+ 41791us) tablet.cc:701] Row locks acquired
0709 12:12:03.506086 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:12:03.506299 (+   213us) write_op.cc:270] Start()
0709 12:12:03.506462 (+   163us) write_op.cc:276] Timestamp: P: 1783599123506229 usec, L: 0
0709 12:12:03.506492 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:12:03.590882 (+ 84390us) log.cc:844] Serialized 11132 byte log entry
0709 12:12:03.609410 (+ 18528us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f1222a110ac 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f12256b520b
0709 12:12:04.234893 (+625483us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54000762d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b16e28 00007f1229551581 00007f1229550d58 00007f12295559f1 00007f12295559a9 00007f1229555939 00007f1229555901 00007f1229554b2d 0000000000388634 0000000000388479
0709 12:12:04.264199 (+ 29306us) op_driver.cc:464] REPLICATION: finished
0709 12:12:04.838772 (+574573us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b4400022b4c. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f1222954c85 00007f12229556a2 00007f12256c71db 00007f12256c2aaf 00007f1222a110ac 00007f122b86b9a9 00007f1222a2d69b 00007f1222a2b93f 00007f1222a2dc02 00007f1229551ef0
0709 12:12:04.973011 (+134239us) write_op.cc:301] APPLY: starting
0709 12:12:04.973120 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:05.131988 (+158868us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:05.132036 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:05.186490 (+ 54454us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b54000762d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1832a 00007f1225a9df14 00007f1225a9dec3 00007f1225a9de38 00007f1225a9ddf3 00007f1225a9d0dc 00007f1225ac6e16 00007f1225aaecbb 00007f1225a9939d 00007f1225a9cd75
0709 12:12:05.278007 (+ 91517us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:05.314949 (+ 36942us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=0,mrs_lookups=0
0709 12:12:05.315030 (+    81us) write_op.cc:312] APPLY: finished
0709 12:12:05.315671 (+   641us) log.cc:844] Serialized 244 byte log entry
0709 12:12:05.378877 (+ 63206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:05.417641 (+ 38764us) write_op.cc:454] Released schema lock
0709 12:12:05.417737 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:05.433516 (+ 15779us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:05.433548 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":273477,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":696451,"apply.run_cpu_time_us":63804,"apply.run_wall_time_us":459933,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121111,"num_ops":28,"prepare.queue_time_us":217310,"prepare.run_cpu_time_us":77693,"prepare.run_wall_time_us":1133151,"raft.queue_time_us":142539,"raft.run_cpu_time_us":50873,"raft.run_wall_time_us":994937,"replication_time_us":697710,"spinlock_wait_cycles":79598976,"thread_start_us":968706,"threads_started":5,"wal-append.queue_time_us":252903,"wal-append.run_cpu_time_us":13481,"wal-append.run_wall_time_us":1413447}]]}
W20260709 12:12:05.766378 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.763751 23251 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.769138 23251 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.773775 23251 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:05.822461 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.831605 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.831173 18014 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:05.836253 17332 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.850857 17406 consensus_peers.cc:597] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.847710 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.856709 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.858628 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.865989 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.874660 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.875440 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.879989 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.894054 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.893179 23107 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:12:05.903131 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.904387 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.908428 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:05.908977 17366 raft_consensus.cc:3055] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:05.909191 17366 raft_consensus.cc:740] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:05.910218 18014 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:05.911196 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:05.911723 17436 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.912415 17366 consensus_queue.cc:260] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:05.920965 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.925032 17436 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:12:05.905462 23107 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.928311 17366 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:05.933301 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.927624 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.935452 17980 leader_election.cc:336] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:05.940236 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.947392 17363 raft_consensus.cc:1275] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:05.951860 23309 consensus_queue.cc:1048] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:05.953548 17366 raft_consensus.cc:2468] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:12:05.955205 17978 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:05.958338 22986 raft_consensus.cc:2804] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:05.973640 22986 raft_consensus.cc:697] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:05.974781 22986 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:05.985324 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.969377 23251 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:05.988761 17436 raft_consensus.cc:1275] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:12:05.993270 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:05.993899 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.996069 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:05.996803 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:12:05.997936 17332 consensus_peers.cc:597] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.996802 17436 raft_consensus.cc:2368] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 20. Current term is 21.
I20260709 12:12:06.007400 17333 leader_election.cc:400] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 pre-election: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 20. Current term is 21.
I20260709 12:12:06.007761 17333 leader_election.cc:403] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:05.994413 23107 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:05.994575 23150 consensus_queue.cc:1048] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 12:12:06.037542 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.042199 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.044708 23121 raft_consensus.cc:3060] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Advancing to term 21
W20260709 12:12:06.047049 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.061188 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.098529 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 86361.2us
I20260709 12:12:06.069249 23121 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) with higher term. Message: Invalid argument: T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for earlier term 20. Current term is 21.
I20260709 12:12:06.145834 17360 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 21 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:06.189464 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:06.190135 17360 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:06.217325 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 110862us
I20260709 12:12:06.219842 17436 raft_consensus.cc:1275] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:12:06.215466 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.229635 17360 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:12:06.232743 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:06.233454 17436 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:06.235642 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 130782us
I20260709 12:12:06.251881 17436 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
W20260709 12:12:06.271193 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.293140 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.280139 23251 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:06.310626 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.360256 17255 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:06.413959 23055 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.427908 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:06.436689 18014 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:06.437585 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 68571us
I20260709 12:12:06.448204 23055 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Becoming Leader. State: Replica: 33539b233c2044afa31017244f6cc0d1, State: Running, Role: LEADER
I20260709 12:12:06.513015 18014 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33539b233c2044afa31017244f6cc0d1 in term 15.
I20260709 12:12:06.457254 23396 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:12:06.499706 23055 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:06.551275 23375 log.cc:927] Time spent T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:12:06.555146 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 157912us
W20260709 12:12:06.559221 17184 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55928 (request call id 328) took 26633 ms (client timeout 15000 ms). Trace:
W20260709 12:12:06.561578 17184 rpcz_store.cc:269] 0709 12:11:39.919846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.920037 (+   191us) service_pool.cc:224] Handling call
0709 12:12:06.553220 (+26633183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:05.765930 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:05.789307 (+ 23377us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:05.800302 (+ 10995us) write_op.cc:435] Acquired schema lock
0709 12:12:05.802005 (+  1703us) tablet.cc:662] Decoding operations
0709 12:12:05.884121 (+ 82116us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:05.886229 (+  2108us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:05.887259 (+  1030us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:12:05.889373 (+  2114us) tablet.cc:701] Row locks acquired
0709 12:12:05.889392 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:12:05.889532 (+   140us) write_op.cc:270] Start()
0709 12:12:05.889868 (+   336us) write_op.cc:276] Timestamp: P: 1783599125889485 usec, L: 0
0709 12:12:05.889891 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:12:05.927934 (+ 38043us) log.cc:844] Serialized 3225 byte log entry
0709 12:12:06.063253 (+135319us) op_driver.cc:464] REPLICATION: finished
0709 12:12:06.129746 (+ 66493us) write_op.cc:301] APPLY: starting
0709 12:12:06.129839 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:06.133989 (+  4150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:06.134088 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:06.140224 (+  6136us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:06.140474 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:12:06.140526 (+    52us) write_op.cc:312] APPLY: finished
0709 12:12:06.140817 (+   291us) log.cc:844] Serialized 81 byte log entry
0709 12:12:06.140998 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:06.141123 (+   125us) write_op.cc:454] Released schema lock
0709 12:12:06.141168 (+    45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":197567,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":66229,"apply.run_cpu_time_us":10287,"apply.run_wall_time_us":11838,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37551,"num_ops":8,"prepare.queue_time_us":32952,"prepare.run_cpu_time_us":5965,"prepare.run_wall_time_us":183177,"replication_time_us":173159,"spinlock_wait_cycles":1792,"thread_start_us":105467,"threads_started":2}]]}
W20260709 12:12:06.661590 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 73339.1us
I20260709 12:12:06.667776 23282 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:06.668356 23282 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.670498 23282 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:06.711632 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 122446us
I20260709 12:12:06.714454 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.731413 23359 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:06.732086 23359 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:06.790386 23404 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:06.791028 23404 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:06.815904 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.818315 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.773625 23359 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:06.826989 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:06.834563 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:06.845613 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:06.815801 23408 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:12:06.862411 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 155241us
I20260709 12:12:06.872079 23427 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:06.872783 23427 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.875579 23427 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.876533 23403 consensus_queue.cc:1048] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:12:06.880193 23430 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:06.880823 23430 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.859272 23408 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.882944 23430 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.883471 23430 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:06.883929 23430 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:06.884267 23408 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.862176 23281 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:06.886653 23281 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:06.887589 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.888821 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.889418 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.894585 17433 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:06.897004 23282 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:06.897601 23282 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.899878 23282 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.901772 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.902596 17366 raft_consensus.cc:2393] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33539b233c2044afa31017244f6cc0d1 in current term 17: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:06.903421 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.903584 23422 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:06.904583 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.905558 23429 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:06.905732 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.906221 23429 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.908464 23429 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.908942 23429 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:06.909413 23429 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.921576 23251 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:06.922241 23282 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:06.922860 23282 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:06.924942 23282 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:06.885941 23430 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:06.925693 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.933851 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:06.934165 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 71102.2us
I20260709 12:12:06.888747 23281 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:06.936918 17358 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:06.929672 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.938339 23399 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:06.922247 23251 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.953609 23281 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:06.954238 23281 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:06.956470 23281 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:06.958287 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:06.962420 23309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.003s	sys 0.001s
I20260709 12:12:06.963311 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.967288 23436 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:06.967908 23436 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.970077 23436 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.971022 23430 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:06.971537 23430 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.973548 23430 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.974025 23430 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:06.975731 23430 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.980173 23430 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.980657 23430 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:06.981081 23430 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.986129 23404 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:06.987998 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:06.989929 23430 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.992146 23282 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:06.992707 23282 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:06.994922 23282 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:06.995460 23282 raft_consensus.cc:493] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:06.995985 23282 raft_consensus.cc:515] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:06.998080 23282 leader_election.cc:290] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:06.999675 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.002892 23282 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:06.995046 22847 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:07.004285 23404 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:07.004052 22847 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.006935 22847 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.004794 23404 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:07.009269 23404 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.002592 23436 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:07.013767 23251 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.026988 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.003417 23282 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:07.030180 23282 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.011195 23436 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:07.032546 23436 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.021692 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.024413 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.024820 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.025272 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:07.011083 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 60585.6us
I20260709 12:12:07.026160 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.036005 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:12:07.036551 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:07.037106 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.037599 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.039139 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.040099 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.043725 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.046556 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.046623 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.050598 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.050830 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.051874 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f950276bbbb4642872e9280fad2a766" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.053282 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.054363 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.055542 23309 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.055873 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.056133 23309 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.057530 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.057049 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.058764 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.058964 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.059603 17364 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:12:07.060636 17978 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:07.055588 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:06.934403 23429 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.064034 23251 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:07.064623 23251 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.066772 23251 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.074404 23393 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:07.074998 23393 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.075373 23393 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:07.080992 23251 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:07.081637 23251 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.085153 23251 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:07.085238 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 48925.9us
I20260709 12:12:07.086347 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.088194 23251 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:07.089175 23251 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.092227 23251 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.102035 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.104264 23429 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:07.104947 23429 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.107349 23429 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.108721 23429 raft_consensus.cc:493] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:07.109341 23429 raft_consensus.cc:515] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.110772 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.114816 23429 leader_election.cc:290] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.108210 23055 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:07.118120 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.119271 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.119787 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.120589 23309 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.121169 23055 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:07.123390 23055 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.123526 23436 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:07.124049 23436 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.126088 23436 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.128782 23436 raft_consensus.cc:493] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:07.129388 23436 raft_consensus.cc:515] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.129073 23282 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:07.130398 23282 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:07.132411 23282 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.132889 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.133901 23436 leader_election.cc:290] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.134178 22847 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:07.136945 22847 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:07.139215 22847 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.135002 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.135530 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77855d79ba04cf1bf33cc20e8236abc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.140255 17360 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:07.140793 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.140820 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.142203 22847 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:07.142911 23282 raft_consensus.cc:493] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:07.143687 23436 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:07.143472 23282 raft_consensus.cc:515] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.144229 23436 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:07.145588 23282 leader_election.cc:290] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.143183 17258 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.146865 22847 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:07.139118 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 52229.8us
I20260709 12:12:07.147784 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.149353 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.150187 22847 raft_consensus.cc:3060] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.152397 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.154965 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.155613 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.156291 17436 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:12:07.143441 23055 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:12:07.158288 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 70530.1us
I20260709 12:12:07.158747 23055 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.160969 23055 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.168229 23282 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:07.169714 17258 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.170522 23282 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.161613 23393 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.171838 17258 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.161443 22847 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.162664 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.163380 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.163614 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.165488 23436 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.174593 23282 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:07.176426 17258 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.177490 23282 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.178392 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:07.179046 17360 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:07.185834 17258 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.186955 23393 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.096376 17189 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.188946 22847 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.190061 17258 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.192337 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:07.199024 17436 raft_consensus.cc:3060] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:07.199079 22847 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.210408 17436 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:12:07.211601 17981 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:07.213223 17189 catalog_manager.cc:5697] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.214596 17258 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.222347 23393 raft_consensus.cc:2804] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:07.244477 23393 raft_consensus.cc:697] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:07.245639 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.245388 23393 consensus_queue.cc:237] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.246829 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.247557 23055 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.248239 23055 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.248852 23055 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.250133 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.250916 23282 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:07.253309 17258 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.243206 17360 raft_consensus.cc:2468] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:12:07.254134 23282 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:07.255131 17258 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.255847 23282 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:07.257130 17258 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.259757 23282 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.261075 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.270435 23282 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.272446 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.273444 23282 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.275943 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.281260 17258 leader_election.cc:304] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.281981 23282 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.293921 22847 raft_consensus.cc:2749] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:07.295384 17258 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.296319 17189 catalog_manager.cc:5697] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.298272 22847 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.299801 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.302245 22847 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:07.304593 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.307057 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.312553 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.313881 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.314692 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.315876 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.316154 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.316883 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.318598 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.319124 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.320020 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.320497 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.321743 22847 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:07.322374 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.322376 22847 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:07.324043 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.324528 22847 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:07.322153 17189 catalog_manager.cc:5697] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 2 to 8, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 8 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.326157 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:07.326918 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12759295b3a947cca3d2c7fc3c815e59" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.332722 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.336889 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f622d20c7b40a296d381dcc9b82704" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.339985 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4d0995911b4beb98abd9a7a508cddc" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.341445 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.351094 17258 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.360522 22847 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.362967 17258 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.365190 22847 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:07.366541 17258 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.367311 22847 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:07.368685 17258 leader_election.cc:304] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.375391 22847 raft_consensus.cc:2749] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:07.376854 17258 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.377691 22847 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.381070 23282 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.381642 23282 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:07.396113 17258 leader_election.cc:304] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:07.397004 22847 raft_consensus.cc:2749] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.402381 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.407043 17258 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.407806 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:07.399956 23282 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:07.412482 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.412578 22847 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.416416 17258 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.417356 22847 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.419305 17258 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.421322 22847 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.417698 23282 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.422803 17258 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.424611 22847 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.424988 17258 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.427057 17258 leader_election.cc:304] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.428936 22847 raft_consensus.cc:2749] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:07.429379 17258 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.431663 22847 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:07.432114 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.428224 23282 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.433979 17258 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.433264 22847 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.435559 22847 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:07.436993 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.438269 22847 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.447793 17440 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:07.449273 22847 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:07.450965 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:07.454710 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:07.458354 23282 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.525295 18006 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Refusing update from remote peer 33539b233c2044afa31017244f6cc0d1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:07.534294 23436 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:07.619310 17181 catalog_manager.cc:5697] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 9 to 18, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 18 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:07.621441 17181 catalog_manager.cc:5697] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:07.623087 17181 catalog_manager.cc:5697] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:07.629983 17181 catalog_manager.cc:5697] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 18, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 18 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.631479 17181 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 14 to 16, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 16 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:07.633185 17181 catalog_manager.cc:5697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:07.634668 17181 catalog_manager.cc:5697] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.635944 17181 catalog_manager.cc:5697] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 13 to 14, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 14 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:07.628885 17189 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55944 (request call id 313) took 33754 ms (client timeout 15000 ms). Trace:
W20260709 12:12:07.637046 17189 rpcz_store.cc:269] 0709 12:11:33.874798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.875080 (+   282us) service_pool.cc:224] Handling call
0709 12:11:33.961721 (+ 86641us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b5400002210. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f70b2 00007f122b970759 00007f122b908a76 00007f122b8d9d58 00007f122b9d804e 00007f1229e992a4 00007f1229e99232 00007f1229e99161 00007f1229e990dc
0709 12:12:07.628792 (+33667071us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:07.359408 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:07.359954 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:07.359984 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:12:07.360002 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:07.363891 (+  3889us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:07.363956 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:07.363981 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:12:07.364363 (+   382us) tablet.cc:701] Row locks acquired
0709 12:12:07.364381 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:07.364526 (+   145us) write_op.cc:270] Start()
0709 12:12:07.364634 (+   108us) write_op.cc:276] Timestamp: P: 1783599127364478 usec, L: 0
0709 12:12:07.364654 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:12:07.374752 (+ 10098us) log.cc:844] Serialized 1686 byte log entry
0709 12:12:07.484490 (+109738us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b54000762d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b16e28 00007f1229551581 00007f1229550d58 00007f12295559f1 00007f12295559a9 00007f1229555939 00007f1229555901 00007f1229554b2d 0000000000388634 0000000000388479
0709 12:12:07.543351 (+ 58861us) op_driver.cc:464] REPLICATION: finished
0709 12:12:07.566687 (+ 23336us) write_op.cc:301] APPLY: starting
0709 12:12:07.566795 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:07.569517 (+  2722us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:07.569543 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:07.583136 (+ 13593us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:07.583359 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:12:07.583415 (+    56us) write_op.cc:312] APPLY: finished
0709 12:12:07.583680 (+   265us) log.cc:844] Serialized 49 byte log entry
0709 12:12:07.584530 (+   850us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:07.584653 (+   123us) write_op.cc:454] Released schema lock
0709 12:12:07.584701 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:07.610408 (+ 25707us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:07.610443 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77696,"reported_tablets":47,"spinlock_wait_cycles":99981056,"child_traces":[["op",{"apply.queue_time_us":23057,"apply.run_cpu_time_us":6716,"apply.run_wall_time_us":43674,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20839,"num_ops":4,"prepare.queue_time_us":14923,"prepare.run_cpu_time_us":24458,"prepare.run_wall_time_us":141942,"raft.queue_time_us":89519,"raft.run_cpu_time_us":1351,"raft.run_wall_time_us":18840,"replication_time_us":178517,"spinlock_wait_cycles":21687168,"thread_start_us":146086,"threads_started":4,"wal-append.queue_time_us":57917}]]}
I20260709 12:12:07.642707 17181 catalog_manager.cc:5697] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 19 to 21, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 21 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.649710 17181 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 15, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 15 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:07.651557 17181 catalog_manager.cc:5697] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:07.652915 17181 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.654296 17181 catalog_manager.cc:5697] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 14 to 16, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 16 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:07.658955 17181 catalog_manager.cc:5697] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 12, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 12 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.660425 17181 catalog_manager.cc:5697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 12, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 12 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:07.662016 17181 catalog_manager.cc:5697] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.663405 17181 catalog_manager.cc:5697] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 10 to 11, VOTER e860f7e876b74ec589f447737822a4f6 (127.15.191.67) evicted. New cstate: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:07.665134 17181 catalog_manager.cc:5697] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 17, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 17 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.666528 17181 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:07.667730 17181 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 14, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 14 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.669045 17181 catalog_manager.cc:5697] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 13, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 13 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:07.670439 17181 catalog_manager.cc:5697] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:07.672144 17181 catalog_manager.cc:5697] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.673421 17181 catalog_manager.cc:5697] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 14, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 14 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:07.674805 17181 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.676103 17181 catalog_manager.cc:5697] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.677379 17181 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 14 to 17, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.678998 17181 catalog_manager.cc:5697] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 14, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 14 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:07.680323 17181 catalog_manager.cc:5697] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 15, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 15 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } }
I20260709 12:12:07.726751 17358 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:07.729378 23288 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:07.805851 17440 raft_consensus.cc:1275] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:07.811049 23390 consensus_queue.cc:1048] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:07.885646 17190 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 7 to 8, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 8 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.895792 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f950276bbbb4642872e9280fad2a766 with delete_type TABLET_DATA_TOMBSTONED (TS e860f7e876b74ec589f447737822a4f6 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51598
I20260709 12:12:07.919667 23458 tablet_replica.cc:333] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:07.927022 23458 raft_consensus.cc:2243] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:07.920439 17181 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55932 (request call id 332) took 1692 ms. Trace:
I20260709 12:12:07.932056 17181 rpcz_store.cc:276] 0709 12:12:06.228342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.236329 (+  7987us) service_pool.cc:224] Handling call
0709 12:12:06.486942 (+250613us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5400002210. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6b71 00007f12229f70b2 00007f122b970759 00007f122b908a76 00007f122b8d9d58 00007f122b9d804e 00007f1229e992a4 00007f1229e99232 00007f1229e99161 00007f1229e990dc
0709 12:12:06.794948 (+308006us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5400002210. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f6e9c 00007f12229f70f6 00007f122b970759 00007f122b908a76 00007f122b8d9d58 00007f122b9d804e 00007f1229e992a4 00007f1229e99232 00007f1229e99161 00007f1229e990dc
0709 12:12:07.920351 (+1125403us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:07.690195 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:07.690718 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:07.690751 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:12:07.690767 (+    16us) tablet.cc:662] Decoding operations
0709 12:12:07.692613 (+  1846us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:07.692670 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:07.692705 (+    35us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:12:07.694929 (+  2224us) tablet.cc:701] Row locks acquired
0709 12:12:07.694950 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:12:07.695100 (+   150us) write_op.cc:270] Start()
0709 12:12:07.695220 (+   120us) write_op.cc:276] Timestamp: P: 1783599127695052 usec, L: 0
0709 12:12:07.695242 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:07.695953 (+   711us) log.cc:844] Serialized 11317 byte log entry
0709 12:12:07.699389 (+  3436us) op_driver.cc:464] REPLICATION: finished
0709 12:12:07.699865 (+   476us) write_op.cc:301] APPLY: starting
0709 12:12:07.699949 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:07.715097 (+ 15148us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:07.715208 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:07.777896 (+ 62688us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:07.785217 (+  7321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=0,mrs_lookups=0
0709 12:12:07.805191 (+ 19974us) write_op.cc:312] APPLY: finished
0709 12:12:07.805961 (+   770us) log.cc:844] Serialized 252 byte log entry
0709 12:12:07.806165 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:07.806425 (+   260us) write_op.cc:454] Released schema lock
0709 12:12:07.806490 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:07.806897 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:07.806923 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3121,"reported_tablets":38,"spinlock_wait_cycles":53691008,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":32147,"apply.run_wall_time_us":106968,"cfile_cache_hit":116,"cfile_cache_hit_bytes":121162,"num_ops":29,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":5981,"prepare.run_wall_time_us":16369,"replication_time_us":3973}]]}
I20260709 12:12:07.935348 23458 raft_consensus.cc:2272] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:07.940984 23458 ts_tablet_manager.cc:1916] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:07.971668 17187 catalog_manager.cc:5697] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.973296 17187 catalog_manager.cc:5697] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.983459 17187 catalog_manager.cc:5697] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.985879 17187 catalog_manager.cc:5697] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.987859 17187 catalog_manager.cc:5697] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:07.991608 17187 catalog_manager.cc:5697] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 9 to 10, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 10 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:07.980950 17190 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55928 (request call id 327) took 44866 ms (client timeout 15000 ms). Trace:
W20260709 12:12:07.992796 17190 rpcz_store.cc:269] 0709 12:11:23.115018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.562614 (+447596us) service_pool.cc:224] Handling call
0709 12:12:07.980878 (+44418264us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:07.930776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:07.931320 (+   544us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:07.931362 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:12:07.931378 (+    16us) tablet.cc:662] Decoding operations
0709 12:12:07.931729 (+   351us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:07.931780 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:07.931821 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:07.931995 (+   174us) tablet.cc:701] Row locks acquired
0709 12:12:07.932011 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:12:07.932150 (+   139us) write_op.cc:270] Start()
0709 12:12:07.932264 (+   114us) write_op.cc:276] Timestamp: P: 1783599127932105 usec, L: 0
0709 12:12:07.932284 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:12:07.932858 (+   574us) log.cc:844] Serialized 536 byte log entry
0709 12:12:07.935101 (+  2243us) op_driver.cc:464] REPLICATION: finished
0709 12:12:07.936403 (+  1302us) write_op.cc:301] APPLY: starting
0709 12:12:07.936496 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:07.937240 (+   744us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:07.937327 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:07.937956 (+   629us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:07.938124 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:12:07.938171 (+    47us) write_op.cc:312] APPLY: finished
0709 12:12:07.938358 (+   187us) log.cc:844] Serialized 25 byte log entry
0709 12:12:07.938528 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:07.938612 (+    84us) write_op.cc:454] Released schema lock
0709 12:12:07.938657 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:07.939025 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:07.939058 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":240226,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1084,"apply.run_cpu_time_us":2583,"apply.run_wall_time_us":2582,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":2351,"prepare.run_wall_time_us":2351,"replication_time_us":2703}]]}
I20260709 12:12:07.998090 17187 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 reported cstate change: term changed from 11 to 15, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 15 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:08.025871 23458 ts_tablet_manager.cc:1929] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:12:08.026590 23458 log.cc:1199] T 8f950276bbbb4642872e9280fad2a766 P e860f7e876b74ec589f447737822a4f6: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/wals/8f950276bbbb4642872e9280fad2a766
I20260709 12:12:08.029577 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet 8f950276bbbb4642872e9280fad2a766 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:12:08.073057 17187 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55928 (request call id 329) took 6492 ms. Trace:
I20260709 12:12:08.073467 17187 rpcz_store.cc:276] 0709 12:12:01.580807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.642317 (+ 61510us) service_pool.cc:224] Handling call
0709 12:12:08.072986 (+6430669us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:08.002849 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:08.003434 (+   585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:08.003479 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:12:08.003494 (+    15us) tablet.cc:662] Decoding operations
0709 12:12:08.004259 (+   765us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:08.004313 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:08.004338 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:12:08.004875 (+   537us) tablet.cc:701] Row locks acquired
0709 12:12:08.004892 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:12:08.005018 (+   126us) write_op.cc:270] Start()
0709 12:12:08.005129 (+   111us) write_op.cc:276] Timestamp: P: 1783599128004974 usec, L: 0
0709 12:12:08.005151 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:08.005801 (+   650us) log.cc:844] Serialized 2835 byte log entry
0709 12:12:08.007911 (+  2110us) op_driver.cc:464] REPLICATION: finished
0709 12:12:08.008304 (+   393us) write_op.cc:301] APPLY: starting
0709 12:12:08.008373 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:08.011770 (+  3397us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:08.011840 (+    70us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:08.014843 (+  3003us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:08.015045 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:12:08.015090 (+    45us) write_op.cc:312] APPLY: finished
0709 12:12:08.015338 (+   248us) log.cc:844] Serialized 73 byte log entry
0709 12:12:08.016116 (+   778us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:08.016245 (+   129us) write_op.cc:454] Released schema lock
0709 12:12:08.016290 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:08.016639 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:08.016664 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3423,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":205,"apply.run_cpu_time_us":7704,"apply.run_wall_time_us":8302,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29246,"num_ops":7,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":3174,"prepare.run_wall_time_us":5448,"replication_time_us":2648}]]}
I20260709 12:12:08.081617 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:08.083417 16125 tablet_replica.cc:333] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.084249 16125 raft_consensus.cc:2243] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:08.085315 16125 raft_consensus.cc:2272] T 5d769dc29730489bb1bc366ea38bf391 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.088092 16125 tablet_replica.cc:333] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.089015 16125 raft_consensus.cc:2243] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.089804 16125 raft_consensus.cc:2272] T dfb3d142442b4e3aada6416cb667a95b P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.092478 16125 tablet_replica.cc:333] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.093387 16125 raft_consensus.cc:2243] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.094058 16125 raft_consensus.cc:2272] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.105086 16125 tablet_replica.cc:333] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.112802 16125 raft_consensus.cc:2243] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.113674 16125 raft_consensus.cc:2272] T 7912262477ba4fc0a074c658eed0d241 P 33539b233c2044afa31017244f6cc0d1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.116344 16125 tablet_replica.cc:333] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.117345 16125 raft_consensus.cc:2243] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.127851 17181 catalog_manager.cc:5697] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 10 to 14, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 14 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:08.130479 17181 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 16 to 17, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 17 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:08.132171 17181 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 15, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to 33539b233c2044afa31017244f6cc0d1 (127.15.191.65). New cstate: current_term: 15 leader_uuid: "33539b233c2044afa31017244f6cc0d1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:08.117924 16125 raft_consensus.cc:2272] T 12759295b3a947cca3d2c7fc3c815e59 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.145903 16125 tablet_replica.cc:333] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.146852 16125 raft_consensus.cc:2243] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.147957 17181 catalog_manager.cc:5697] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:08.188712 16125 raft_consensus.cc:2272] T ccfe00a9196e4e49a4ad7e72acd36c08 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.200443 16125 tablet_replica.cc:333] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.205658 16125 raft_consensus.cc:2243] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:08.213748 17186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60632 (request call id 222) took 38959 ms (client timeout 15000 ms). Trace:
W20260709 12:12:08.214766 17186 rpcz_store.cc:269] 0709 12:11:29.254607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.267653 (+ 13046us) service_pool.cc:224] Handling call
0709 12:11:29.386747 (+119094us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5400002210. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f12228b6db1 00007f12229f7640 00007f122b8ce846 00007f122b9d890e 00007f1229e992a4 00007f1229e99232 00007f1229e99161 00007f1229e990dc 00007f1229e98392 00007f1223e5648c 00007f1223e558c6
0709 12:12:08.213515 (+38826768us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2734,"reported_tablets":39,"spinlock_wait_cycles":27904256}
I20260709 12:12:08.222453 16125 raft_consensus.cc:2272] T d9108b2dade34abca8d8b1d985d2dc05 P 33539b233c2044afa31017244f6cc0d1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.225368 16125 tablet_replica.cc:333] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.224436 17185 catalog_manager.cc:5697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.226572 23251 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.227231 23251 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:08.229964 23251 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:08.231612 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:08.240149 16125 raft_consensus.cc:2243] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.240037 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:08.243431 17258 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:08.244247 23251 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:08.247804 17185 catalog_manager.cc:5697] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 11 to 13, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 13 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:08.252698 16125 raft_consensus.cc:2272] T d7f622d20c7b40a296d381dcc9b82704 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.263258 16125 tablet_replica.cc:333] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.264050 16125 raft_consensus.cc:2243] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.265048 16125 raft_consensus.cc:2272] T 8f950276bbbb4642872e9280fad2a766 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.297672 16125 tablet_replica.cc:333] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.309437 16125 raft_consensus.cc:2243] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.310070 16125 raft_consensus.cc:2272] T 6685bf7292cc44e09a9965668c0345cc P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:08.310508 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:08.312940 16125 tablet_replica.cc:333] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.313865 16125 raft_consensus.cc:2243] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.332377 16125 raft_consensus.cc:2272] T a77855d79ba04cf1bf33cc20e8236abc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:08.333664 17238 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:08.334154 17238 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:08.334488 17238 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:08.335211 16125 tablet_replica.cc:333] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
W20260709 12:12:08.340721 17185 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60632 (request call id 223) took 15043 ms (client timeout 15000 ms). Trace:
W20260709 12:12:08.345409 17185 rpcz_store.cc:269] 0709 12:11:53.297432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.302294 (+  4862us) service_pool.cc:224] Handling call
0709 12:12:08.278340 (+14976046us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:08.278368 (+    28us) write_op.cc:454] Released schema lock
0709 12:12:08.340621 (+ 62253us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:08.254654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:08.255168 (+   514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:08.255208 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:12:08.255225 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:08.255639 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:08.255696 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:08.255722 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:08.256053 (+   331us) tablet.cc:701] Row locks acquired
0709 12:12:08.256070 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:12:08.256208 (+   138us) write_op.cc:270] Start()
0709 12:12:08.256316 (+   108us) write_op.cc:276] Timestamp: P: 1783599128256169 usec, L: 0
0709 12:12:08.256337 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:12:08.256931 (+   594us) log.cc:844] Serialized 919 byte log entry
0709 12:12:08.259496 (+  2565us) op_driver.cc:464] REPLICATION: finished
0709 12:12:08.259909 (+   413us) write_op.cc:301] APPLY: starting
0709 12:12:08.259983 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:08.261261 (+  1278us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:08.261354 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:08.263350 (+  1996us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:08.263517 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:12:08.263572 (+    55us) write_op.cc:312] APPLY: finished
0709 12:12:08.263763 (+   191us) log.cc:844] Serialized 33 byte log entry
0709 12:12:08.263928 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:08.264021 (+    93us) write_op.cc:454] Released schema lock
0709 12:12:08.264064 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":7216,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":3802,"apply.run_wall_time_us":4420,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8356,"num_ops":2,"prepare.queue_time_us":2393,"prepare.run_cpu_time_us":2548,"prepare.run_wall_time_us":2547,"replication_time_us":3049}]]}
I20260709 12:12:08.354803 16125 raft_consensus.cc:2243] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.355744 16125 raft_consensus.cc:2272] T b9356b25ee58416ca89b944be6f0b562 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.358741 16125 tablet_replica.cc:333] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.359576 16125 raft_consensus.cc:2243] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.360239 16125 raft_consensus.cc:2272] T 62f5a9a5a773414fa979e4e68b31bb5d P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.386268 16125 tablet_replica.cc:333] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.387140 16125 raft_consensus.cc:2243] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.387735 16125 raft_consensus.cc:2272] T f7c3705a9e0e457898a7061b4170a8a1 P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.408705 16125 tablet_replica.cc:333] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.409590 16125 raft_consensus.cc:2243] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.426421 16125 raft_consensus.cc:2272] T 97e731eb30ed4f36ab13505e2cad7085 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.429065 16125 tablet_replica.cc:333] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.429900 16125 raft_consensus.cc:2243] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.431334 16125 raft_consensus.cc:2272] T d6c49969609c4c85a0a31036764369c0 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:08.542362 17188 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55928 (request call id 325) took 82195 ms (client timeout 15000 ms). Trace:
I20260709 12:12:08.542937 16125 tablet_replica.cc:333] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
W20260709 12:12:08.542932 17188 rpcz_store.cc:269] 0709 12:10:46.347218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.347571 (+   353us) service_pool.cc:224] Handling call
0709 12:12:08.517044 (+82169473us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11358,"reported_tablets":33,"spinlock_wait_cycles":795520}
I20260709 12:12:08.543838 16125 raft_consensus.cc:2243] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.568212 16125 raft_consensus.cc:2272] T a9955d24ad7243689a5a438424f992e9 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:08.659528 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 61231.2us
I20260709 12:12:08.670984 16125 tablet_replica.cc:333] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:08.671977 16125 raft_consensus.cc:2243] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:08.673137 17186 catalog_manager.cc:5697] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 13 to 15, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 15 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:08.682375 17186 catalog_manager.cc:5697] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.684609 17186 catalog_manager.cc:5697] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 9 to 10, leader changed from 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 10 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:08.692713 17182 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55944 (request call id 314) took 11193 ms. Trace:
I20260709 12:12:08.693255 17182 rpcz_store.cc:276] 0709 12:11:57.499475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.499820 (+   345us) service_pool.cc:224] Handling call
0709 12:12:08.692606 (+11192786us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90282,"reported_tablets":47}
I20260709 12:12:08.702314 17186 catalog_manager.cc:5697] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 8 to 13, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 13 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.705368 17186 catalog_manager.cc:5697] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 15 to 16, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 16 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.707314 17186 catalog_manager.cc:5697] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 13 to 16, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 16 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.737527 23470 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.758514 23251 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:08.786077 17430 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f950276bbbb4642872e9280fad2a766 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 10 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:51598
W20260709 12:12:08.807569 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 46174.7us
I20260709 12:12:08.770898 23470 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:08.790412 23251 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:08.832222 23470 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:08.847223 17255 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.864950 23476 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:12:08.884893 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:08.887751 23476 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:08.893402 17440 consensus_queue.cc:237] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:08.899799 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 97084.1us
I20260709 12:12:08.904035 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:08.912766 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:08.893334 23251 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:08.916263 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 113914us
I20260709 12:12:08.925571 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:08.911275 23476 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:08.912837 23468 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:08.931834 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:08.932497 23473 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:08.952970 23473 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:08.955295 23473 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:08.955777 23468 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:08.963368 16125 raft_consensus.cc:2272] T 3673757d03f243668794c10285c7d1ff P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.913070 23492 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:08.912765 23470 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:08.973713 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:08.975193 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:08.976223 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:08.970034 17258 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:08.939986 17407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.022891 17258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 52960.4us
I20260709 12:12:08.958024 23468 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:09.030369 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:08.932577 23251 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
W20260709 12:12:09.029811 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 60229.3us
I20260709 12:12:09.035038 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:09.036345 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.037173 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.049901 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:09.051250 23494 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:09.064201 23494 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.029299 23282 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.072855 23494 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:09.081080 23498 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:09.081710 23498 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:09.101020 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:08.988802 23470 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:09.110698 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.117869 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 86685.5us
I20260709 12:12:09.124022 16125 tablet_replica.cc:333] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.125020 16125 raft_consensus.cc:2243] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:09.126842 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:08.973225 23492 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:09.045228 23251 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.099431 23498 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:09.128299 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.134222 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.134887 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.129581 16125 raft_consensus.cc:2272] T 6f4d0995911b4beb98abd9a7a508cddc P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:09.131402 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 94503.2us
I20260709 12:12:09.138878 23490 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:09.139581 23490 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.136586 23282 raft_consensus.cc:493] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:09.124352 23494 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:12:09.147969 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 210498us
I20260709 12:12:09.146818 23282 raft_consensus.cc:515] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.155110 17177 catalog_manager.cc:5028] TS e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): tablet 8f950276bbbb4642872e9280fad2a766 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:12:09.142066 23490 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:09.156278 23282 leader_election.cc:290] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:09.158139 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:09.161504 23470 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:09.162698 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:09.172613 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:09.171437 17255 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:09.177647 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.187561 23470 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:09.183753 17255 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.191036 17255 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.191962 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.193331 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.195495 23470 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.201534 16125 tablet_replica.cc:333] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.202466 16125 raft_consensus.cc:2243] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.205432 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.206401 17366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.207223 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.151391 23494 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:09.211279 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.213218 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd27279c3e8c4e0cbe30a2cbe7e56ab1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.216068 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.216400 23492 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:09.217585 17258 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.223148 17255 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.226774 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.208244 23507 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.236034 23251 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:09.224236 23476 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.239490 23476 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.241590 23476 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:09.243490 23494 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:09.245167 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.248471 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.254346 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.257421 23492 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.262418 16125 raft_consensus.cc:2272] T 814b69784b0f4c3d8b07d13d54ae4b47 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.265489 16125 tablet_replica.cc:333] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.265877 18015 raft_consensus.cc:1275] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:12:09.286033 17258 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.287359 17258 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.290351 23494 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.290409 23470 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.291446 23470 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:09.291939 23470 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:09.292527 23472 consensus_queue.cc:1048] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:09.294011 23470 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:09.291720 17258 leader_election.cc:304] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:09.297822 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 74760.6us
I20260709 12:12:09.299474 23470 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.302767 16125 raft_consensus.cc:2243] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.303499 16125 raft_consensus.cc:2272] T 4466b54543584a9898797997087d10f1 P 33539b233c2044afa31017244f6cc0d1 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.303711 23470 raft_consensus.cc:2749] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:09.304652 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.298969 17255 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:09.306185 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:09.310716 23470 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:09.307880 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:09.310774 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:09.310946 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.320057 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:09.321647 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.322556 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.324186 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:09.327492 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.328095 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.328949 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.329092 23478 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:09.330394 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff441a2f8cb4ea9b0e9a4bec55d843b" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.330214 23478 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.332641 23478 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:09.334323 16125 tablet_replica.cc:333] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.335229 16125 raft_consensus.cc:2243] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.335911 16125 raft_consensus.cc:2272] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.354929 16125 tablet_replica.cc:333] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.355756 16125 raft_consensus.cc:2243] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:12:09.355994 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.359766 16125 raft_consensus.cc:2272] T 93c0e960dcac478bbf09add686ea3b3c P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.365512 23494 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:12:09.365620 17255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 44662.5us
I20260709 12:12:09.366165 23494 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:09.367578 23470 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:09.368124 23470 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.368466 23494 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:09.369988 17186 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60632 (request call id 224) took 1051 ms. Trace:
I20260709 12:12:09.372159 23470 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:09.372617 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.374821 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.375172 23425 raft_consensus.cc:2955] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 3 to 9, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:09.391345 17186 rpcz_store.cc:276] 0709 12:12:08.318611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.318732 (+   121us) service_pool.cc:224] Handling call
0709 12:12:09.369917 (+1051185us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:08.888839 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:08.889418 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:08.889456 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:12:08.889485 (+    29us) tablet.cc:662] Decoding operations
0709 12:12:08.890303 (+   818us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:08.890389 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:08.890417 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:12:08.890950 (+   533us) tablet.cc:701] Row locks acquired
0709 12:12:08.890969 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:12:08.891114 (+   145us) write_op.cc:270] Start()
0709 12:12:08.891231 (+   117us) write_op.cc:276] Timestamp: P: 1783599128891061 usec, L: 0
0709 12:12:08.891253 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:08.891910 (+   657us) log.cc:844] Serialized 2452 byte log entry
0709 12:12:09.118542 (+226632us) op_driver.cc:464] REPLICATION: finished
0709 12:12:09.263405 (+144863us) write_op.cc:301] APPLY: starting
0709 12:12:09.263491 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:09.281779 (+ 18288us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:09.281885 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:09.301690 (+ 19805us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:09.302018 (+   328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:12:09.302084 (+    66us) write_op.cc:312] APPLY: finished
0709 12:12:09.302362 (+   278us) log.cc:844] Serialized 65 byte log entry
0709 12:12:09.302533 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:09.302645 (+   112us) write_op.cc:454] Released schema lock
0709 12:12:09.302692 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:09.303103 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:09.303130 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":137467,"apply.run_cpu_time_us":10355,"apply.run_wall_time_us":39690,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29195,"num_ops":6,"prepare.queue_time_us":76225,"prepare.run_cpu_time_us":3467,"prepare.run_wall_time_us":25227,"replication_time_us":213073,"thread_start_us":84703,"threads_started":2}]]}
W20260709 12:12:09.378278 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 62148.9us
I20260709 12:12:09.377864 18014 raft_consensus.cc:2955] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 3 to 9, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:09.383852 16125 tablet_replica.cc:333] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.406971 16125 raft_consensus.cc:2243] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.407737 16125 raft_consensus.cc:2272] T d582e1abf9be42689682da4cee6206c8 P 33539b233c2044afa31017244f6cc0d1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.409577 23470 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:09.410189 23470 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.411267 16125 tablet_replica.cc:333] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.412405 23470 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:09.414191 17980 leader_election.cc:336] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:09.418643 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.419358 17363 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:12:09.419845 16125 raft_consensus.cc:2243] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.420730 16125 raft_consensus.cc:2272] T 539116186b9c4b269f16afb90a4654f4 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.423588 16125 tablet_replica.cc:333] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.446560 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:09.450695 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7912262477ba4fc0a074c658eed0d241 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:09.454846 23395 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:09.455343 23395 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:09.455731 23395 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.455514 16125 raft_consensus.cc:2243] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.464089 16125 raft_consensus.cc:2272] T 8789c06ba7714e709d794ce12c4141d1 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.467265 16125 tablet_replica.cc:333] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.468067 16125 raft_consensus.cc:2243] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.468693 16125 raft_consensus.cc:2272] T e31ef54befbd4be3b1626005e275d427 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.483886 16125 tablet_replica.cc:333] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.484714 16125 raft_consensus.cc:2243] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.485320 16125 raft_consensus.cc:2272] T c6728648e29b471c950575a72ecf0454 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.488365 16125 tablet_replica.cc:333] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.489162 16125 raft_consensus.cc:2243] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.489741 16125 raft_consensus.cc:2272] T c44e7f48dd474ca1a12a7ac7251f4c6f P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.463867 23395 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.509791 23395 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:09.499332 16125 tablet_replica.cc:333] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.511034 16125 raft_consensus.cc:2243] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.511101 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:09.511838 17364 raft_consensus.cc:3060] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.512320 16125 raft_consensus.cc:2272] T 12b75d8684e5472b87d6b3acb0ef9d2e P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.523216 17364 raft_consensus.cc:2468] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 19.
I20260709 12:12:09.526079 17978 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:09.526938 23502 raft_consensus.cc:2804] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:09.527472 23502 raft_consensus.cc:697] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:09.528352 23502 consensus_queue.cc:237] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:09.530056 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:09.533209 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.533797 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.535306 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.535928 17406 consensus_peers.cc:597] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.541313 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:09.554822 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.554409 17258 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:09.556173 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:09.556589 17186 catalog_manager.cc:5697] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: config changed from index 3 to 9, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 11 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:09.561897 16125 tablet_replica.cc:333] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.562909 16125 raft_consensus.cc:2243] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.563769 17258 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:09.569022 17258 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.567338 23494 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.577392 17258 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.575790 23476 raft_consensus.cc:2706] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Received pre-election callback for term 16 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:12:09.554922 23470 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:09.578459 16125 raft_consensus.cc:2272] T ff74c08559a64593bfe9cdc08a3b96d1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:09.579869 17258 raft_consensus.cc:2686] T 4198acb44a394602a442737d55022d72 P 33539b233c2044afa31017244f6cc0d1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:09.589007 17258 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:09.589984 17980 leader_election.cc:336] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:09.590466 17258 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.578330 23473 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.593012 23476 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.586467 23470 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:09.605290 23470 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:09.607717 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:09.608588 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.609474 17258 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.610270 23470 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:09.597075 23476 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:09.612645 17258 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:09.613420 23470 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:09.619261 16125 tablet_replica.cc:333] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.620204 16125 raft_consensus.cc:2243] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.620884 16125 raft_consensus.cc:2272] T eb339cd935184a289cfac7d49d2f74d3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.657006 16125 tablet_replica.cc:333] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.657814 16125 raft_consensus.cc:2243] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.659103 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "33539b233c2044afa31017244f6cc0d1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:09.661393 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:09.658088 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.662242 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.666582 16125 raft_consensus.cc:2272] T f462146b97ed46f2821bee27630d0218 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:09.662993 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.668195 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.669692 17332 consensus_peers.cc:597] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.668915 17258 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33539b233c2044afa31017244f6cc0d1; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:09.678853 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.671710 23476 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.694804 16125 tablet_replica.cc:333] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.695844 16125 raft_consensus.cc:2243] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.696656 16125 raft_consensus.cc:2272] T 4b90fb9f510d4f0abcf7148b6fafae89 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.697964 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet 7912262477ba4fc0a074c658eed0d241 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37556
W20260709 12:12:09.696731 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.700218 17186 catalog_manager.cc:5697] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 18 to 19, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 19 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.705364 16125 tablet_replica.cc:333] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.706352 16125 raft_consensus.cc:2243] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.710702 16125 raft_consensus.cc:2272] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.713281 16125 tablet_replica.cc:333] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.720075 23514 tablet_replica.cc:333] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:09.723356 16125 raft_consensus.cc:2243] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.724154 23514 raft_consensus.cc:2243] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.724901 23514 raft_consensus.cc:2272] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.726207 16125 raft_consensus.cc:2272] T 51babcffb8ce4ac99ebd5354a7c7d898 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:09.746616 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.747462 23514 ts_tablet_manager.cc:1916] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:09.758179 16125 tablet_replica.cc:333] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.763685 16125 raft_consensus.cc:2243] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.767647 16125 raft_consensus.cc:2272] T ee22d4e5e05e423097297625d6158f21 P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:09.768934 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.769114 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.773665 16125 tablet_replica.cc:333] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.774483 16125 raft_consensus.cc:2243] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.775146 16125 raft_consensus.cc:2272] T 8832d652d7004314892ca1c18bd94f7c P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.779168 16125 tablet_replica.cc:333] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.779906 16125 raft_consensus.cc:2243] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.780476 16125 raft_consensus.cc:2272] T e8f15a1b060b43ca9ea130feba217bcf P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:09.791697 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.804623 16125 tablet_replica.cc:333] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.823556 16125 raft_consensus.cc:2243] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.825006 16125 raft_consensus.cc:2272] T 51f32408cb854e64a70dc3560f27b02e P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.828024 16125 tablet_replica.cc:333] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.828822 16125 raft_consensus.cc:2243] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.829422 16125 raft_consensus.cc:2272] T 119706da80854a2680f098d29fac4c43 P 33539b233c2044afa31017244f6cc0d1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.834616 16125 tablet_replica.cc:333] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.835988 16125 raft_consensus.cc:2243] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.836680 16125 raft_consensus.cc:2272] T 6bbcd6d92bbd4175a2f8233eb40726ad P 33539b233c2044afa31017244f6cc0d1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.839370 16125 tablet_replica.cc:333] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.840082 16125 raft_consensus.cc:2243] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:09.841602 16125 raft_consensus.cc:2272] T 1c41ebef06654a43a98e69d0c065bba4 P 33539b233c2044afa31017244f6cc0d1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.844326 16125 tablet_replica.cc:333] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.847565 16125 raft_consensus.cc:2243] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.848352 16125 raft_consensus.cc:2272] T f7130b980d9147f2b3915212d4028e03 P 33539b233c2044afa31017244f6cc0d1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.852610 16125 tablet_replica.cc:333] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.853324 16125 raft_consensus.cc:2243] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.853940 16125 raft_consensus.cc:2272] T 18a366d5769a4ed9bb2b1e32afb26cd3 P 33539b233c2044afa31017244f6cc0d1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.857458 16125 tablet_replica.cc:333] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.858173 16125 raft_consensus.cc:2243] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.858717 16125 raft_consensus.cc:2272] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 33539b233c2044afa31017244f6cc0d1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:09.862882 16125 tablet_replica.cc:333] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: stopping tablet replica
I20260709 12:12:09.864482 16125 raft_consensus.cc:2243] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:09.865048 16125 pending_rounds.cc:70] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: Trying to abort 1 pending ops.
I20260709 12:12:09.865264 16125 pending_rounds.cc:77] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7305622016401285120 op_type: NO_OP noop_request { }
I20260709 12:12:09.865625 16125 raft_consensus.cc:2889] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:09.865974 16125 raft_consensus.cc:2272] T 3a03a1e696734298850b94830af8a727 P 33539b233c2044afa31017244f6cc0d1 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:09.874154 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.875478 23514 ts_tablet_manager.cc:1929] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 12:12:09.880774 23514 log.cc:1199] T 7912262477ba4fc0a074c658eed0d241 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/7912262477ba4fc0a074c658eed0d241
I20260709 12:12:09.882684 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet 7912262477ba4fc0a074c658eed0d241 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
W20260709 12:12:09.884419 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:09.897428 23466 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:09.898123 23466 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:09.904222 17406 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:09.905375 23466 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:09.906517 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:09.912827 17404 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:09.917186 23472 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:09.936028 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.974677 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:10.083333 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.107743 17363 raft_consensus.cc:1275] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:10.112203 23503 consensus_queue.cc:1048] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:10.477571 23384 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:10.478333 23384 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:10.480749 23384 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:10.482071 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:10.482746 23384 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:10.483058 17437 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:12:10.483769 23384 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:10.485801 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:10.487223 23413 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:10.487648 23413 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:10.488035 23413 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.486186 23384 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:10.491098 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:10.492883 17332 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111) [suppressed 328 similar messages]
W20260709 12:12:10.501408 17332 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:10.511519 17332 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:10.512068 17332 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:10.512905 23384 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.547487 23413 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:10.574476 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:10.575142 17437 raft_consensus.cc:3060] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.579396 23472 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:10.580103 23472 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:10.580746 17332 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:10.583664 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:10.584380 17364 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:12:10.585789 17404 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:10.586730 23466 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:10.587218 23466 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:10.587576 23466 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.596989 23466 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:10.605818 17406 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:10.586400 23472 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:10.610415 17437 raft_consensus.cc:2468] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 13.
I20260709 12:12:10.611796 17333 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:10.612859 23496 raft_consensus.cc:2804] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:10.613413 23496 raft_consensus.cc:697] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:10.614564 23496 consensus_queue.cc:237] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:10.619449 23413 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:10.629535 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:10.635197 17364 raft_consensus.cc:3060] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.637146 23466 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:10.644976 17182 catalog_manager.cc:5697] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 12 to 13, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 13 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.670930 17364 raft_consensus.cc:2468] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:12:10.672524 17404 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:12:10.673364 17406 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:10.675381 23466 raft_consensus.cc:2804] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:10.676388 23466 raft_consensus.cc:697] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:10.677419 23466 consensus_queue.cc:237] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:10.706070 23496 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:10.706741 23496 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:10.726779 17332 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:10.727928 23496 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:10.730036 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:10.736297 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:10.737186 23496 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.749956 17186 catalog_manager.cc:5697] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 16 to 17, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:10.810698 23466 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:10.811333 23466 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:10.817795 23466 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:10.825433 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:10.826213 17364 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:12:10.827567 17404 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:10.828584 23480 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.829016 23480 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:10.829406 23480 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:10.831570 17406 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:10.946249 23480 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:10.952870 17406 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:10.975800 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:10.976497 17363 raft_consensus.cc:3060] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.985158 17363 raft_consensus.cc:2468] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:12:10.986513 17404 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:10.987337 23472 raft_consensus.cc:2804] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:10.987897 23472 raft_consensus.cc:697] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:10.988929 23472 consensus_queue.cc:237] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:11.020673 17440 raft_consensus.cc:1275] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:11.026289 23413 consensus_queue.cc:1048] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:11.025851 17182 catalog_manager.cc:5697] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 15 to 16, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 16 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.040606 23466 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:11.041257 23466 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:11.044803 23466 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:11.053916 17406 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:11.057303 23480 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:11.055327 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:11.064670 17404 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:11.066066 23481 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.070425 23478 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:11.071144 23478 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:11.074002 23478 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:11.075254 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:11.075724 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:11.082862 17981 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:11.083746 23478 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:11.107793 17980 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:11.108733 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.109206 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.112089 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.120885 23480 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:11.121575 23480 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:11.123756 23480 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:11.120942 23413 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:11.124969 23413 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:11.126485 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:11.127216 17361 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 14.
I20260709 12:12:11.128690 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:12:11.133105 17332 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:11.134516 23481 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:11.134974 23481 raft_consensus.cc:493] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:11.135370 23481 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:11.138622 17406 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:11.139092 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:11.135185 23413 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:11.163554 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.166013 23384 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:11.166738 23384 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:11.174942 17332 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:11.177553 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:11.176586 23384 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:11.179390 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:11.180214 23384 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.181048 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:11.181767 18015 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:12:11.182009 23481 raft_consensus.cc:515] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:11.183276 17437 raft_consensus.cc:2393] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 in current term 15: Already voted for candidate e860f7e876b74ec589f447737822a4f6 in this term.
I20260709 12:12:11.184680 17361 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:12:11.188162 17333 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:11.189738 23413 raft_consensus.cc:3060] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:11.219378 17333 consensus_peers.cc:597] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7130b980d9147f2b3915212d4028e03. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.196816 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.233538 23481 leader_election.cc:290] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:11.237288 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb339cd935184a289cfac7d49d2f74d3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
W20260709 12:12:11.237721 17406 leader_election.cc:336] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:11.240408 17440 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:11.201457 23413 raft_consensus.cc:2749] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.257372 17363 raft_consensus.cc:2468] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
W20260709 12:12:11.242769 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.258973 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.246336 23384 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:12:11.275564 17404 leader_election.cc:304] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:11.277117 23472 raft_consensus.cc:2804] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:11.277657 23472 raft_consensus.cc:697] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:12:11.278733 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.279891 23472 consensus_queue.cc:237] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:11.280360 23413 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
W20260709 12:12:11.286954 17332 consensus_peers.cc:597] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.286799 23413 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:11.291077 17363 raft_consensus.cc:1275] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:11.298794 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.307832 23481 consensus_queue.cc:1048] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:11.313987 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.314273 23413 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:11.318687 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:11.319408 17439 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:12:11.320825 23481 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:11.321425 17333 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:11.321496 23481 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:11.334983 17332 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:11.337146 16125 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17313)
I20260709 12:12:11.325264 23413 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.338182 23413 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:11.338605 23413 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.361261 17182 catalog_manager.cc:5697] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 14 to 15, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 15 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:11.366513 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.372041 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.377533 23481 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:11.378703 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:11.379392 18006 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
W20260709 12:12:11.381927 17406 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:11.393934 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.393671 23413 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:11.397078 23496 raft_consensus.cc:2955] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:12:11.400619 23413 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:11.402650 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:11.403287 17440 raft_consensus.cc:3060] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.404309 17332 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:11.416146 17439 raft_consensus.cc:2955] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:12:11.424062 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:11.424773 17363 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:12:11.429360 17437 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:12:11.436755 17404 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:11.437626 23480 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.438012 23480 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 33539b233c2044afa31017244f6cc0d1)
I20260709 12:12:11.440955 23480 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.446581 17186 catalog_manager.cc:5697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 10, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 16 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:11.451097 17406 consensus_peers.cc:597] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.453696 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.447654 17440 raft_consensus.cc:2468] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:12:11.462410 17333 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:11.463666 23538 raft_consensus.cc:2804] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:11.464181 23538 raft_consensus.cc:697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:11.465106 23538 consensus_queue.cc:237] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:11.475387 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.481195 17407 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 539116186b9c4b269f16afb90a4654f4. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.485517 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.506701 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.507136 23480 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:11.518636 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:11.519258 18006 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.525882 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.526213 23480 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Requested vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:11.528266 17360 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:12:11.530393 17406 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:11.530676 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:11.531324 17360 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.542654 17360 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:12:11.543746 17186 catalog_manager.cc:5697] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 15 to 16, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 16 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.548309 23543 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:11.555986 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.559321 23541 raft_consensus.cc:2955] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:12:11.562602 17363 raft_consensus.cc:2955] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:12:11.582901 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.581844 18006 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:12:11.588114 17407 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1
I20260709 12:12:11.589015 23543 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:11.589531 23543 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:11.590761 23543 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:11.593312 17238 auto_rebalancer.cc:629] Failed to schedule move for tablet 51f32408cb854e64a70dc3560f27b02e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:12:11.599421 17437 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:12:11.607954 17186 catalog_manager.cc:5697] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index -1 to 10, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 14 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:11.611533 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.628427 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:11.633232 17363 raft_consensus.cc:1275] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:11.636621 23543 consensus_queue.cc:1048] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:11.642055 17361 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:11.644120 23481 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:11.651324 17407 consensus_peers.cc:597] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 -> Peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143): Couldn't send request to peer 868a5e341d0a41b4ac0927342c8cd598. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6c49969609c4c85a0a31036764369c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.720013 23543 raft_consensus.cc:2955] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:12:11.723764 17406 consensus_peers.cc:597] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.723454 17186 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 15 to 16, leader changed from 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 16 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.733390 17360 raft_consensus.cc:2955] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
I20260709 12:12:11.758200 17182 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index -1 to 11, NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) added. New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } } }
W20260709 12:12:11.766636 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.789701 23549 ts_tablet_manager.cc:933] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:11.808004 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.832046 23549 tablet_copy_client.cc:323] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.66:35675
W20260709 12:12:11.848337 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.851656 17363 raft_consensus.cc:1275] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:11.852125 17377 tablet_copy_service.cc:140] P aaafaad0810b4e95983d2d73ec814346: Received BeginTabletCopySession request for tablet f7130b980d9147f2b3915212d4028e03 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:34702)
I20260709 12:12:11.852967 17377 tablet_copy_service.cc:161] P aaafaad0810b4e95983d2d73ec814346: Beginning new tablet copy session on tablet f7130b980d9147f2b3915212d4028e03 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:34702: session id = 868a5e341d0a41b4ac0927342c8cd598-f7130b980d9147f2b3915212d4028e03
I20260709 12:12:11.853899 23466 consensus_queue.cc:1048] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:11.865772 17377 tablet_copy_source_session.cc:215] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:12:11.870559 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.871719 23549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7130b980d9147f2b3915212d4028e03. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:11.903223 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.908308 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.928210 17437 raft_consensus.cc:1275] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:11.930392 23413 consensus_queue.cc:1048] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:11.944006 23553 ts_tablet_manager.cc:933] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:11.957008 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.969537 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.976855 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.984530 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.988669 18014 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:11.991168 23543 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:11.991724 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:12.011970 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:12.023448 23549 tablet_copy_client.cc:806] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:12.027549 23549 tablet_copy_client.cc:670] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:12.044543 23553 tablet_copy_client.cc:323] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:12:12.046885 17450 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet 539116186b9c4b269f16afb90a4654f4 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:12:12.047488 17450 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet 539116186b9c4b269f16afb90a4654f4 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-539116186b9c4b269f16afb90a4654f4
I20260709 12:12:12.059223 17450 tablet_copy_source_session.cc:215] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:12.059651 23549 tablet_copy_client.cc:538] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:12:12.100406 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:12.102355 23553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539116186b9c4b269f16afb90a4654f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:12.142858 23549 tablet_bootstrap.cc:492] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:12:12.185930 23553 tablet_copy_client.cc:806] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:12.197726 23553 tablet_copy_client.cc:670] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
W20260709 12:12:12.203896 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:12.207425 17363 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:12.207729 23553 tablet_copy_client.cc:538] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:12.209436 23543 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:12.230856 17406 consensus_peers.cc:597] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:12.234268 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:12.235375 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:12.249536 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:12.249423 23553 tablet_bootstrap.cc:492] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
I20260709 12:12:12.294701 23559 ts_tablet_manager.cc:933] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: Initiating tablet copy from peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:12.337685 16125 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 17313)
I20260709 12:12:12.352169 23559 tablet_copy_client.cc:323] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Beginning tablet copy session from remote peer at address 127.15.191.67:34917
I20260709 12:12:12.359236 23549 tablet_bootstrap.cc:492] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:12.359815 17450 tablet_copy_service.cc:140] P e860f7e876b74ec589f447737822a4f6: Received BeginTabletCopySession request for tablet d6c49969609c4c85a0a31036764369c0 from peer 868a5e341d0a41b4ac0927342c8cd598 ({username='slave'} at 127.0.0.1:52714)
I20260709 12:12:12.360486 17450 tablet_copy_service.cc:161] P e860f7e876b74ec589f447737822a4f6: Beginning new tablet copy session on tablet d6c49969609c4c85a0a31036764369c0 from peer 868a5e341d0a41b4ac0927342c8cd598 at {username='slave'} at 127.0.0.1:52714: session id = 868a5e341d0a41b4ac0927342c8cd598-d6c49969609c4c85a0a31036764369c0
I20260709 12:12:12.374040 17450 tablet_copy_source_session.cc:215] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:12.377681 23549 tablet_bootstrap.cc:492] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:12:12.378599 23549 ts_tablet_manager.cc:1403] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.236s	user 0.038s	sys 0.036s
I20260709 12:12:12.381927 23559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c49969609c4c85a0a31036764369c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:12.381752 23549 raft_consensus.cc:359] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:12:12.382682 23549 raft_consensus.cc:740] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:12:12.383406 23549 consensus_queue.cc:260] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:12:12.394713 23549 ts_tablet_manager.cc:1434] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:12:12.396876 17377 tablet_copy_service.cc:342] P aaafaad0810b4e95983d2d73ec814346: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-f7130b980d9147f2b3915212d4028e03 received from {username='slave'} at 127.0.0.1:34702
I20260709 12:12:12.397356 17377 tablet_copy_service.cc:434] P aaafaad0810b4e95983d2d73ec814346: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-f7130b980d9147f2b3915212d4028e03 on tablet f7130b980d9147f2b3915212d4028e03 with peer 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:12:12.437938 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:12.453015 23559 tablet_copy_client.cc:806] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:12.453792 23559 tablet_copy_client.cc:670] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:12.461231 23559 tablet_copy_client.cc:538] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:12.470175 23559 tablet_bootstrap.cc:492] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap starting.
W20260709 12:12:12.589450 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:12.592620 23553 tablet_bootstrap.cc:492] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:12.593637 23553 tablet_bootstrap.cc:492] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:12:12.594408 23553 ts_tablet_manager.cc:1403] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.345s	user 0.028s	sys 0.018s
I20260709 12:12:12.597832 23553 raft_consensus.cc:359] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:12:12.618300 23553 raft_consensus.cc:740] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:12:12.619169 23553 consensus_queue.cc:260] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:12:12.623342 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:12.635317 23553 ts_tablet_manager.cc:1434] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 12:12:12.674373 17450 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-539116186b9c4b269f16afb90a4654f4 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:12:12.674928 17450 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-539116186b9c4b269f16afb90a4654f4 on tablet 539116186b9c4b269f16afb90a4654f4 with peer 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:12:12.672812 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 49528us
I20260709 12:12:12.727450 23559 tablet_bootstrap.cc:492] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:12.738921 23559 tablet_bootstrap.cc:492] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: Bootstrap complete.
I20260709 12:12:12.746243 23559 ts_tablet_manager.cc:1403] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent bootstrapping tablet: real 0.276s	user 0.042s	sys 0.009s
I20260709 12:12:12.768910 23559 raft_consensus.cc:359] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
I20260709 12:12:12.769922 23559 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Initialized, Role: LEARNER
I20260709 12:12:12.770766 23559 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: NON_VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: true } }
W20260709 12:12:12.775324 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:12.783248 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:12.786561 23559 ts_tablet_manager.cc:1434] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 12:12:12.788683 17450 tablet_copy_service.cc:342] P e860f7e876b74ec589f447737822a4f6: Request end of tablet copy session 868a5e341d0a41b4ac0927342c8cd598-d6c49969609c4c85a0a31036764369c0 received from {username='slave'} at 127.0.0.1:52714
I20260709 12:12:12.789124 17450 tablet_copy_service.cc:434] P e860f7e876b74ec589f447737822a4f6: ending tablet copy session 868a5e341d0a41b4ac0927342c8cd598-d6c49969609c4c85a0a31036764369c0 on tablet d6c49969609c4c85a0a31036764369c0 with peer 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:12.906889 18006 raft_consensus.cc:1217] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 12:12:12.947387 18006 raft_consensus.cc:1217] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 12:12:13.076460 18006 raft_consensus.cc:1217] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
W20260709 12:12:13.338202 16125 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:13.409309 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:13.413101 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.476804 23481 raft_consensus.cc:1064] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:12:13.479661 23481 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:13.508251 23538 raft_consensus.cc:1064] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:12:13.511183 23538 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:13.544507 18006 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:13.545858 23541 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:13.576566 18006 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEARNER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:13.578181 23534 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:13.591665 23543 raft_consensus.cc:1064] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: attempting to promote NON_VOTER 868a5e341d0a41b4ac0927342c8cd598 to VOTER
I20260709 12:12:13.592100 17440 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:13.594564 23543 consensus_queue.cc:237] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:13.603345 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:13.621063 23534 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:13.668206 17363 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:13.670624 23541 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:13.683223 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:13.697760 17332 consensus_peers.cc:597] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.704952 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:13.709646 18014 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEARNER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:13.711129 17361 raft_consensus.cc:1275] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:12:13.713850 17406 consensus_peers.cc:597] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.713749 23569 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:13.716809 23566 consensus_queue.cc:1048] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:13.725293 23574 raft_consensus.cc:2955] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:13.739604 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:13.740203 17440 raft_consensus.cc:2955] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:13.746812 23572 raft_consensus.cc:2955] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:13.749210 17361 raft_consensus.cc:2955] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:13.769229 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:13.779332 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:13.782138 18007 raft_consensus.cc:2955] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:13.786612 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.798578 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:13.800524 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.810640 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:13.811760 18015 raft_consensus.cc:2955] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:13.823642 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:13.823500 17186 catalog_manager.cc:5697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 10 to 11, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.840562 17188 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 11 to 12, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.849114 23566 raft_consensus.cc:2955] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:13.856488 17363 raft_consensus.cc:2955] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:13.887859 18015 raft_consensus.cc:2955] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:13.897311 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:13.999286 17363 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:14.017704 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:14.044620 18015 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:14.046260 23538 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:14.052604 17440 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:14.054453 23580 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:14.083948 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:14.085345 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:14.090737 17186 catalog_manager.cc:5697] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 10 to 11, 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:14.092027 23574 raft_consensus.cc:2955] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:14.099478 18007 raft_consensus.cc:2955] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:14.114254 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:14.133665 17437 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:14.135578 17440 raft_consensus.cc:2955] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:14.142154 18015 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:14.143980 17363 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:14.145689 23566 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:14.148696 23481 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:14.156780 23543 raft_consensus.cc:2955] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:14.163009 18007 raft_consensus.cc:2955] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:14.173151 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:14.178645 17363 raft_consensus.cc:2955] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:14.187616 17174 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7130b980d9147f2b3915212d4028e03 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:12:14.199309 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:14.223721 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d6c49969609c4c85a0a31036764369c0 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:14.244186 17188 catalog_manager.cc:5697] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 11 to 12, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 16 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:14.257364 17177 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet d6c49969609c4c85a0a31036764369c0 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 12 but the committed config has opid_index of 13
W20260709 12:12:14.270249 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.270911 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.284536 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:14.284997 17188 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: config changed from index 12 to 13, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:14.300347 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.338740 16125 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:14.352705 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f7130b980d9147f2b3915212d4028e03: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:14.385526 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.414561 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:14.451282 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.469226 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.477958 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:14.505550 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.552889 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.555994 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.552868 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.596662 17406 consensus_peers.cc:597] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:14.604892 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.640892 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.656203 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.686757 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 52466.5us
W20260709 12:12:14.719506 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.813016 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.972791 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:15.118558 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.133087 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:15.314402 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:15.325022 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:15.339269 16125 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:15.404333 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:15.513335 17980 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111) [suppressed 479 similar messages]
W20260709 12:12:15.543047 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f7130b980d9147f2b3915212d4028e03: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:15.735432 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.782019 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:15.925683 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.107177 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.137382 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.265443 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.280205 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.297644 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.313380 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.339772 16125 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:16.347904 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.376032 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.395493 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:16.407497 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.408126 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.548300 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.561480 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.614362 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.619555 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f7130b980d9147f2b3915212d4028e03: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:16.627475 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.647886 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.672650 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:16.734863 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.752077 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.753813 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.754670 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.768241 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.908073 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.908630 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.919019 17406 consensus_peers.cc:597] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.955341 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:16.958289 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.033238 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 51821us
W20260709 12:12:17.046599 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:17.086247 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.111133 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.162693 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.179991 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.236249 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.241176 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.340276 16125 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:17.526800 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.581638 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.640189 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.642848 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:17.645506 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.667922 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:17.687999 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:18.027536 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:18.191318 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:18.270392 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.340930 16125 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:18.395505 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:18.526775 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:18.534482 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:18.574605 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:18.724035 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f7130b980d9147f2b3915212d4028e03: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:18.753629 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:18.817447 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:18.931437 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:18.938910 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:18.975515 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.022214 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:19.024019 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.027868 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.049467 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.075269 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:19.080977 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.092141 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.128001 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.137496 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.161695 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.220126 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:19.237152 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:19.290962 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.341456 16125 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:19.365430 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.420800 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.434195 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.452745 17406 consensus_peers.cc:597] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:19.496035 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.524010 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 133032us
W20260709 12:12:19.528038 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.545779 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 70208.9us
W20260709 12:12:19.715159 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.737726 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.745622 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.773382 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.803637 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:19.850383 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.901981 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.983958 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.997347 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:19.998859 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:20.016259 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.203177 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 51355.8us
W20260709 12:12:20.276036 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:20.302407 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:20.304250 17437 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:20.317024 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:20.333667 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 55560.5us
W20260709 12:12:20.342249 16125 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 17313)
I20260709 12:12:20.346189 18006 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:20.351734 23614 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:20.368920 17360 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:20.383018 23481 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:20.395337 23600 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:12:20.436285 18014 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:20.476753 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:20.488534 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c41ebef06654a43a98e69d0c065bba4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 12:12:20.513029 17182 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 3 to 12, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New cstate: current_term: 16 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:20.520753 17363 raft_consensus.cc:2955] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER 33539b233c2044afa31017244f6cc0d1 (127.15.191.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:20.537393 17332 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111) [suppressed 452 similar messages]
W20260709 12:12:20.722872 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:20.764400 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.823305 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1c41ebef06654a43a98e69d0c065bba4: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:20.893512 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 54723.3us
W20260709 12:12:20.951606 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.110437 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.111153 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.185722 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.267195 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.342810 16125 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:21.420944 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.441298 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.454319 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.490402 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.534907 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.609951 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.621887 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.622037 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:21.643206 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:21.653910 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:21.672851 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.687368 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.723058 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.728176 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.781929 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:21.804904 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:21.823505 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.906994 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.957440 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:21.960376 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.018044 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.058393 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.092355 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.153440 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:22.179818 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.181605 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1c41ebef06654a43a98e69d0c065bba4: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:22.237515 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.265966 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.318500 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:22.343348 16125 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:22.355965 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.398186 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.416546 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.450773 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.461647 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.533934 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.577767 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:22.578382 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:23.018428 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:23.080030 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 48919.6us
W20260709 12:12:23.108721 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.121812 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 94479.2us
W20260709 12:12:23.225960 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1c41ebef06654a43a98e69d0c065bba4: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:23.343848 16125 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:23.400974 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:23.668753 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:23.671264 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:23.699826 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:23.875880 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:23.884671 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:23.927983 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:23.936385 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:23.941335 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:23.948148 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.958237 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.148977 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.160063 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:24.188208 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.227419 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:24.230710 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.263563 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:24.271090 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.302454 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:24.339836 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.344388 16125 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:24.354223 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.384687 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.411059 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.428727 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.509328 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.538618 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.624382 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.637531 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:24.823246 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.866385 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.868803 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:24.891674 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:25.104630 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:25.172935 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:25.194861 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:25.284459 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:25.334527 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:25.345006 16125 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:25.366494 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:25.372393 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:25.373235 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:25.377403 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1c41ebef06654a43a98e69d0c065bba4: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:25.391536 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:25.550793 17980 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111) [suppressed 438 similar messages]
W20260709 12:12:25.564301 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:25.566990 18007 consensus_queue.cc:237] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:25.705533 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.711094 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 81886.1us
I20260709 12:12:25.737748 17440 raft_consensus.cc:1275] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:25.739486 23641 consensus_queue.cc:1048] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:25.740726 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:25.776119 23617 raft_consensus.cc:2955] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 7 to 13, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:25.781442 17437 raft_consensus.cc:2955] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 7 to 13, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
I20260709 12:12:25.838508 17188 catalog_manager.cc:5697] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 reported cstate change: config changed from index 7 to 13, VOTER aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) evicted. New cstate: current_term: 17 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } } }
W20260709 12:12:25.865228 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 68215us
W20260709 12:12:26.546828 23657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.000s	sys 0.013s
W20260709 12:12:26.547480 23657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.000s	sys 0.014s
I20260709 12:12:26.915524 23665 raft_consensus.cc:493] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:26.916352 23665 raft_consensus.cc:515] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:26.946985 23664 raft_consensus.cc:493] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:26.947706 23664 raft_consensus.cc:515] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:26.950625 23664 leader_election.cc:290] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.030226 23664 raft_consensus.cc:493] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.030846 23664 raft_consensus.cc:515] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.033121 23664 leader_election.cc:290] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:26.998392 23665 leader_election.cc:290] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.102463 23665 raft_consensus.cc:493] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.103235 23665 raft_consensus.cc:515] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.105724 23665 leader_election.cc:290] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.148161 23665 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:27.283197 23608 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.289625 23665 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.289729 23608 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.294991 23665 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.294914 23667 raft_consensus.cc:493] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.295904 23667 raft_consensus.cc:515] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.296608 23608 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.304607 23668 raft_consensus.cc:493] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.306557 23650 raft_consensus.cc:493] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.309382 23650 raft_consensus.cc:515] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.311923 23650 leader_election.cc:290] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.312570 23650 raft_consensus.cc:493] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.313140 23650 raft_consensus.cc:515] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.316435 23650 leader_election.cc:290] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.308667 23664 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:27.318413 23664 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.320618 23664 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:27.306850 23668 raft_consensus.cc:515] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.323319 23668 leader_election.cc:290] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.330812 23664 raft_consensus.cc:493] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.332980 23664 raft_consensus.cc:515] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.335364 23664 leader_election.cc:290] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.332145 23650 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:27.336691 23650 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.339411 23650 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:27.331321 23665 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:27.341320 23665 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.343871 23665 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:27.340579 23668 raft_consensus.cc:493] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.331772 23608 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:27.345340 23608 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.347553 23608 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:27.348711 23668 raft_consensus.cc:515] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.351615 23668 leader_election.cc:290] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.352236 23668 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.352813 23668 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.355652 23668 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.356240 23668 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.356773 23668 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.358971 23668 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.359548 23668 raft_consensus.cc:493] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.360069 23668 raft_consensus.cc:515] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.362231 23668 leader_election.cc:290] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.291491 23666 raft_consensus.cc:493] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.666299 23666 raft_consensus.cc:515] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.668850 23666 leader_election.cc:290] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.733382 23667 leader_election.cc:290] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.770603 17437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52714 (request call id 1809) took 1145 ms. Trace:
I20260709 12:12:27.771147 17437 rpcz_store.cc:276] 0709 12:12:26.624939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.769678 (+1144739us) service_pool.cc:224] Handling call
0709 12:12:27.770052 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.770282 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.770308 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:27.770347 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:27.770376 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.770413 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.770542 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:27.786141 16125 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:27.786190 17462 debug-util.cc:398] Leaking SignalData structure 0x7b0800282780 after lost signal to thread 16128
I20260709 12:12:27.808495 23608 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:27.809159 23608 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.810381 23638 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:27.811211 23608 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:27.810948 23638 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.811683 23608 raft_consensus.cc:493] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.812114 23608 raft_consensus.cc:515] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.813022 23638 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:27.816669 17177 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee22d4e5e05e423097297625d6158f21 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 12:12:27.813963 23608 leader_election.cc:290] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:27.820416 17333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.004s	sys 0.031s
W20260709 12:12:27.820806 17333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.005s	sys 0.032s
I20260709 12:12:27.824319 23668 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.824891 23668 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.830777 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0e960dcac478bbf09add686ea3b3c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.832952 23652 raft_consensus.cc:493] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.833338 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.833539 23652 raft_consensus.cc:515] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.834403 23669 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.834983 23669 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.836066 23652 leader_election.cc:290] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.837212 23669 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.832801 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.840021 23668 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.837841 23652 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.841882 23652 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.844333 23652 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.860726 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.862447 23617 raft_consensus.cc:493] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.863571 23617 raft_consensus.cc:515] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.869088 23641 raft_consensus.cc:493] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.873097 23649 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.873926 23668 raft_consensus.cc:493] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.874449 23668 raft_consensus.cc:515] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.875685 23666 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.876322 23666 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.876696 23668 leader_election.cc:290] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.873747 23649 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.881780 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.869851 23641 raft_consensus.cc:515] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.885205 23641 leader_election.cc:290] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.887570 23649 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.892544 23666 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.860788 23673 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.902624 23673 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.902351 23641 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.911437 23617 leader_election.cc:290] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.912135 23651 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.912899 23651 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:27.916509 17188 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.075s	user 0.009s	sys 0.027s
I20260709 12:12:27.917095 23651 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:27.922036 17188 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.080s	user 0.010s	sys 0.027s
I20260709 12:12:27.922076 23652 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.923041 23652 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.925221 23652 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.928458 23673 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.929158 23673 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:12:27.939021 17462 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb840 after lost signal to thread 17224
W20260709 12:12:27.940598 17462 debug-util.cc:398] Leaking SignalData structure 0x7b080019c920 after lost signal to thread 17391
W20260709 12:12:27.940905 17462 debug-util.cc:398] Leaking SignalData structure 0x7b080019c800 after lost signal to thread 17392
I20260709 12:12:27.942577 23668 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.943216 17188 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55944 (request call id 353) took 2111 ms. Trace:
W20260709 12:12:27.943440 17462 debug-util.cc:398] Leaking SignalData structure 0x7b080014a6a0 after lost signal to thread 17465
I20260709 12:12:27.944139 23649 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.944646 23671 raft_consensus.cc:493] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.943259 23668 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.944823 23640 raft_consensus.cc:493] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.945261 23671 raft_consensus.cc:515] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.945503 23640 raft_consensus.cc:515] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } attrs { replace: true } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.946775 23668 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.948366 23668 raft_consensus.cc:493] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.948511 23640 leader_election.cc:290] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:27.943894 17462 debug-util.cc:398] Leaking SignalData structure 0x7b08001cdfe0 after lost signal to thread 17466
I20260709 12:12:27.948908 23668 raft_consensus.cc:515] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.951081 23668 leader_election.cc:290] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.950759 23649 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.952967 23649 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:27.950453 17462 debug-util.cc:398] Leaking SignalData structure 0x7b080013d1e0 after lost signal to thread 18039
W20260709 12:12:27.965628 17462 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9800 after lost signal to thread 18040
I20260709 12:12:27.966307 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.920869 23641 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.957801 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:27.968492 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 51049us
I20260709 12:12:27.929705 23673 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.950395 23671 leader_election.cc:290] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.971071 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.943670 17188 rpcz_store.cc:276] 0709 12:12:25.831727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.831928 (+   201us) service_pool.cc:224] Handling call
0709 12:12:27.922543 (+2090615us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:27.922574 (+    31us) write_op.cc:454] Released schema lock
0709 12:12:27.943128 (+ 20554us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:25.914881 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:25.915531 (+   650us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:25.915562 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:12:25.915584 (+    22us) tablet.cc:662] Decoding operations
0709 12:12:25.915957 (+   373us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:25.916048 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:25.916084 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:25.916274 (+   190us) tablet.cc:701] Row locks acquired
0709 12:12:25.916291 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:12:25.916439 (+   148us) write_op.cc:270] Start()
0709 12:12:25.916542 (+   103us) write_op.cc:276] Timestamp: P: 1783599145916377 usec, L: 0
0709 12:12:25.916561 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:12:25.917283 (+   722us) log.cc:844] Serialized 536 byte log entry
0709 12:12:26.549743 (+632460us) op_driver.cc:464] REPLICATION: finished
0709 12:12:26.613969 (+ 64226us) write_op.cc:301] APPLY: starting
0709 12:12:26.614067 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:26.617354 (+  3287us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:26.617505 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:26.618292 (+   787us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:26.618486 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:12:26.618534 (+    48us) write_op.cc:312] APPLY: finished
0709 12:12:26.618787 (+   253us) log.cc:844] Serialized 25 byte log entry
0709 12:12:26.618974 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:26.619065 (+    91us) write_op.cc:454] Released schema lock
0709 12:12:26.619106 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:27.891490 (+1272384us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b54000762d4. stack: 00007f12229fc343 00007f12229fc240 00007f122238b1d4 00007f122c0c9304 00007f122c0c9299 00007f1225a84571 00007f1225b1832a 00007f1225a9df14 00007f1225a9dec3 00007f1225a9de38 00007f1225a9ddf3 00007f1225a9d0dc 00007f1225ac6e16 00007f1225aaecbb 00007f1225a9939d 00007f1225a9cd75
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":229632,"child_traces":[["op",{"apply.queue_time_us":63896,"apply.run_cpu_time_us":3614,"apply.run_wall_time_us":5528,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":73169,"prepare.run_cpu_time_us":16463,"prepare.run_wall_time_us":633293,"raft.queue_time_us":478418,"raft.run_cpu_time_us":30113,"raft.run_wall_time_us":1348952,"replication_time_us":632981,"spinlock_wait_cycles":15447936,"thread_start_us":3253789,"threads_started":4,"wal-append.queue_time_us":144939,"wal-append.run_cpu_time_us":5992,"wal-append.run_wall_time_us":1557339}]]}
I20260709 12:12:27.973842 23617 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.978542 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.982311 23654 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:27.982980 23654 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.983553 23641 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.973829 23649 raft_consensus.cc:493] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:27.985069 23649 raft_consensus.cc:515] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.987375 23649 leader_election.cc:290] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:27.987352 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.988283 23684 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.988999 23684 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:27.989564 17440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.990199 17440 raft_consensus.cc:1813] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Handling vote request from an unknown peer aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:27.990727 17440 raft_consensus.cc:2410] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaafaad0810b4e95983d2d73ec814346 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:12:27.992373 23617 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:27.987948 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44e7f48dd474ca1a12a7ac7251f4c6f" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.987283 23676 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.993999 23641 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:27.991194 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6685bf7292cc44e09a9965668c0345cc" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.000967 23617 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:27.993698 23638 raft_consensus.cc:493] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:28.001431 23676 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.001744 23638 raft_consensus.cc:515] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.002794 23675 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.002992 23684 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.003405 23675 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.003865 23676 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.005303 23676 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.001876 23641 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.006302 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:27.999558 23671 raft_consensus.cc:493] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.007680 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.007543 23671 raft_consensus.cc:515] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:28.008563 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:27.998883 23666 raft_consensus.cc:493] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.009202 18007 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:12:28.009403 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d769dc29730489bb1bc366ea38bf391" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.009649 23671 leader_election.cc:290] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.008014 23641 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.011189 23641 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:28.010948 23666 raft_consensus.cc:515] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:28.011688 23641 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.012068 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9108b2dade34abca8d8b1d985d2dc05" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.013346 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.013727 23641 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:27.998150 23668 raft_consensus.cc:493] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:28.005781 23676 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.010540 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7912262477ba4fc0a074c658eed0d241" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.014532 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c3705a9e0e457898a7061b4170a8a1" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.015964 23666 leader_election.cc:290] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.016151 23676 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.016279 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814b69784b0f4c3d8b07d13d54ae4b47" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.014688 23668 raft_consensus.cc:515] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.018743 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9955d24ad7243689a5a438424f992e9" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.019029 23668 leader_election.cc:290] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:28.020082 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9356b25ee58416ca89b944be6f0b562" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.019948 23654 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.020936 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.016685 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.022091 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.022509 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.014421 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.005647 23675 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:28.025439 18013 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
I20260709 12:12:28.033200 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539116186b9c4b269f16afb90a4654f4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.010643 23638 leader_election.cc:290] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:28.032013 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.034144 17358 raft_consensus.cc:2468] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:12:28.039501 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.039896 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.040210 18007 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 11.
I20260709 12:12:28.040665 18015 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
I20260709 12:12:28.041272 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.041883 18014 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
I20260709 12:12:28.040161 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.043179 18006 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 14.
I20260709 12:12:28.045150 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90fb9f510d4f0abcf7148b6fafae89" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.046078 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbcd6d92bbd4175a2f8233eb40726ad" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.046574 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.046923 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4198acb44a394602a442737d55022d72" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.047272 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.046455 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.047538 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4466b54543584a9898797997087d10f1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.048955 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.042395 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee22d4e5e05e423097297625d6158f21" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:12:28.048308 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 48496us
I20260709 12:12:28.058063 17356 tablet_service.cc:1558] Processing DeleteTablet for tablet ee22d4e5e05e423097297625d6158f21 with delete_type TABLET_DATA_TOMBSTONED (TS aaafaad0810b4e95983d2d73ec814346 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37556
I20260709 12:12:28.065027 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e731eb30ed4f36ab13505e2cad7085" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.066221 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.066414 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.066614 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8789c06ba7714e709d794ce12c4141d1" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.069826 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119706da80854a2680f098d29fac4c43" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.050868 23679 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.074595 23679 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.082440 18012 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 16.
I20260709 12:12:28.089305 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.090051 17358 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:12:28.095111 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.096074 17360 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 14.
I20260709 12:12:28.097873 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.098296 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.100281 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.101454 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.102267 17359 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:12:28.100893 17361 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 11.
I20260709 12:12:28.103276 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.101549 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.103663 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74c08559a64593bfe9cdc08a3b96d1" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.114358 23679 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.115412 23673 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.102618 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.119448 17360 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:12:28.125491 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9367e72dd7c24f7e8aa4d479a069ed0e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.127012 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f5a9a5a773414fa979e4e68b31bb5d" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.128870 23682 raft_consensus.cc:493] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:28.129496 23682 raft_consensus.cc:515] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.132179 23682 leader_election.cc:290] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:28.133491 23682 raft_consensus.cc:493] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:28.134047 23682 raft_consensus.cc:515] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.137264 23682 leader_election.cc:290] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:28.138805 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 50024.9us
W20260709 12:12:28.161186 17332 leader_election.cc:336] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.165210 17332 leader_election.cc:336] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.169343 17332 leader_election.cc:336] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.171662 17332 leader_election.cc:336] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.172338 17332 leader_election.cc:336] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.173657 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f32408cb854e64a70dc3560f27b02e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.179956 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.180212 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:28.180641 17332 leader_election.cc:336] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.182663 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f462146b97ed46f2821bee27630d0218" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.182852 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72f5fa94fdd4fedb64a0e5db13dc3a5" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.188705 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:28.178438 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 84050us
I20260709 12:12:28.191988 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.193215 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.193812 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:28.198482 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8832d652d7004314892ca1c18bd94f7c" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:12:28.199550 17980 leader_election.cc:336] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.200030 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31ef54befbd4be3b1626005e275d427" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.200137 17980 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.200181 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.201144 23681 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.199438 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:28.202046 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:28.202584 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:28.203099 17980 leader_election.cc:336] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.201174 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.203541 17980 leader_election.cc:304] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:28.204943 17980 leader_election.cc:336] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.205464 23679 raft_consensus.cc:2749] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:28.206985 23688 tablet_replica.cc:333] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:28.208228 23688 raft_consensus.cc:2243] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:28.208963 23688 raft_consensus.cc:2272] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:28.207948 17332 leader_election.cc:336] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.212587 17332 leader_election.cc:336] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.213071 17332 leader_election.cc:336] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.213740 17332 leader_election.cc:336] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.214226 17332 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.219269 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a366d5769a4ed9bb2b1e32afb26cd3" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.220456 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3d142442b4e3aada6416cb667a95b" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.220436 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfe00a9196e4e49a4ad7e72acd36c08" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:28.221692 17332 leader_election.cc:336] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.222177 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fb1d5d8c204d70a68af6043f3ba9dd" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:28.222306 17332 leader_election.cc:336] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.222977 17332 leader_election.cc:336] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.223596 17332 leader_election.cc:336] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.224119 17332 leader_election.cc:336] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.224547 17406 leader_election.cc:336] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.225085 17406 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.225903 23665 raft_consensus.cc:2749] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.226336 17978 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.224551 17332 leader_election.cc:304] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:28.227945 17406 leader_election.cc:336] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.228168 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d582e1abf9be42689682da4cee6206c8" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:28.228780 23675 raft_consensus.cc:2749] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.230175 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.231829 23679 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:28.232213 23679 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.232558 23679 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.235948 17978 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.236855 23681 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.238217 17978 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.242578 23681 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.246152 17333 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.247108 23675 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:28.248137 23679 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.230753 17406 leader_election.cc:304] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:12:28.259042 17406 leader_election.cc:336] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.259545 17406 leader_election.cc:304] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:12:28.230315 17332 leader_election.cc:336] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.260157 17332 leader_election.cc:304] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.249208 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3673757d03f243668794c10285c7d1ff" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:28.249485 17333 leader_election.cc:304] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.260265 23650 raft_consensus.cc:2749] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.260905 23665 raft_consensus.cc:2749] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:28.261066 17333 raft_consensus.cc:2686] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:28.228876 23678 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.261806 23678 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.262012 17333 leader_election.cc:304] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.262518 23678 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.263252 17333 leader_election.cc:304] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:28.260473 17406 leader_election.cc:336] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.264407 17406 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.264894 17406 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.265317 17406 leader_election.cc:336] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.265918 17406 leader_election.cc:336] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.266413 17406 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:28.266889 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:28.267798 17406 leader_election.cc:336] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.268184 17406 leader_election.cc:304] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.268538 23688 ts_tablet_manager.cc:1916] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:28.269019 23675 raft_consensus.cc:2749] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.269793 23675 raft_consensus.cc:2749] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:28.270417 23650 raft_consensus.cc:2749] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:28.271330 17333 leader_election.cc:304] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.272101 23666 raft_consensus.cc:2749] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:28.274179 23678 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.276226 17333 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.278733 23666 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.280347 17333 leader_election.cc:304] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.281188 23666 raft_consensus.cc:2749] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.281181 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.282743 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e0aa678a447dcab13573f3577208e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
W20260709 12:12:28.287168 17406 leader_election.cc:336] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.287281 23678 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.287817 17406 leader_election.cc:304] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.288679 23650 raft_consensus.cc:2749] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:28.288798 17406 leader_election.cc:336] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.289345 17406 leader_election.cc:304] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.290199 23650 raft_consensus.cc:2749] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:12:28.290508 17406 leader_election.cc:336] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.290570 17333 leader_election.cc:304] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.295418 23666 raft_consensus.cc:2749] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:28.296386 23666 raft_consensus.cc:2749] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:28.297228 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 66941.3us
W20260709 12:12:28.297770 17332 leader_election.cc:336] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.291168 17406 leader_election.cc:304] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.299098 23650 raft_consensus.cc:2749] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:28.299098 17406 leader_election.cc:336] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.300202 17406 leader_election.cc:304] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.301618 23643 raft_consensus.cc:2749] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:28.298156 17332 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.303092 23675 raft_consensus.cc:2749] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:28.304178 17332 leader_election.cc:336] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.304597 17333 leader_election.cc:304] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.307577 23675 raft_consensus.cc:2749] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:28.306062 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.312094 17978 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.312831 23678 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:28.313987 23678 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.310781 17333 leader_election.cc:304] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
W20260709 12:12:28.314488 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:28.315071 17406 leader_election.cc:336] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:28.315150 23675 raft_consensus.cc:2749] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:28.315486 17406 leader_election.cc:304] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.314508 23678 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.317286 23685 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:28.317715 23685 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.318087 23685 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:28.316627 23643 raft_consensus.cc:2749] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:28.323021 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.324194 17978 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.325448 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.316807 17333 leader_election.cc:304] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.327051 23675 raft_consensus.cc:2749] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.327105 23643 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.328692 23681 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:28.329854 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.330416 17978 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.332155 23678 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.343406 17333 leader_election.cc:304] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.344077 23678 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.345288 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.344241 23681 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.328787 23679 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:28.337601 17404 leader_election.cc:304] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.347249 23643 raft_consensus.cc:2749] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:28.347923 17404 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.348814 23643 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:28.349181 17404 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.349897 23643 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.353240 17404 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.354027 23650 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.354592 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.355381 23650 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.355867 17404 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.356601 23650 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.357100 17404 leader_election.cc:304] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.359373 23643 raft_consensus.cc:2749] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.360543 23675 raft_consensus.cc:2749] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:28.345293 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.362272 17333 leader_election.cc:304] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.369002 17404 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.369704 23675 raft_consensus.cc:2749] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.372323 23665 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:28.365984 23685 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.374580 23685 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:28.312119 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:28.375515 17332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 63460.1us
I20260709 12:12:28.375644 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.370972 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.379177 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.380741 23679 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.382023 23681 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:28.382454 23681 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.382838 23681 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:28.385893 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.394147 17404 leader_election.cc:304] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:28.404193 23681 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.411350 23666 raft_consensus.cc:2749] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.412786 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.414788 23665 raft_consensus.cc:2749] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:28.416496 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.421615 23668 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.422119 23668 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.422502 23668 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:28.425962 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:28.426541 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.429100 18012 raft_consensus.cc:1240] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:28.433413 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:28.441409 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:28.433640 23665 consensus_queue.cc:1059] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:12:28.443344 23643 raft_consensus.cc:3055] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:28.443735 23643 raft_consensus.cc:740] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:28.444620 23643 consensus_queue.cc:260] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.445919 23643 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.451810 18012 raft_consensus.cc:1240] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:28.452458 23688 ts_tablet_manager.cc:1929] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 12:12:28.452935 23688 log.cc:1199] T ee22d4e5e05e423097297625d6158f21 P aaafaad0810b4e95983d2d73ec814346: Deleting WAL directory at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/wals/ee22d4e5e05e423097297625d6158f21
I20260709 12:12:28.453524 23608 consensus_queue.cc:1059] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:28.457938 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.469786 23681 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:28.462869 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 50167.1us
I20260709 12:12:28.472847 17174 catalog_manager.cc:5028] TS aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): tablet ee22d4e5e05e423097297625d6158f21 (table test-workload [id=a75371d56b394d9dbee3cf186f3fefdb]) successfully deleted
I20260709 12:12:28.474610 23608 raft_consensus.cc:3055] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:28.476562 18012 raft_consensus.cc:1240] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:28.476912 23608 raft_consensus.cc:740] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
W20260709 12:12:28.474763 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:28.462146 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.477768 23608 consensus_queue.cc:260] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.478222 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.479120 23608 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.479765 23643 consensus_queue.cc:1059] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:28.480899 23643 raft_consensus.cc:3055] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:28.481316 23643 raft_consensus.cc:740] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:28.482328 23643 consensus_queue.cc:260] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.485327 23643 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:28.493891 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:28.514341 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:28.517297 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:28.518319 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:28.520757 18008 raft_consensus.cc:1240] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:28.522660 23665 consensus_queue.cc:1059] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:28.524832 23650 raft_consensus.cc:3055] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:28.525230 23650 raft_consensus.cc:740] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:28.525916 23675 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:28.526384 23675 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.526736 23675 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:28.537429 23675 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.562201 17363 raft_consensus.cc:1240] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:28.565528 23675 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:28.538504 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 61068.4us
W20260709 12:12:28.539563 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.566641 17333 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.569767 23691 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.558318 23650 consensus_queue.cc:260] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.571087 23650 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.539915 23668 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.579507 23691 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.580057 23668 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:28.580052 23691 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.569882 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.592229 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.596024 17333 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.598212 23668 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:28.598664 23668 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.599051 23668 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.595456 23675 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.604303 23675 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.604837 23675 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.606413 23667 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.607527 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.608328 23667 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:28.608677 23667 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:28.608758 17333 leader_election.cc:304] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.609078 23667 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.616341 23668 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.622798 23691 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.626492 23666 raft_consensus.cc:2749] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:28.615921 23650 consensus_queue.cc:1059] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:12:28.627468 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.632650 17333 leader_election.cc:304] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.632933 23666 raft_consensus.cc:2749] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.633668 23666 raft_consensus.cc:2749] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:28.626493 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.631058 23668 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:28.635236 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:28.635946 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:28.636399 23691 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:28.639530 17358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:28.639904 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:28.640369 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:28.644253 23650 raft_consensus.cc:3055] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:28.644752 23650 raft_consensus.cc:740] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:28.645736 23650 consensus_queue.cc:260] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.647213 23650 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:28.663400 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:28.666008 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:28.633414 23667 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.667933 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:28.669909 17978 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.670755 23681 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.673503 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.673758 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.674518 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.675150 17978 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.676071 23673 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.679075 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:28.681396 17978 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.682448 23672 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:28.682922 17978 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.685634 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.687171 23681 raft_consensus.cc:2749] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.688190 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.690796 17439 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 15.
I20260709 12:12:28.697722 23679 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.702037 17359 raft_consensus.cc:1240] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:28.703662 23692 consensus_queue.cc:1059] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:28.704803 23643 raft_consensus.cc:3055] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:28.705181 23643 raft_consensus.cc:740] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:28.706166 23643 consensus_queue.cc:260] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.708202 23643 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.711350 17435 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 18.
I20260709 12:12:28.675551 23667 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:28.723155 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.751205 23675 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.753005 17441 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 12.
I20260709 12:12:28.726567 17333 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:28.756366 23693 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:28.757048 23693 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 15 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:28.757982 23693 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.762985 23675 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:28.756462 17333 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:28.765930 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.767746 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:28.768812 23668 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:28.771016 23668 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 18 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:28.771952 23668 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.774767 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:28.775967 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
W20260709 12:12:28.779722 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:28.785728 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:28.786919 16125 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 17313)
I20260709 12:12:28.788764 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.789685 23666 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:28.792712 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.823407 17333 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.824771 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:28.824918 23693 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:28.826226 17441 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 17.
W20260709 12:12:28.829531 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.834875 23668 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.836074 23693 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:28.837009 23693 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:28.842041 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.850678 17188 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 14 to 15, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 15 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.852566 17188 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 17 to 18, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 18 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.847971 17333 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:28.860363 23675 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:28.869884 23675 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 17 LEADER]: Becoming Leader. State: Replica: aaafaad0810b4e95983d2d73ec814346, State: Running, Role: LEADER
I20260709 12:12:28.870929 23675 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:28.863801 23694 log.cc:927] Time spent T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.052s	user 0.000s	sys 0.004s
W20260709 12:12:28.913666 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.920310 17364 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Rejecting Update request from peer e860f7e876b74ec589f447737822a4f6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:28.922226 23692 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:28.923305 23650 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:28.923722 23650 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:28.924695 23650 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:28.927256 23650 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:28.938982 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:28.972210 17188 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 11 to 12, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 12 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.973924 17188 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 reported cstate change: term changed from 16 to 17, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to aaafaad0810b4e95983d2d73ec814346 (127.15.191.66). New cstate: current_term: 17 leader_uuid: "aaafaad0810b4e95983d2d73ec814346" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:29.057019 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:29.084765 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:29.184897 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:29.185527 17435 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:12:29.188964 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:29.190212 23675 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:29.197139 17441 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:29.198635 23675 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:29.297819 18008 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:29.300096 23697 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:12:29.317085 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:29.342964 18012 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:29.352239 23668 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:29.393868 18013 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:29.395817 23667 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:29.429059 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:29.447798 18009 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:29.450629 17435 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:29.465512 17437 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Refusing update from remote peer aaafaad0810b4e95983d2d73ec814346: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:29.482089 23667 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:29.489044 23693 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:12:29.495702 23668 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:29.497517 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:29.503057 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:29.566905 17176 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 55827.9us
W20260709 12:12:29.582039 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:29.587342 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:29.634455 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1c41ebef06654a43a98e69d0c065bba4: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:29.681505 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:29.684079 23712 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: Append to log took a long time: real 0.069s	user 0.001s	sys 0.007s
W20260709 12:12:29.689913 23698 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346: Append to log took a long time: real 0.077s	user 0.000s	sys 0.010s
W20260709 12:12:29.693235 23714 log.cc:927] Time spent T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: Append to log took a long time: real 0.083s	user 0.003s	sys 0.002s
W20260709 12:12:29.741143 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:29.787369 16125 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:29.865003 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:29.999670 23716 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:30.000622 23716 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.003029 23716 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:30.006932 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:30.010336 17435 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:12:30.007989 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:30.012053 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:30.012429 17364 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 18: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:30.012992 23716 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.015281 23716 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:30.016598 23716 raft_consensus.cc:3060] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:30.015923 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:30.032636 23716 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.035955 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:30.036840 17364 raft_consensus.cc:2393] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 18: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:30.037804 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:30.039017 23716 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:30.074725 17435 raft_consensus.cc:2468] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:12:30.077553 17981 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:30.082581 23716 raft_consensus.cc:2804] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:30.083145 23716 raft_consensus.cc:697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:30.084059 23716 consensus_queue.cc:237] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.096453 23717 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:30.097476 23717 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.101091 17364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:30.101320 23717 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:30.103490 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:30.104209 17439 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:12:30.102052 17364 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 18: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:30.117655 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:30.119038 23717 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.119462 23717 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:30.119834 23717 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.130929 23692 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.133939 23692 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.138913 23692 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:30.139093 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:30.141763 17359 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 15.
I20260709 12:12:30.142482 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:30.143203 18012 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:12:30.144619 23717 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.144793 17404 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:30.152431 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:30.153259 17359 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 868a5e341d0a41b4ac0927342c8cd598 in current term 18: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:30.155138 23692 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:30.155596 23692 raft_consensus.cc:493] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.155951 23692 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.161809 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:12:30.166625 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:30.155104 23717 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:30.176338 17182 catalog_manager.cc:5697] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 17 to 18, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 18 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:30.187485 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:30.175079 23692 raft_consensus.cc:515] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.190835 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:30.190807 17359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faefcc2755734398b9b0b1a778da9a50" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:30.191650 18012 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.191689 17359 raft_consensus.cc:3060] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.191744 17435 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:12:30.193667 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:30.194868 23717 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:30.195398 23717 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:30.196365 23717 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.190737 23692 leader_election.cc:290] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:30.205380 17359 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:12:30.206525 17404 leader_election.cc:304] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:30.214617 23650 raft_consensus.cc:2804] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:30.215225 23650 raft_consensus.cc:697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:30.216142 23650 consensus_queue.cc:237] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.255208 18012 raft_consensus.cc:2468] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
W20260709 12:12:30.272913 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:30.362314 17188 catalog_manager.cc:5697] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:30.439097 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:30.463490 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:30.498574 17182 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 17 to 18, leader changed from e860f7e876b74ec589f447737822a4f6 (127.15.191.67) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 18 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:30.613281 17406 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111) [suppressed 312 similar messages]
W20260709 12:12:30.614192 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 59119.1us
I20260709 12:12:30.701174 17437 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:30.707245 23681 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:30.738080 23667 raft_consensus.cc:493] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.738915 23667 raft_consensus.cc:515] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.741400 23667 leader_election.cc:290] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:30.743948 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:30.746726 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b7d359bb7400c8b795e1b6f9dd1a2" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:30.753948 23667 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.754686 23667 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:30.757170 23667 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:30.759683 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:30.768740 17361 raft_consensus.cc:1275] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:30.771842 17361 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:30.773649 23672 consensus_queue.cc:1048] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:30.776187 23672 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:30.787508 17441 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:12:30.788537 16125 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 17313)
I20260709 12:12:30.791107 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:30.791805 17435 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaafaad0810b4e95983d2d73ec814346 in term 18.
I20260709 12:12:30.797219 18012 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:30.799831 23730 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:30.805397 23716 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:30.809708 17363 raft_consensus.cc:1275] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:30.845836 23692 consensus_queue.cc:1048] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:30.840040 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:30.856513 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:30.861565 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:30.862183 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:30.874912 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:30.876192 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:30.885520 17333 leader_election.cc:304] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:30.901173 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:30.906325 23729 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:30.906889 23729 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.907301 23729 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.902073 23666 raft_consensus.cc:2749] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.910799 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:30.922423 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:30.978798 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 77814.5us
W20260709 12:12:31.072180 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.080732 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.100044 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.121938 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.167384 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:31.126148 23729 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:31.178839 17361 raft_consensus.cc:1240] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Rejecting Update request from peer 868a5e341d0a41b4ac0927342c8cd598 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:12:31.179992 23729 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 election: Requested vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:31.170612 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:31.181088 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.188922 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.197854 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.198762 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.200475 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.211004 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d6c49969609c4c85a0a31036764369c0: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:31.217284 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.221693 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.285223 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:31.310739 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
W20260709 12:12:31.339313 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:31.359602 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:31.374277 23735 consensus_queue.cc:1059] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:31.375558 23746 raft_consensus.cc:3055] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:31.376072 23746 raft_consensus.cc:740] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:31.377339 23746 consensus_queue.cc:260] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:31.378959 23746 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:31.385752 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.471432 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:31.525421 17333 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:31.528417 23668 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:31.705175 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.789057 16125 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:31.791324 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:31.861738 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.973505 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:31.977505 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:32.022495 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:32.063369 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:32.127200 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:32.160794 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:32.173777 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:32.195477 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:32.293685 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:32.320722 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:32.508315 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 48362.7us
I20260709 12:12:32.552078 23735 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.552645 23735 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:32.554903 23735 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:32.557235 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:32.558122 17363 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 19.
I20260709 12:12:32.563311 17978 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346; no voters: 
I20260709 12:12:32.565187 23746 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:32.565608 23746 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.565958 23746 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.567891 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:32.592163 23746 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:32.599568 23748 raft_consensus.cc:493] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:32.601259 23748 raft_consensus.cc:515] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:32.603691 23748 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:32.606127 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:12:32.606587 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:32.607355 18012 raft_consensus.cc:2368] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 19. Current term is 20.
I20260709 12:12:32.609769 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346" is_pre_election: true
I20260709 12:12:32.610646 17361 raft_consensus.cc:2393] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 19: Already voted for candidate aaafaad0810b4e95983d2d73ec814346 in this term.
I20260709 12:12:32.614871 17407 leader_election.cc:400] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 19. Current term is 20.
I20260709 12:12:32.615338 17407 leader_election.cc:403] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:32.619654 23756 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.619901 23746 leader_election.cc:290] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 20 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:32.639256 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:32.639537 23756 raft_consensus.cc:2749] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143) with higher term. Message: Invalid argument: T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 for earlier term 19. Current term is 20.
I20260709 12:12:32.663786 17435 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 20.
I20260709 12:12:32.667915 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9b4ec086384e2b800cbd4d98e9fe33" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaafaad0810b4e95983d2d73ec814346"
I20260709 12:12:32.668562 17361 raft_consensus.cc:3060] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.667418 17981 leader_election.cc:304] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:32.682719 23746 raft_consensus.cc:2804] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:32.688898 23746 raft_consensus.cc:697] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 20 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:32.690476 23746 consensus_queue.cc:237] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:32.693416 17361 raft_consensus.cc:2468] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 20.
W20260709 12:12:32.699412 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:32.746896 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:32.789587 16125 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:32.793893 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 105883us
I20260709 12:12:32.796033 17182 catalog_manager.cc:5697] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:32.946946 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:32.958981 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:33.094928 17361 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 20 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:33.105237 23735 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:33.107223 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:33.171779 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:33.213937 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:33.253998 17435 raft_consensus.cc:1275] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:33.256431 23761 consensus_queue.cc:1048] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:12:33.279592 17333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 83053.9us
W20260709 12:12:33.419759 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:33.432842 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.446727 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.457278 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.457281 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.460652 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:33.474704 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.548445 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.555732 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:33.594987 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.601450 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.606400 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.665620 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.702507 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.710311 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:33.722970 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.790196 16125 thread.cc:527] Waited for 22000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:33.812448 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 89521.3us
W20260709 12:12:33.821322 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.800848 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.822438 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 112183us
W20260709 12:12:33.845902 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.873365 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.859472 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.894518 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:33.931347 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.184896 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:34.204481 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:34.230306 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.301477 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.383603 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.394234 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.562320 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.567446 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.619585 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.678553 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.692906 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.812604 16125 thread.cc:527] Waited for 23000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:34.873112 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:34.984217 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 53741.2us
W20260709 12:12:35.016168 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:35.028255 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:35.133342 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:35.293609 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:35.355356 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:35.542079 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:35.603508 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:35.616585 17980 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111) [suppressed 440 similar messages]
W20260709 12:12:35.641669 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:35.813349 16125 thread.cc:527] Waited for 24000ms trying to join with diag-logger (tid 17313)
W20260709 12:12:35.896202 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:35.909162 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:35.932760 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:35.980621 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:35.999742 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.009572 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.033998 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:36.045410 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.064746 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.076033 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.120783 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.131500 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.133683 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:36.153678 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.203786 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.218456 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.224318 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:36.250237 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.263540 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.283561 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.349503 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.353680 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.415628 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.604166 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.731181 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.770525 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.913762 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:36.961320 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:36.990475 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:37.003548 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:37.183691 17332 consensus_peers.cc:597] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:37.208961 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:37.451680 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:37.457159 17332 consensus_peers.cc:597] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:37.464803 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:37.477257 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 63998.8us
W20260709 12:12:37.488744 17332 consensus_peers.cc:597] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:37.527550 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:37.611992 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:38.060266 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1c41ebef06654a43a98e69d0c065bba4: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:38.238920 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:38.257884 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:38.284696 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:38.306530 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:38.312055 17462 debug-util.cc:398] Leaking SignalData structure 0x7b0800234340 after lost signal to thread 16128
W20260709 12:12:38.313153 17462 debug-util.cc:398] Leaking SignalData structure 0x7b08002ddc20 after lost signal to thread 17224
W20260709 12:12:38.314376 17462 debug-util.cc:398] Leaking SignalData structure 0x7b08002f78a0 after lost signal to thread 17391
W20260709 12:12:38.315821 17462 debug-util.cc:398] Leaking SignalData structure 0x7b0800278fc0 after lost signal to thread 17465
W20260709 12:12:38.317126 17462 debug-util.cc:398] Leaking SignalData structure 0x7b0800117040 after lost signal to thread 18039
I20260709 12:12:38.322618 16125 tablet_server.cc:196] TabletServer@127.15.191.65:0 shutdown complete.
W20260709 12:12:38.494704 17332 consensus_peers.cc:597] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:38.612105 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:38.652812 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:38.653425 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:38.664570 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:38.707754 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:38.743968 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:38.747027 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:12:38.763218 16125 tablet_server.cc:179] TabletServer@127.15.191.66:0 shutting down...
W20260709 12:12:38.764978 17332 consensus_peers.cc:597] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:38.786304 17978 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.791419 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:38.776458 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:38.806825 17332 consensus_peers.cc:597] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:38.816169 17978 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.817183 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:38.858639 17404 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.875958 17978 consensus_peers.cc:597] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.861577 17404 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.879082 17404 consensus_peers.cc:597] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.887233 17404 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.892295 17404 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.898701 17404 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.899519 17404 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.905041 17404 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.906978 17404 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.913479 17404 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.945870 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:38.957942 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:38.959254 16125 tablet_replica.cc:333] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:38.960685 16125 raft_consensus.cc:2243] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:38.963033 16125 raft_consensus.cc:2272] T d9108b2dade34abca8d8b1d985d2dc05 P aaafaad0810b4e95983d2d73ec814346 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:38.963855 17388 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4140 after lost signal to thread 16128
W20260709 12:12:38.965292 17388 debug-util.cc:398] Leaking SignalData structure 0x7b08000458e0 after lost signal to thread 17224
W20260709 12:12:38.966773 17388 debug-util.cc:398] Leaking SignalData structure 0x7b0800299ac0 after lost signal to thread 17391
W20260709 12:12:38.968004 17388 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4d60 after lost signal to thread 17465
W20260709 12:12:38.973044 17388 debug-util.cc:398] Leaking SignalData structure 0x7b0800195fe0 after lost signal to thread 18039
I20260709 12:12:38.982151 16125 tablet_replica.cc:333] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:38.998903 16125 raft_consensus.cc:2243] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:39.000248 16125 raft_consensus.cc:2272] T ccfe00a9196e4e49a4ad7e72acd36c08 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.003134 16125 tablet_replica.cc:333] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
W20260709 12:12:39.004896 17978 consensus_peers.cc:597] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.007103 16125 raft_consensus.cc:2243] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:39.009474 16125 raft_consensus.cc:2272] T dfb3d142442b4e3aada6416cb667a95b P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.025328 16125 tablet_replica.cc:333] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.026576 16125 raft_consensus.cc:2243] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:39.027837 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:39.034288 17404 consensus_peers.cc:597] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.035979 16125 raft_consensus.cc:2272] T 12759295b3a947cca3d2c7fc3c815e59 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:39.036283 17978 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.046217 16125 tablet_replica.cc:333] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.047335 16125 raft_consensus.cc:2243] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.053619 16125 raft_consensus.cc:2272] T 5d769dc29730489bb1bc366ea38bf391 P aaafaad0810b4e95983d2d73ec814346 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:39.055647 17404 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.056854 16125 tablet_replica.cc:333] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.059079 16125 raft_consensus.cc:2243] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:39.079159 16125 raft_consensus.cc:2272] T 8f950276bbbb4642872e9280fad2a766 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.083250 16125 tablet_replica.cc:333] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.085559 16125 raft_consensus.cc:2243] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.086416 16125 raft_consensus.cc:2272] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.089376 16125 tablet_replica.cc:333] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
W20260709 12:12:39.089921 17978 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:39.098127 17978 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.099424 16125 raft_consensus.cc:2243] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:12:39.101786 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.101781 16125 raft_consensus.cc:2272] T b3657462e03f42ac95c71bed480ca6a6 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:39.104463 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.110396 16125 tablet_replica.cc:333] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.113932 16125 raft_consensus.cc:2243] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.115592 16125 raft_consensus.cc:2272] T d7f622d20c7b40a296d381dcc9b82704 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:39.114882 17404 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:39.133249 17978 consensus_peers.cc:597] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.139276 16125 tablet_replica.cc:333] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.140326 16125 raft_consensus.cc:2243] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:12:39.141147 17978 consensus_peers.cc:597] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.142428 16125 raft_consensus.cc:2272] T d6c49969609c4c85a0a31036764369c0 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.149122 16125 tablet_replica.cc:333] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
W20260709 12:12:39.153038 17404 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.153090 16125 raft_consensus.cc:2243] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.154472 16125 raft_consensus.cc:2272] T a9955d24ad7243689a5a438424f992e9 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.167888 16125 tablet_replica.cc:333] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.168882 16125 raft_consensus.cc:2243] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.169641 16125 raft_consensus.cc:2272] T ff2e0aa678a447dcab13573f3577208e P aaafaad0810b4e95983d2d73ec814346 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.176923 16125 tablet_replica.cc:333] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.182842 16125 raft_consensus.cc:2243] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.183779 16125 raft_consensus.cc:2272] T faefcc2755734398b9b0b1a778da9a50 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.186681 16125 tablet_replica.cc:333] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
W20260709 12:12:39.187816 17978 consensus_peers.cc:597] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.191149 16125 raft_consensus.cc:2243] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.191965 16125 raft_consensus.cc:2272] T 6685bf7292cc44e09a9965668c0345cc P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:39.194859 17978 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.199245 16125 tablet_replica.cc:333] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.207320 16125 raft_consensus.cc:2243] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.208092 16125 raft_consensus.cc:2272] T 814b69784b0f4c3d8b07d13d54ae4b47 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.211117 16125 tablet_replica.cc:333] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.213361 16125 raft_consensus.cc:2243] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.214460 16125 raft_consensus.cc:2272] T f462146b97ed46f2821bee27630d0218 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.220873 16125 tablet_replica.cc:333] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
W20260709 12:12:39.222167 17332 consensus_peers.cc:597] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:39.216675 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.228852 16125 raft_consensus.cc:2243] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:39.230002 16125 raft_consensus.cc:2272] T 3673757d03f243668794c10285c7d1ff P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.238183 16125 tablet_replica.cc:333] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.239141 16125 raft_consensus.cc:2243] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:39.256685 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.260552 16125 raft_consensus.cc:2272] T 94fb1d5d8c204d70a68af6043f3ba9dd P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.272217 16125 tablet_replica.cc:333] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
W20260709 12:12:39.274065 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.278085 16125 raft_consensus.cc:2243] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:39.276446 17978 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:39.279171 17978 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:39.275225 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:39.288551 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.344730 16125 raft_consensus.cc:2272] T 539116186b9c4b269f16afb90a4654f4 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.369410 16125 tablet_replica.cc:333] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.398885 16125 raft_consensus.cc:2243] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:39.399609 17978 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:39.393457 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:39.404811 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.406013 16125 raft_consensus.cc:2272] T 93c0e960dcac478bbf09add686ea3b3c P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:39.432484 17978 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:39.434684 16125 tablet_replica.cc:333] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.445402 16125 raft_consensus.cc:2243] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.468067 16125 raft_consensus.cc:2272] T d582e1abf9be42689682da4cee6206c8 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.491968 16125 tablet_replica.cc:333] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.517993 16125 raft_consensus.cc:2243] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.519025 16125 raft_consensus.cc:2272] T f7c3705a9e0e457898a7061b4170a8a1 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.521660 16125 tablet_replica.cc:333] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.522532 16125 raft_consensus.cc:2243] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:39.569782 16125 raft_consensus.cc:2272] T 8386bc0b5fc7467d87ca1ca69464e42e P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.603463 16125 tablet_replica.cc:333] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.604350 16125 raft_consensus.cc:2243] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:39.605316 16125 raft_consensus.cc:2272] T 623409527b5e49f3a95ae127569da2b0 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.628221 16125 tablet_replica.cc:333] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.632653 23808 raft_consensus.cc:493] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 868a5e341d0a41b4ac0927342c8cd598)
I20260709 12:12:39.633304 23808 raft_consensus.cc:515] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:39.635592 23808 leader_election.cc:290] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:39.640604 17332 leader_election.cc:336] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:39.643198 16125 raft_consensus.cc:2243] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.655027 16125 raft_consensus.cc:2272] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.659024 16125 tablet_replica.cc:333] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
W20260709 12:12:39.660420 17332 consensus_peers.cc:597] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.667925 16125 raft_consensus.cc:2243] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.683320 16125 raft_consensus.cc:2272] T 9367e72dd7c24f7e8aa4d479a069ed0e P aaafaad0810b4e95983d2d73ec814346 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.708593 16125 tablet_replica.cc:333] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.709441 16125 raft_consensus.cc:2243] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:12:39.715787 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.718523 16125 raft_consensus.cc:2272] T ff74c08559a64593bfe9cdc08a3b96d1 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.728956 23782 raft_consensus.cc:493] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
W20260709 12:12:39.718648 17981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:34917, user_credentials={real_user=slave}} blocked reactor thread for 108398us
I20260709 12:12:39.729524 23782 raft_consensus.cc:515] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:39.726078 16125 tablet_replica.cc:333] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.732080 16125 raft_consensus.cc:2243] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.742923 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6728648e29b471c950575a72ecf0454" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:39.749619 16125 raft_consensus.cc:2272] T eb339cd935184a289cfac7d49d2f74d3 P aaafaad0810b4e95983d2d73ec814346 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.749904 23782 leader_election.cc:290] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:39.750726 23782 raft_consensus.cc:493] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:39.751034 23808 raft_consensus.cc:493] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:39.751230 23782 raft_consensus.cc:515] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:39.751613 23808 raft_consensus.cc:515] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:39.753440 23782 leader_election.cc:290] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:39.757403 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:39.758037 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b75d8684e5472b87d6b3acb0ef9d2e" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:39.758262 17432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51babcffb8ce4ac99ebd5354a7c7d898" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:39.761054 16125 tablet_replica.cc:333] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.779481 16125 raft_consensus.cc:2243] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.781154 16125 raft_consensus.cc:2272] T fe9b4ec086384e2b800cbd4d98e9fe33 P aaafaad0810b4e95983d2d73ec814346 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.753623 23808 leader_election.cc:290] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:39.790995 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55e72b6c888480d92e455681414fbb0" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:39.793965 23817 raft_consensus.cc:493] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:39.794729 23817 raft_consensus.cc:515] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:39.797067 23817 leader_election.cc:290] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:39.799640 23808 raft_consensus.cc:493] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e860f7e876b74ec589f447737822a4f6)
I20260709 12:12:39.800257 23808 raft_consensus.cc:515] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:39.802390 23808 leader_election.cc:290] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:39.815038 16125 tablet_replica.cc:333] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.822813 16125 raft_consensus.cc:2243] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:39.824038 16125 raft_consensus.cc:2272] T f7130b980d9147f2b3915212d4028e03 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:39.817231 17332 leader_election.cc:336] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:39.829254 17332 leader_election.cc:304] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:39.830574 16125 tablet_replica.cc:333] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.831037 23817 raft_consensus.cc:2749] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:39.831771 17332 leader_election.cc:336] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:39.838951 17332 leader_election.cc:304] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:39.827071 17333 leader_election.cc:304] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, 868a5e341d0a41b4ac0927342c8cd598
I20260709 12:12:39.839381 16125 raft_consensus.cc:2243] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.846746 23817 raft_consensus.cc:2749] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:39.847590 17333 raft_consensus.cc:2686] T c6728648e29b471c950575a72ecf0454 P aaafaad0810b4e95983d2d73ec814346: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:39.847999 16125 raft_consensus.cc:2272] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.851073 16125 tablet_replica.cc:333] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.854851 16125 raft_consensus.cc:2243] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:39.855654 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:12:39.853066 17333 leader_election.cc:304] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:39.865249 16125 raft_consensus.cc:2272] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:39.865466 17333 raft_consensus.cc:2686] T b55e72b6c888480d92e455681414fbb0 P aaafaad0810b4e95983d2d73ec814346: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:39.867939 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a03a1e696734298850b94830af8a727" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:39.868175 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f15a1b060b43ca9ea130feba217bcf" candidate_uuid: "aaafaad0810b4e95983d2d73ec814346" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
W20260709 12:12:39.869804 17332 leader_election.cc:336] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:39.870445 17332 leader_election.cc:336] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:39.875116 16125 tablet_replica.cc:333] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.883735 16125 raft_consensus.cc:2243] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:12:39.889878 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:39.892328 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.898699 16125 raft_consensus.cc:2272] T 51f32408cb854e64a70dc3560f27b02e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.906647 16125 tablet_replica.cc:333] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.912870 16125 raft_consensus.cc:2243] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:12:39.901084 17332 consensus_peers.cc:597] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:39.909835 17333 leader_election.cc:304] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:39.914328 16125 raft_consensus.cc:2272] T 4ec8dfd95d9a45c2a5becdfb706a42fb P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.915210 23817 raft_consensus.cc:2749] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:39.916100 17333 leader_election.cc:304] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaafaad0810b4e95983d2d73ec814346; no voters: 33539b233c2044afa31017244f6cc0d1, e860f7e876b74ec589f447737822a4f6
W20260709 12:12:39.921440 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:39.928519 17333 raft_consensus.cc:2686] T e8f15a1b060b43ca9ea130feba217bcf P aaafaad0810b4e95983d2d73ec814346: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:39.940385 16125 tablet_replica.cc:333] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.941015 16125 raft_consensus.cc:2243] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:39.942147 16125 raft_consensus.cc:2272] T 62f5a9a5a773414fa979e4e68b31bb5d P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.968531 16125 tablet_replica.cc:333] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.969658 16125 raft_consensus.cc:2243] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.970662 16125 raft_consensus.cc:2272] T b9356b25ee58416ca89b944be6f0b562 P aaafaad0810b4e95983d2d73ec814346 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.973999 16125 tablet_replica.cc:333] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.980039 16125 raft_consensus.cc:2243] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.980899 16125 raft_consensus.cc:2272] T c44e7f48dd474ca1a12a7ac7251f4c6f P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.983691 16125 tablet_replica.cc:333] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:39.986785 16125 raft_consensus.cc:2243] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:39.987536 16125 raft_consensus.cc:2272] T 51babcffb8ce4ac99ebd5354a7c7d898 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:39.997560 16125 tablet_replica.cc:333] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:40.009610 16125 raft_consensus.cc:2243] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:40.010612 16125 raft_consensus.cc:2272] T 8832d652d7004314892ca1c18bd94f7c P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:40.013628 16125 tablet_replica.cc:333] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:40.014477 16125 raft_consensus.cc:2243] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:40.015798 16125 raft_consensus.cc:2272] T 18a366d5769a4ed9bb2b1e32afb26cd3 P aaafaad0810b4e95983d2d73ec814346 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:40.018577 16125 tablet_replica.cc:333] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:40.019371 16125 raft_consensus.cc:2243] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:40.020565 16125 raft_consensus.cc:2272] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:40.023327 16125 tablet_replica.cc:333] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:40.024250 16125 raft_consensus.cc:2243] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:40.025497 16125 raft_consensus.cc:2272] T 4ddf5e2cbdb748f7a7ed880493377874 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:40.028636 16125 tablet_replica.cc:333] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:40.029426 16125 raft_consensus.cc:2243] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:40.030740 16125 raft_consensus.cc:2272] T 1c41ebef06654a43a98e69d0c065bba4 P aaafaad0810b4e95983d2d73ec814346 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:40.037739 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:40.040858 16125 tablet_replica.cc:333] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:40.041760 16125 raft_consensus.cc:2243] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:40.042634 16125 raft_consensus.cc:2272] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P aaafaad0810b4e95983d2d73ec814346 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:40.045629 16125 tablet_replica.cc:333] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:40.046504 16125 raft_consensus.cc:2243] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:40.047205 16125 raft_consensus.cc:2272] T 12b75d8684e5472b87d6b3acb0ef9d2e P aaafaad0810b4e95983d2d73ec814346 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:40.052286 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:40.058254 16125 tablet_replica.cc:333] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346: stopping tablet replica
I20260709 12:12:40.059084 16125 raft_consensus.cc:2243] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:40.062623 16125 raft_consensus.cc:2272] T 3a03a1e696734298850b94830af8a727 P aaafaad0810b4e95983d2d73ec814346 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:40.202207 17978 connection.cc:769] client connection to 127.15.191.66:35675 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 12:12:40.244895 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:40.286881 23813 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.287560 23813 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:40.289716 23813 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:40.305465 23811 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.306195 23811 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:40.311347 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:40.311939 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:40.311970 23810 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.312605 23810 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:40.314404 23818 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.314949 23818 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:40.315327 23810 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:40.317245 23818 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:40.317770 23818 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.318228 23818 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:40.319787 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:40.322549 23818 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:40.326035 17978 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.330080 23811 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:40.330955 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
W20260709 12:12:40.335839 17404 leader_election.cc:336] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
W20260709 12:12:40.340039 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:40.342408 17980 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:40.343655 17980 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:40.343164 17406 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:40.344646 17406 leader_election.cc:336] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:40.338925 17404 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:40.345151 23813 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:40.347191 17404 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.348179 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:40.348964 23818 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.347708 23811 raft_consensus.cc:2749] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:40.364960 17404 leader_election.cc:336] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.367504 17404 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:40.380774 23811 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:40.382083 17404 leader_election.cc:336] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.382666 23813 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.383453 23813 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:40.396801 17978 leader_election.cc:336] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.400385 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:40.401067 17437 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:12:40.402546 17981 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:40.403434 23815 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:40.403838 23815 raft_consensus.cc:493] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.404161 23815 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.411039 23813 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:40.413268 17404 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:40.425753 23815 raft_consensus.cc:515] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:40.428218 23811 raft_consensus.cc:2749] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:40.429462 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 47413.1us
W20260709 12:12:40.465529 17978 leader_election.cc:336] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.473563 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3657462e03f42ac95c71bed480ca6a6" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:40.474222 17437 raft_consensus.cc:3060] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.482290 17437 raft_consensus.cc:2468] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 17.
I20260709 12:12:40.483558 17981 leader_election.cc:304] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:40.484495 23813 raft_consensus.cc:2804] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:40.485646 23813 raft_consensus.cc:697] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:40.486908 23813 consensus_queue.cc:237] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:40.487768 23815 leader_election.cc:290] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:40.556035 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:40.587685 17188 catalog_manager.cc:5697] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 16 to 17, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 17 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:40.593161 23822 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.596364 23822 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:40.617913 17980 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111) [suppressed 509 similar messages]
I20260709 12:12:40.623636 23822 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:40.626546 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:40.628068 17439 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:12:40.629860 17981 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:40.631757 23809 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.632675 23809 raft_consensus.cc:493] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.634305 23809 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:40.633545 17978 leader_election.cc:336] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.655984 23809 raft_consensus.cc:515] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:40.668128 17978 leader_election.cc:336] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.669858 23809 leader_election.cc:290] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:40.672041 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c49969609c4c85a0a31036764369c0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:40.672735 17439 raft_consensus.cc:3060] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:40.677820 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:40.683012 17439 raft_consensus.cc:2468] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 19.
I20260709 12:12:40.692554 17981 leader_election.cc:304] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:40.693296 23809 raft_consensus.cc:2804] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:40.694000 23809 raft_consensus.cc:697] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:40.695544 23809 consensus_queue.cc:237] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:40.736117 23810 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.736909 23810 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:40.745890 17406 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:40.747391 23810 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:40.758535 17404 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.759194 17404 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:40.760393 23794 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:40.757779 17188 catalog_manager.cc:5697] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 18 to 19, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 19 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:40.786914 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:40.903870 23810 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.904628 23810 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:40.912691 17404 leader_election.cc:336] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:40.915288 23810 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:40.915620 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:40.922469 17407 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:40.923956 23810 raft_consensus.cc:2749] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.927361 23822 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.928371 23822 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:40.930790 23822 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:40.942303 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:40.943090 17439 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 15.
I20260709 12:12:40.944962 17981 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:40.946033 23815 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:40.951134 23815 raft_consensus.cc:493] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.951514 23815 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:40.954743 17978 leader_election.cc:336] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
W20260709 12:12:40.963052 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:40.971649 23794 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:40.972433 23794 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:40.976588 23794 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:40.989398 17404 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
W20260709 12:12:40.993160 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:40.995263 17406 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:41.010324 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:41.000303 17978 consensus_peers.cc:597] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:41.013605 23810 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:41.011044 17404 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.050426 23810 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.051177 23810 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.054603 23810 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:41.054826 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:41.059165 23822 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.059900 23822 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.062407 23822 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:41.064461 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:41.070739 23815 raft_consensus.cc:515] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:41.055801 17404 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.081741 23815 leader_election.cc:290] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:41.087289 17439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8386bc0b5fc7467d87ca1ca69464e42e" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:41.123270 17439 raft_consensus.cc:3060] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:41.088619 17437 raft_consensus.cc:1275] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:41.132428 17439 raft_consensus.cc:2468] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 16.
I20260709 12:12:41.135694 17981 leader_election.cc:304] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:41.138445 23809 raft_consensus.cc:2804] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:41.138998 23809 raft_consensus.cc:697] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:41.147750 23809 consensus_queue.cc:237] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:41.161310 17978 leader_election.cc:336] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.161885 17978 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:41.162708 23815 raft_consensus.cc:2749] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:41.122597 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:41.133670 23813 consensus_queue.cc:1048] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:41.103931 23794 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.173524 23794 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.177062 23794 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:41.177347 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:41.178066 18009 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 16.
I20260709 12:12:41.179041 17407 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:41.180408 23810 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:41.180855 23810 raft_consensus.cc:493] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.181393 23810 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:41.186267 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 63684.7us
W20260709 12:12:41.190826 17404 leader_election.cc:336] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.191468 17404 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:41.192395 23811 raft_consensus.cc:2749] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:41.193477 17404 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.199920 17437 raft_consensus.cc:1275] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:41.203123 23829 consensus_queue.cc:1048] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:12:41.210140 16125 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17388)
W20260709 12:12:41.222577 17978 consensus_peers.cc:597] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:41.235306 17978 leader_election.cc:336] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.213138 23811 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.237576 23811 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.239926 23811 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:41.241400 23829 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:12:41.234827 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:41.246450 23809 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.246595 23829 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.247210 23809 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.249418 23809 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:41.250649 23829 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:41.254845 17980 leader_election.cc:336] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:41.259845 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:41.260160 23829 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.260828 23829 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.263060 23829 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:41.233771 23810 raft_consensus.cc:515] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:41.279399 17978 leader_election.cc:336] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
W20260709 12:12:41.281563 17978 leader_election.cc:336] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.282285 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:41.303908 23810 leader_election.cc:290] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:41.281248 23811 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.316200 23811 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:41.320029 23811 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:41.320811 17404 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.321573 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:41.326472 17437 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:12:41.326474 17404 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.329347 23809 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.329373 17182 catalog_manager.cc:5697] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 15 to 16, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 16 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.349994 23829 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.350785 23829 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:41.348806 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:41.356426 17404 leader_election.cc:336] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
W20260709 12:12:41.357530 17404 consensus_peers.cc:597] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.353449 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:41.358227 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:41.363893 17406 leader_election.cc:336] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:41.356410 23829 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
W20260709 12:12:41.369235 17404 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.372032 17980 leader_election.cc:336] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:41.369405 23809 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.374723 23809 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:41.376327 17404 leader_election.cc:336] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.376824 23809 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:41.376847 17404 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:41.379748 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 98232.3us
W20260709 12:12:41.380716 17978 leader_election.cc:336] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.381091 17978 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:41.369424 23836 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.381482 23794 raft_consensus.cc:2749] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:41.381956 23836 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.383535 23815 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:41.388005 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:41.388571 17437 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 12.
W20260709 12:12:41.385363 17404 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.391809 17404 leader_election.cc:336] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.393319 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:41.394203 23809 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:41.394600 23809 raft_consensus.cc:493] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.394959 23809 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:41.395397 17404 leader_election.cc:336] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.395920 17404 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:41.396989 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:41.399187 23794 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:41.401225 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:12:41.401782 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:41.402280 23838 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:41.402740 23838 raft_consensus.cc:493] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.403152 23838 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:41.404186 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:41.405108 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7130b980d9147f2b3915212d4028e03" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:41.405768 18008 raft_consensus.cc:3060] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:41.407644 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:41.386358 23836 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:41.413646 23838 raft_consensus.cc:515] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.420854 23809 raft_consensus.cc:515] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.422850 18009 raft_consensus.cc:2393] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e860f7e876b74ec589f447737822a4f6 in current term 13: Already voted for candidate 868a5e341d0a41b4ac0927342c8cd598 in this term.
I20260709 12:12:41.425045 23838 leader_election.cc:290] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:41.426332 17441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec8dfd95d9a45c2a5becdfb706a42fb" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:41.427007 17441 raft_consensus.cc:3060] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:41.427289 23809 leader_election.cc:290] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:41.428990 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623409527b5e49f3a95ae127569da2b0" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:41.429610 17433 raft_consensus.cc:3060] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:41.436379 23809 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.437084 23809 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:41.439945 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:41.440572 23809 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:41.440927 17435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6" is_pre_election: true
I20260709 12:12:41.441581 17435 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 18.
I20260709 12:12:41.443075 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:41.444367 23815 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:41.444777 23815 raft_consensus.cc:493] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.445201 23815 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.447700 18008 raft_consensus.cc:2468] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
W20260709 12:12:41.454604 17978 leader_election.cc:336] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.461185 17407 leader_election.cc:304] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:41.456845 17433 raft_consensus.cc:2468] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
I20260709 12:12:41.459013 17441 raft_consensus.cc:2468] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 13.
W20260709 12:12:41.461668 17978 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.462080 23834 raft_consensus.cc:2804] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:41.462162 17978 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: aaafaad0810b4e95983d2d73ec814346, e860f7e876b74ec589f447737822a4f6
I20260709 12:12:41.462893 17981 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:41.462863 23834 raft_consensus.cc:697] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:41.463083 23838 raft_consensus.cc:2749] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.463933 17981 leader_election.cc:304] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:41.464349 23834 consensus_queue.cc:237] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.465131 23838 raft_consensus.cc:2804] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:41.465682 23838 raft_consensus.cc:697] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:41.466625 23838 consensus_queue.cc:237] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.461529 23815 raft_consensus.cc:515] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.464277 23809 raft_consensus.cc:2804] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:41.469218 23809 raft_consensus.cc:697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
W20260709 12:12:41.469761 17978 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.470355 17978 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.470759 17978 consensus_peers.cc:597] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.454273 23836 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:12:41.471297 17978 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.470669 23809 consensus_queue.cc:237] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:41.471771 17978 leader_election.cc:336] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
W20260709 12:12:41.472487 17978 leader_election.cc:336] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.471509 23836 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:41.473562 17978 leader_election.cc:336] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.475466 23836 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
W20260709 12:12:41.461421 17404 leader_election.cc:336] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.477309 23815 leader_election.cc:290] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917)
I20260709 12:12:41.477730 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598" is_pre_election: true
I20260709 12:12:41.478256 17433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddf5e2cbdb748f7a7ed880493377874" candidate_uuid: "868a5e341d0a41b4ac0927342c8cd598" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e860f7e876b74ec589f447737822a4f6"
I20260709 12:12:41.479471 17433 raft_consensus.cc:3060] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:41.482880 17978 leader_election.cc:336] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.487690 17433 raft_consensus.cc:2468] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868a5e341d0a41b4ac0927342c8cd598 in term 19.
I20260709 12:12:41.477319 17404 leader_election.cc:304] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 868a5e341d0a41b4ac0927342c8cd598, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:41.488930 17981 leader_election.cc:304] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:41.489774 23836 raft_consensus.cc:2749] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:41.489738 23809 raft_consensus.cc:2804] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:41.490816 23809 raft_consensus.cc:697] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 LEADER]: Becoming Leader. State: Replica: 868a5e341d0a41b4ac0927342c8cd598, State: Running, Role: LEADER
I20260709 12:12:41.492295 18008 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 17.
I20260709 12:12:41.492722 23809 consensus_queue.cc:237] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.493309 17407 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
I20260709 12:12:41.494637 23794 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:41.495023 23794 raft_consensus.cc:493] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.495390 23794 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:41.500487 17404 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.511021 23834 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.511674 23834 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:41.513877 23834 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:41.521776 17188 catalog_manager.cc:5697] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 12 to 13, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 13 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.524170 17188 catalog_manager.cc:5697] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 12 to 13, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 13 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:41.526351 17406 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:41.530815 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:41.538327 17406 leader_election.cc:336] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:41.538486 17404 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.542825 17404 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.541133 23794 raft_consensus.cc:515] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.545583 17182 catalog_manager.cc:5697] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 16 to 17, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 17 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.549582 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c41ebef06654a43a98e69d0c065bba4" candidate_uuid: "e860f7e876b74ec589f447737822a4f6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "868a5e341d0a41b4ac0927342c8cd598"
I20260709 12:12:41.550244 18008 raft_consensus.cc:3060] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:41.547266 23794 leader_election.cc:290] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 election: Requested vote from peers aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675), 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68:34143)
I20260709 12:12:41.563051 18008 raft_consensus.cc:2468] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e860f7e876b74ec589f447737822a4f6 in term 18.
W20260709 12:12:41.569346 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:41.578258 17406 consensus_peers.cc:597] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:41.584409 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:41.574189 17407 leader_election.cc:304] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598, e860f7e876b74ec589f447737822a4f6; no voters: 
W20260709 12:12:41.575361 17978 consensus_peers.cc:597] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.573328 17404 leader_election.cc:336] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:41.586047 23834 raft_consensus.cc:2804] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:41.586607 23834 raft_consensus.cc:697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 18 LEADER]: Becoming Leader. State: Replica: e860f7e876b74ec589f447737822a4f6, State: Running, Role: LEADER
I20260709 12:12:41.587584 23834 consensus_queue.cc:237] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.586046 17404 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:41.593009 17182 catalog_manager.cc:5697] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 reported cstate change: term changed from 18 to 19, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to 868a5e341d0a41b4ac0927342c8cd598 (127.15.191.68). New cstate: current_term: 19 leader_uuid: "868a5e341d0a41b4ac0927342c8cd598" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.594727 23836 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:41.595932 17404 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.600406 17404 leader_election.cc:336] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
W20260709 12:12:41.623512 17404 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.623109 17182 catalog_manager.cc:5697] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 reported cstate change: term changed from 17 to 18, leader changed from aaafaad0810b4e95983d2d73ec814346 (127.15.191.66) to e860f7e876b74ec589f447737822a4f6 (127.15.191.67). New cstate: current_term: 18 leader_uuid: "e860f7e876b74ec589f447737822a4f6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:41.635852 17978 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.640377 17978 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.642560 17978 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.679090 17978 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.683455 17404 consensus_peers.cc:597] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.699460 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:41.702466 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:41.722882 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:41.744048 17978 consensus_peers.cc:597] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.760012 17441 raft_consensus.cc:1275] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:41.779001 23838 consensus_queue.cc:1048] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:41.789350 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:41.795866 17978 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.810091 17406 consensus_peers.cc:597] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:41.845947 17978 consensus_peers.cc:597] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:41.861963 17978 consensus_peers.cc:597] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.905134 23815 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:41.905776 23815 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:41.907934 23815 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:41.913318 17980 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:41.926725 17404 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:41.945479 17404 consensus_peers.cc:597] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:41.975163 18008 raft_consensus.cc:1275] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:41.978070 23836 consensus_queue.cc:1048] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:41.998361 17978 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:42.007477 17978 consensus_peers.cc:597] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.008059 17978 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:42.008438 17978 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:42.009514 23838 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:42.015875 17441 raft_consensus.cc:1275] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:42.022699 17437 raft_consensus.cc:1275] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:12:42.027305 17978 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:42.029181 17978 consensus_peers.cc:597] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:42.040879 23815 consensus_queue.cc:1048] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:42.042064 23838 consensus_queue.cc:1048] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:42.051680 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:42.051919 17978 consensus_peers.cc:597] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:42.060802 18008 raft_consensus.cc:1275] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Refusing update from remote peer e860f7e876b74ec589f447737822a4f6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:42.065263 23834 consensus_queue.cc:1048] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:42.065689 17978 consensus_peers.cc:597] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.099725 17404 consensus_peers.cc:597] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:42.119712 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:34143, user_credentials={real_user=slave}} blocked reactor thread for 56770.5us
I20260709 12:12:42.170677 17441 raft_consensus.cc:1275] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Refusing update from remote peer 868a5e341d0a41b4ac0927342c8cd598: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:42.172379 23838 consensus_queue.cc:1048] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:12:42.212469 16125 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 17388)
W20260709 12:12:42.230700 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:42.329257 17406 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:42.365029 23836 raft_consensus.cc:493] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:42.365590 23836 raft_consensus.cc:515] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:42.367827 23836 leader_election.cc:290] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:42.396574 17404 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
W20260709 12:12:42.408067 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:42.436841 23836 raft_consensus.cc:493] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:42.437644 23836 raft_consensus.cc:515] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:42.442113 23836 leader_election.cc:290] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:42.453377 17406 leader_election.cc:336] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:42.459661 17406 leader_election.cc:304] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:42.471266 17404 leader_election.cc:336] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:42.477555 23794 raft_consensus.cc:2749] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:42.487331 17406 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:42.489749 17406 leader_election.cc:336] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:42.490306 17406 leader_election.cc:304] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:42.491128 23836 raft_consensus.cc:2749] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:42.511842 17980 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:42.522044 17406 consensus_peers.cc:597] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:42.537446 23836 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:42.538407 23836 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:42.540720 23836 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:42.546128 17406 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:42.559262 17404 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:42.559780 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:42.561549 23836 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:42.629112 17980 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:42.690829 17406 consensus_peers.cc:597] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:42.733006 23836 raft_consensus.cc:493] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:42.733585 23836 raft_consensus.cc:515] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:42.736286 23836 leader_election.cc:290] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:42.768290 17404 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
W20260709 12:12:42.787259 17406 leader_election.cc:336] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:42.795560 17406 leader_election.cc:304] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:42.812594 23836 raft_consensus.cc:2749] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:42.772799 17980 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:42.828229 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 55480.6us
W20260709 12:12:42.975576 17980 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:43.214900 23866 raft_consensus.cc:493] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:43.215710 23866 raft_consensus.cc:515] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:43.218446 23866 leader_election.cc:290] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:43.719677 16125 tablet_server.cc:196] TabletServer@127.15.191.66:0 shutdown complete.
W20260709 12:12:43.894493 17980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 832174us
W20260709 12:12:43.899190 17978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 839600us
W20260709 12:12:43.916783 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 854784us
W20260709 12:12:43.918243 17406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:43395, user_credentials={real_user=slave}} blocked reactor thread for 273818us
I20260709 12:12:43.949174 23838 raft_consensus.cc:493] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:12:43.952986 17406 leader_election.cc:336] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:43.958781 23838 raft_consensus.cc:515] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:43.962972 23867 raft_consensus.cc:493] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:43.965240 23867 raft_consensus.cc:515] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
I20260709 12:12:43.965737 23838 leader_election.cc:290] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
I20260709 12:12:43.967679 23867 leader_election.cc:290] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:43.973451 17406 consensus_peers.cc:597] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:43.983093 17406 consensus_peers.cc:597] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:43.983688 17406 leader_election.cc:336] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:43.984858 23815 raft_consensus.cc:493] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:43.986652 23815 raft_consensus.cc:515] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
I20260709 12:12:43.989106 23815 leader_election.cc:290] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:43.990978 17406 consensus_peers.cc:597] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:43.978900 17980 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:44.014087 17406 consensus_peers.cc:597] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:12:44.056567 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:35675, user_credentials={real_user=slave}} blocked reactor thread for 60630.9us
W20260709 12:12:44.072834 17978 leader_election.cc:336] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:44.073647 23865 raft_consensus.cc:493] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
I20260709 12:12:44.086268 23865 raft_consensus.cc:515] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "e860f7e876b74ec589f447737822a4f6" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 34917 } }
W20260709 12:12:44.077257 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800172660 after lost signal to thread 16128
W20260709 12:12:44.088690 17221 debug-util.cc:398] Leaking SignalData structure 0x7b080038df80 after lost signal to thread 17224
W20260709 12:12:44.090309 17221 debug-util.cc:398] Leaking SignalData structure 0x7b080033d940 after lost signal to thread 17465
W20260709 12:12:44.091802 17221 debug-util.cc:398] Leaking SignalData structure 0x7b0800373c00 after lost signal to thread 18039
W20260709 12:12:44.092311 17221 debug-util.cc:398] Leaking SignalData structure 0x7b08002d59e0 after lost signal to thread 23847
I20260709 12:12:44.094157 23865 leader_election.cc:290] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:44.099924 17406 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:44.085520 17404 leader_election.cc:336] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:44.110502 17404 leader_election.cc:304] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:44.111502 23865 raft_consensus.cc:2749] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:44.094993 17980 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:12:44.116665 17404 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:44.118786 17404 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:44.118074 17980 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:44.122571 17980 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:44.123610 17980 leader_election.cc:336] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:44.128036 17980 leader_election.cc:336] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:44.133388 17980 leader_election.cc:304] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:44.130229 17978 consensus_peers.cc:597] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:44.134928 23876 raft_consensus.cc:2749] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:44.152951 17404 leader_election.cc:336] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:44.167194 17404 leader_election.cc:304] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
W20260709 12:12:44.153738 17978 leader_election.cc:336] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:44.168268 17978 leader_election.cc:304] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:44.169178 23876 raft_consensus.cc:2749] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.171489 23865 raft_consensus.cc:2749] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:44.176039 16125 tablet_server.cc:179] TabletServer@127.15.191.67:0 shutting down...
W20260709 12:12:44.176167 17404 leader_election.cc:336] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:44.177124 17404 leader_election.cc:304] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e860f7e876b74ec589f447737822a4f6; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:44.179104 23865 raft_consensus.cc:2749] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:44.222683 17404 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:44.275481 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:44.276692 16125 tablet_replica.cc:333] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.277657 16125 raft_consensus.cc:2243] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.278964 16125 raft_consensus.cc:2272] T d9108b2dade34abca8d8b1d985d2dc05 P e860f7e876b74ec589f447737822a4f6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.282002 16125 tablet_replica.cc:333] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.282927 16125 raft_consensus.cc:2243] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.283565 16125 raft_consensus.cc:2272] T ccfe00a9196e4e49a4ad7e72acd36c08 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.286444 16125 tablet_replica.cc:333] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.287514 16125 raft_consensus.cc:2243] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.288949 16125 raft_consensus.cc:2272] T 7912262477ba4fc0a074c658eed0d241 P e860f7e876b74ec589f447737822a4f6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.291822 16125 tablet_replica.cc:333] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.292680 16125 raft_consensus.cc:2243] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.293514 16125 raft_consensus.cc:2272] T dfb3d142442b4e3aada6416cb667a95b P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.296344 16125 tablet_replica.cc:333] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.297263 16125 raft_consensus.cc:2243] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.297868 16125 raft_consensus.cc:2272] T b3657462e03f42ac95c71bed480ca6a6 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.300827 16125 tablet_replica.cc:333] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.301728 16125 raft_consensus.cc:2243] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.302541 16125 raft_consensus.cc:2272] T a77855d79ba04cf1bf33cc20e8236abc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.305435 16125 tablet_replica.cc:333] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.306396 16125 raft_consensus.cc:2243] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.307649 16125 raft_consensus.cc:2272] T faefcc2755734398b9b0b1a778da9a50 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.310699 16125 tablet_replica.cc:333] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.311657 16125 raft_consensus.cc:2243] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.312880 16125 raft_consensus.cc:2272] T 6685bf7292cc44e09a9965668c0345cc P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.315754 16125 tablet_replica.cc:333] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.316691 16125 raft_consensus.cc:2243] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.324476 16125 raft_consensus.cc:2272] T b72f5fa94fdd4fedb64a0e5db13dc3a5 P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.325721 17406 consensus_peers.cc:597] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:12:44.327530 16125 tablet_replica.cc:333] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.328603 16125 raft_consensus.cc:2243] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.329331 16125 raft_consensus.cc:2272] T ff2e0aa678a447dcab13573f3577208e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.332322 16125 tablet_replica.cc:333] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.333290 16125 raft_consensus.cc:2243] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.334277 16125 raft_consensus.cc:2272] T 3673757d03f243668794c10285c7d1ff P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.338254 16125 tablet_replica.cc:333] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.339176 16125 raft_consensus.cc:2243] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.340560 16125 raft_consensus.cc:2272] T 6f4d0995911b4beb98abd9a7a508cddc P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.344574 16125 tablet_replica.cc:333] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.345527 16125 raft_consensus.cc:2243] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.346417 16125 raft_consensus.cc:2272] T 97e731eb30ed4f36ab13505e2cad7085 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.349521 16125 tablet_replica.cc:333] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.350683 16125 raft_consensus.cc:2243] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:44.351095 17978 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:44.351419 16125 raft_consensus.cc:2272] T d6c49969609c4c85a0a31036764369c0 P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.364154 17978 consensus_peers.cc:597] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:44.369104 16125 tablet_replica.cc:333] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
W20260709 12:12:44.369093 17980 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:12:44.370177 16125 raft_consensus.cc:2243] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.371554 16125 raft_consensus.cc:2272] T f462146b97ed46f2821bee27630d0218 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.376173 16125 tablet_replica.cc:333] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
W20260709 12:12:44.376183 17981 consensus_peers.cc:597] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.377791 16125 raft_consensus.cc:2243] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.378574 16125 raft_consensus.cc:2272] T 94fb1d5d8c204d70a68af6043f3ba9dd P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.382895 16125 tablet_replica.cc:333] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.383868 16125 raft_consensus.cc:2243] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.384720 16125 raft_consensus.cc:2272] T 4466b54543584a9898797997087d10f1 P e860f7e876b74ec589f447737822a4f6 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.385098 17406 consensus_peers.cc:597] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:44.391685 17981 consensus_peers.cc:597] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.385195 17980 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:44.400151 17404 consensus_peers.cc:597] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:44.409197 17981 consensus_peers.cc:597] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.410035 17406 consensus_peers.cc:597] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:12:44.392724 16125 tablet_replica.cc:333] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.416194 16125 raft_consensus.cc:2243] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.417055 16125 raft_consensus.cc:2272] T 4198acb44a394602a442737d55022d72 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.420121 16125 tablet_replica.cc:333] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.420892 16125 raft_consensus.cc:2243] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.421952 16125 raft_consensus.cc:2272] T 1c41ebef06654a43a98e69d0c065bba4 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.424437 16125 tablet_replica.cc:333] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.425206 16125 raft_consensus.cc:2243] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:44.443964 17404 consensus_peers.cc:597] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:44.449668 17404 consensus_peers.cc:597] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:44.451036 17406 consensus_peers.cc:597] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:12:44.458441 17981 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.426016 16125 raft_consensus.cc:2272] T ee22d4e5e05e423097297625d6158f21 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.469446 17981 consensus_peers.cc:597] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.468665 17978 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:44.470153 17978 consensus_peers.cc:597] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:44.481323 23815 raft_consensus.cc:493] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaafaad0810b4e95983d2d73ec814346)
W20260709 12:12:44.484949 17404 consensus_peers.cc:597] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:44.483683 16125 tablet_replica.cc:333] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.484438 23815 raft_consensus.cc:515] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "33539b233c2044afa31017244f6cc0d1" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 43395 } } peers { permanent_uuid: "aaafaad0810b4e95983d2d73ec814346" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 35675 } } peers { permanent_uuid: "868a5e341d0a41b4ac0927342c8cd598" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 34143 } attrs { promote: false } }
W20260709 12:12:44.493468 17980 consensus_peers.cc:597] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:12:44.499691 23815 leader_election.cc:290] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395), aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675)
W20260709 12:12:44.504477 17980 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:44.506673 16125 raft_consensus.cc:2243] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.507781 16125 raft_consensus.cc:2272] T 51babcffb8ce4ac99ebd5354a7c7d898 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.508469 17978 leader_election.cc:336] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111)
I20260709 12:12:44.508972 17978 leader_election.cc:304] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868a5e341d0a41b4ac0927342c8cd598; no voters: 33539b233c2044afa31017244f6cc0d1, aaafaad0810b4e95983d2d73ec814346
I20260709 12:12:44.509739 23815 raft_consensus.cc:2749] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:44.510218 16125 tablet_replica.cc:333] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.510902 16125 raft_consensus.cc:2243] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:44.488858 17981 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.511590 16125 raft_consensus.cc:2272] T 9367e72dd7c24f7e8aa4d479a069ed0e P e860f7e876b74ec589f447737822a4f6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.514496 16125 tablet_replica.cc:333] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.515443 16125 raft_consensus.cc:2243] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.516453 16125 raft_consensus.cc:2272] T e8f15a1b060b43ca9ea130feba217bcf P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.519344 16125 tablet_replica.cc:333] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.520188 16125 raft_consensus.cc:2243] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:44.521195 17981 consensus_peers.cc:597] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.521754 16125 raft_consensus.cc:2272] T e31ef54befbd4be3b1626005e275d427 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.524775 16125 tablet_replica.cc:333] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.525650 16125 raft_consensus.cc:2243] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.526306 16125 raft_consensus.cc:2272] T 623409527b5e49f3a95ae127569da2b0 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.521823 17981 consensus_peers.cc:597] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.528393 17981 consensus_peers.cc:597] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.529115 16125 tablet_replica.cc:333] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.530058 16125 raft_consensus.cc:2243] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.530751 16125 raft_consensus.cc:2272] T 51f32408cb854e64a70dc3560f27b02e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.535772 16125 tablet_replica.cc:333] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.537992 16125 raft_consensus.cc:2243] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.542905 16125 raft_consensus.cc:2272] T b55e72b6c888480d92e455681414fbb0 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.543046 17981 consensus_peers.cc:597] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.546036 17981 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.546152 16125 tablet_replica.cc:333] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.547606 16125 raft_consensus.cc:2243] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:12:44.548879 17981 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.548988 16125 raft_consensus.cc:2272] T eb339cd935184a289cfac7d49d2f74d3 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.553455 16125 tablet_replica.cc:333] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.554347 16125 raft_consensus.cc:2243] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:44.554728 17981 consensus_peers.cc:597] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.555500 17981 consensus_peers.cc:597] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.555573 16125 raft_consensus.cc:2272] T fe9b4ec086384e2b800cbd4d98e9fe33 P e860f7e876b74ec589f447737822a4f6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.558282 16125 tablet_replica.cc:333] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
W20260709 12:12:44.558348 17978 consensus_peers.cc:597] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:44.559597 16125 raft_consensus.cc:2243] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:12:44.559556 17981 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.562865 17981 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.563380 16125 raft_consensus.cc:2272] T f7130b980d9147f2b3915212d4028e03 P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.566562 16125 tablet_replica.cc:333] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.567505 16125 raft_consensus.cc:2243] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:44.563444 17981 consensus_peers.cc:597] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.568257 17981 consensus_peers.cc:597] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.568845 17981 consensus_peers.cc:597] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.569492 17981 consensus_peers.cc:597] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.572499 16125 raft_consensus.cc:2272] T 8789c06ba7714e709d794ce12c4141d1 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.575531 16125 tablet_replica.cc:333] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.576380 16125 raft_consensus.cc:2243] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.577028 16125 raft_consensus.cc:2272] T 8386bc0b5fc7467d87ca1ca69464e42e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.581053 16125 tablet_replica.cc:333] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.581907 16125 raft_consensus.cc:2243] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.583087 16125 raft_consensus.cc:2272] T 4b90fb9f510d4f0abcf7148b6fafae89 P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.585420 17978 consensus_peers.cc:597] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:44.585979 16125 tablet_replica.cc:333] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.586660 16125 raft_consensus.cc:2243] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.587154 16125 raft_consensus.cc:2272] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P e860f7e876b74ec589f447737822a4f6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.589499 16125 tablet_replica.cc:333] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.590078 16125 raft_consensus.cc:2243] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.590612 16125 raft_consensus.cc:2272] T 4ec8dfd95d9a45c2a5becdfb706a42fb P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.593956 16125 tablet_replica.cc:333] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.595187 16125 raft_consensus.cc:2243] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:44.595300 17981 consensus_peers.cc:597] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer e860f7e876b74ec589f447737822a4f6 (127.15.191.67:34917): Couldn't send request to peer e860f7e876b74ec589f447737822a4f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.596110 16125 raft_consensus.cc:2272] T 62f5a9a5a773414fa979e4e68b31bb5d P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.598484 16125 tablet_replica.cc:333] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.599100 16125 raft_consensus.cc:2243] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.600009 16125 raft_consensus.cc:2272] T c44e7f48dd474ca1a12a7ac7251f4c6f P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.602065 16125 tablet_replica.cc:333] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.602634 16125 raft_consensus.cc:2243] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.603255 16125 raft_consensus.cc:2272] T 18a366d5769a4ed9bb2b1e32afb26cd3 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.605221 16125 tablet_replica.cc:333] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.605779 16125 raft_consensus.cc:2243] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.606339 16125 raft_consensus.cc:2272] T 4ddf5e2cbdb748f7a7ed880493377874 P e860f7e876b74ec589f447737822a4f6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.608433 16125 tablet_replica.cc:333] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.608943 16125 raft_consensus.cc:2243] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.609546 16125 raft_consensus.cc:2272] T 6bbcd6d92bbd4175a2f8233eb40726ad P e860f7e876b74ec589f447737822a4f6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.611660 16125 tablet_replica.cc:333] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.612195 16125 raft_consensus.cc:2243] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.612767 16125 raft_consensus.cc:2272] T 119706da80854a2680f098d29fac4c43 P e860f7e876b74ec589f447737822a4f6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.614984 16125 tablet_replica.cc:333] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.615558 16125 raft_consensus.cc:2243] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.616670 16125 raft_consensus.cc:2272] T 93c0e960dcac478bbf09add686ea3b3c P e860f7e876b74ec589f447737822a4f6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.618762 16125 tablet_replica.cc:333] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.619290 16125 raft_consensus.cc:2243] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.620515 16125 raft_consensus.cc:2272] T 539116186b9c4b269f16afb90a4654f4 P e860f7e876b74ec589f447737822a4f6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.622615 16125 tablet_replica.cc:333] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.623096 16125 raft_consensus.cc:2243] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.623932 16125 raft_consensus.cc:2272] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P e860f7e876b74ec589f447737822a4f6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.625811 16125 tablet_replica.cc:333] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.626379 16125 raft_consensus.cc:2243] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.627527 16125 raft_consensus.cc:2272] T 12b75d8684e5472b87d6b3acb0ef9d2e P e860f7e876b74ec589f447737822a4f6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.629827 16125 tablet_replica.cc:333] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6: stopping tablet replica
I20260709 12:12:44.630383 16125 raft_consensus.cc:2243] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.631302 16125 raft_consensus.cc:2272] T 3a03a1e696734298850b94830af8a727 P e860f7e876b74ec589f447737822a4f6 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.804905 17980 consensus_peers.cc:597] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:44.842370 17978 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:44.883004 17978 consensus_peers.cc:597] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:44.883570 17978 consensus_peers.cc:597] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:45.034984 17980 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:45.048799 17978 consensus_peers.cc:597] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:45.055141 17978 consensus_peers.cc:597] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:45.056564 17978 consensus_peers.cc:597] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:45.058918 17980 consensus_peers.cc:597] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:45.089665 17980 consensus_peers.cc:597] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:45.097565 17978 consensus_peers.cc:597] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:45.102006 17978 consensus_peers.cc:597] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:45.116547 17978 consensus_peers.cc:597] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:45.119277 17978 consensus_peers.cc:597] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:45.149749 17980 consensus_peers.cc:597] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:45.150400 17980 consensus_peers.cc:597] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:12:45.158761 17978 consensus_peers.cc:597] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:45.162492 17978 consensus_peers.cc:597] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:45.181073 17978 consensus_peers.cc:597] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:45.246376 16125 tablet_server.cc:196] TabletServer@127.15.191.67:0 shutdown complete.
W20260709 12:12:45.280763 17978 consensus_peers.cc:597] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer aaafaad0810b4e95983d2d73ec814346 (127.15.191.66:35675): Couldn't send request to peer aaafaad0810b4e95983d2d73ec814346. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:35675: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:45.392341 16125 tablet_server.cc:179] TabletServer@127.15.191.68:0 shutting down...
W20260709 12:12:45.414963 17980 consensus_peers.cc:597] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:12:45.458376 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:45.461017 16125 tablet_replica.cc:333] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.462188 16125 raft_consensus.cc:2243] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.463418 16125 raft_consensus.cc:2272] T d6c49969609c4c85a0a31036764369c0 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.467044 16125 tablet_replica.cc:333] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.468528 16125 raft_consensus.cc:2243] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.469551 16125 raft_consensus.cc:2272] T f7130b980d9147f2b3915212d4028e03 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.473320 16125 tablet_replica.cc:333] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.474576 16125 raft_consensus.cc:2243] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.475812 16125 raft_consensus.cc:2272] T 1c41ebef06654a43a98e69d0c065bba4 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.478709 16125 tablet_replica.cc:333] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.479660 16125 raft_consensus.cc:2243] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.480551 16125 raft_consensus.cc:2272] T 7912262477ba4fc0a074c658eed0d241 P 868a5e341d0a41b4ac0927342c8cd598 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.483754 16125 tablet_replica.cc:333] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.484753 16125 raft_consensus.cc:2243] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.485816 16125 raft_consensus.cc:2272] T b55e72b6c888480d92e455681414fbb0 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.489185 16125 tablet_replica.cc:333] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.490235 16125 raft_consensus.cc:2243] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.497787 16125 raft_consensus.cc:2272] T e31ef54befbd4be3b1626005e275d427 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.501631 16125 tablet_replica.cc:333] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.502703 16125 raft_consensus.cc:2243] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.504089 16125 raft_consensus.cc:2272] T 814b69784b0f4c3d8b07d13d54ae4b47 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.507381 16125 tablet_replica.cc:333] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.508375 16125 raft_consensus.cc:2243] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.509066 16125 raft_consensus.cc:2272] T faefcc2755734398b9b0b1a778da9a50 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:45.510936 17980 consensus_peers.cc:597] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:12:45.512349 16125 tablet_replica.cc:333] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.513377 16125 raft_consensus.cc:2243] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.514684 16125 raft_consensus.cc:2272] T f7c3705a9e0e457898a7061b4170a8a1 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.517773 16125 tablet_replica.cc:333] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.518711 16125 raft_consensus.cc:2243] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.519979 16125 raft_consensus.cc:2272] T 4198acb44a394602a442737d55022d72 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.523171 16125 tablet_replica.cc:333] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.524139 16125 raft_consensus.cc:2243] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.524976 16125 raft_consensus.cc:2272] T bd0b7d359bb7400c8b795e1b6f9dd1a2 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.527947 16125 tablet_replica.cc:333] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.528793 16125 raft_consensus.cc:2243] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.533128 16125 raft_consensus.cc:2272] T 8789c06ba7714e709d794ce12c4141d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.537590 16125 tablet_replica.cc:333] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.540933 16125 raft_consensus.cc:2243] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.542295 16125 raft_consensus.cc:2272] T c6728648e29b471c950575a72ecf0454 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.545104 16125 tablet_replica.cc:333] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.546021 16125 raft_consensus.cc:2243] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.547286 16125 raft_consensus.cc:2272] T b3657462e03f42ac95c71bed480ca6a6 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.550228 16125 tablet_replica.cc:333] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.551275 16125 raft_consensus.cc:2243] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.552383 16125 raft_consensus.cc:2272] T 8f950276bbbb4642872e9280fad2a766 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.555387 16125 tablet_replica.cc:333] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.556309 16125 raft_consensus.cc:2243] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.557545 16125 raft_consensus.cc:2272] T 12759295b3a947cca3d2c7fc3c815e59 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.560590 16125 tablet_replica.cc:333] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.561496 16125 raft_consensus.cc:2243] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.562806 16125 raft_consensus.cc:2272] T a9955d24ad7243689a5a438424f992e9 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.565635 16125 tablet_replica.cc:333] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.566562 16125 raft_consensus.cc:2243] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.567801 16125 raft_consensus.cc:2272] T 623409527b5e49f3a95ae127569da2b0 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.570689 16125 tablet_replica.cc:333] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.571601 16125 raft_consensus.cc:2243] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:45.572382 17980 consensus_peers.cc:597] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 -> Peer 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): Couldn't send request to peer 33539b233c2044afa31017244f6cc0d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:12:45.572432 16125 raft_consensus.cc:2272] T ff74c08559a64593bfe9cdc08a3b96d1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.577212 16125 tablet_replica.cc:333] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.578992 16125 raft_consensus.cc:2243] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.581224 16125 raft_consensus.cc:2272] T 5d769dc29730489bb1bc366ea38bf391 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.585672 16125 tablet_replica.cc:333] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.586635 16125 raft_consensus.cc:2243] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.587922 16125 raft_consensus.cc:2272] T 6bbcd6d92bbd4175a2f8233eb40726ad P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.591179 16125 tablet_replica.cc:333] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.592162 16125 raft_consensus.cc:2243] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.593312 16125 raft_consensus.cc:2272] T 94fb1d5d8c204d70a68af6043f3ba9dd P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.596082 16125 tablet_replica.cc:333] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.596938 16125 raft_consensus.cc:2243] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.598295 16125 raft_consensus.cc:2272] T d7f622d20c7b40a296d381dcc9b82704 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.601074 16125 tablet_replica.cc:333] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.601943 16125 raft_consensus.cc:2243] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.603117 16125 raft_consensus.cc:2272] T 119706da80854a2680f098d29fac4c43 P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.606003 16125 tablet_replica.cc:333] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.606906 16125 raft_consensus.cc:2243] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.607493 16125 raft_consensus.cc:2272] T 6f4d0995911b4beb98abd9a7a508cddc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.610623 16125 tablet_replica.cc:333] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.611567 16125 raft_consensus.cc:2243] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.612829 16125 raft_consensus.cc:2272] T ee22d4e5e05e423097297625d6158f21 P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.615722 16125 tablet_replica.cc:333] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.616633 16125 raft_consensus.cc:2243] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.617211 16125 raft_consensus.cc:2272] T fd27279c3e8c4e0cbe30a2cbe7e56ab1 P 868a5e341d0a41b4ac0927342c8cd598 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.619987 16125 tablet_replica.cc:333] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.620724 16125 raft_consensus.cc:2243] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.621912 16125 raft_consensus.cc:2272] T 8832d652d7004314892ca1c18bd94f7c P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.624804 16125 tablet_replica.cc:333] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.625623 16125 raft_consensus.cc:2243] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.626739 16125 raft_consensus.cc:2272] T 4ddf5e2cbdb748f7a7ed880493377874 P 868a5e341d0a41b4ac0927342c8cd598 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.629485 16125 tablet_replica.cc:333] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.630311 16125 raft_consensus.cc:2243] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.631072 16125 raft_consensus.cc:2272] T 9ff441a2f8cb4ea9b0e9a4bec55d843b P 868a5e341d0a41b4ac0927342c8cd598 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.633808 16125 tablet_replica.cc:333] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.634626 16125 raft_consensus.cc:2243] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.635913 16125 raft_consensus.cc:2272] T b9356b25ee58416ca89b944be6f0b562 P 868a5e341d0a41b4ac0927342c8cd598 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.638865 16125 tablet_replica.cc:333] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.639680 16125 raft_consensus.cc:2243] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.640756 16125 raft_consensus.cc:2272] T 4ec8dfd95d9a45c2a5becdfb706a42fb P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.643394 16125 tablet_replica.cc:333] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.644166 16125 raft_consensus.cc:2243] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.645233 16125 raft_consensus.cc:2272] T ff2e0aa678a447dcab13573f3577208e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.648020 16125 tablet_replica.cc:333] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.648847 16125 raft_consensus.cc:2243] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.649953 16125 raft_consensus.cc:2272] T 97e731eb30ed4f36ab13505e2cad7085 P 868a5e341d0a41b4ac0927342c8cd598 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.652792 16125 tablet_replica.cc:333] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.653532 16125 raft_consensus.cc:2243] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.654744 16125 raft_consensus.cc:2272] T 8386bc0b5fc7467d87ca1ca69464e42e P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.657539 16125 tablet_replica.cc:333] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.658365 16125 raft_consensus.cc:2243] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.659439 16125 raft_consensus.cc:2272] T a77855d79ba04cf1bf33cc20e8236abc P 868a5e341d0a41b4ac0927342c8cd598 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.662129 16125 tablet_replica.cc:333] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.662848 16125 raft_consensus.cc:2243] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.663936 16125 raft_consensus.cc:2272] T 9367e72dd7c24f7e8aa4d479a069ed0e P 868a5e341d0a41b4ac0927342c8cd598 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.666589 16125 tablet_replica.cc:333] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.667423 16125 raft_consensus.cc:2243] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:45.668251 16125 raft_consensus.cc:2272] T 539116186b9c4b269f16afb90a4654f4 P 868a5e341d0a41b4ac0927342c8cd598 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.671540 16125 tablet_replica.cc:333] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.672254 16125 raft_consensus.cc:2243] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.673369 16125 raft_consensus.cc:2272] T d582e1abf9be42689682da4cee6206c8 P 868a5e341d0a41b4ac0927342c8cd598 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.676055 16125 tablet_replica.cc:333] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.676734 16125 raft_consensus.cc:2243] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.677824 16125 raft_consensus.cc:2272] T fe9b4ec086384e2b800cbd4d98e9fe33 P 868a5e341d0a41b4ac0927342c8cd598 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.680438 16125 tablet_replica.cc:333] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.681119 16125 raft_consensus.cc:2243] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.682178 16125 raft_consensus.cc:2272] T 4466b54543584a9898797997087d10f1 P 868a5e341d0a41b4ac0927342c8cd598 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:45.684948 16125 tablet_replica.cc:333] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598: stopping tablet replica
I20260709 12:12:45.685612 16125 raft_consensus.cc:2243] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:45.686718 16125 raft_consensus.cc:2272] T 4b90fb9f510d4f0abcf7148b6fafae89 P 868a5e341d0a41b4ac0927342c8cd598 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.186700 16125 tablet_server.cc:196] TabletServer@127.15.191.68:0 shutdown complete.
I20260709 12:12:46.257890 16125 master.cc:562] Master@127.15.191.126:37225 shutting down...
W20260709 12:12:46.297168 17238 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:12:46.297505 17238 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:12:46.297724 17238 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:12:47.621038 17176 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111) [suppressed 653 similar messages]
W20260709 12:12:47.624267 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d6c49969609c4c85a0a31036764369c0: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
W20260709 12:12:54.491948 17176 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260709 12:12:54.497788 17176 catalog_manager.cc:4755] TS 33539b233c2044afa31017244f6cc0d1 (127.15.191.65:43395): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1c41ebef06654a43a98e69d0c065bba4: Network error: Client connection negotiation failed: client connection to 127.15.191.65:43395: connect: Connection refused (error 111)
I20260709 12:12:55.027566 16125 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:55.028651 16125 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:55.029023 16125 tablet_replica.cc:333] T 00000000000000000000000000000000 P 437023cdfca24d7494e0818062a37383: stopping tablet replica
I20260709 12:12:55.245848 16125 master.cc:584] Master@127.15.191.126:37225 shutdown complete.
I20260709 12:12:55.300673 16125 test_util.cc:182] -----------------------------------------------
I20260709 12:12:55.300904 16125 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598892377095-16125-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (222571 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:12:55.304608 16125 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.191.126:35665
I20260709 12:12:55.305752 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:55.311587 23890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.312001 23891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.312979 23893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.314594 16125 server_base.cc:1061] running on GCE node
I20260709 12:12:55.317337 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:55.317562 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:55.317701 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599175317684 us; error 0 us; skew 500 ppm
I20260709 12:12:55.318298 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:55.321059 16125 webserver.cc:533] Webserver started at http://127.15.191.126:46661/ using document root <none> and password file <none>
I20260709 12:12:55.321622 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:55.321794 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:55.322077 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:55.323428 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/master-0-root/instance:
uuid: "d768674e8707438e9f056125e7c36c7e"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.328349 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:12:55.332203 23898 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.333093 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:55.333431 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/master-0-root
uuid: "d768674e8707438e9f056125e7c36c7e"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.333725 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:55.355684 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:55.356997 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:55.397229 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.126:35665
I20260709 12:12:55.397329 23949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.126:35665 every 8 connection(s)
I20260709 12:12:55.401505 23950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.413371 23950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e: Bootstrap starting.
I20260709 12:12:55.418635 23950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.423204 23950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e: No bootstrap required, opened a new log
I20260709 12:12:55.425524 23950 raft_consensus.cc:359] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d768674e8707438e9f056125e7c36c7e" member_type: VOTER }
I20260709 12:12:55.426004 23950 raft_consensus.cc:385] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.426241 23950 raft_consensus.cc:740] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d768674e8707438e9f056125e7c36c7e, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.426921 23950 consensus_queue.cc:260] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d768674e8707438e9f056125e7c36c7e" member_type: VOTER }
I20260709 12:12:55.427479 23950 raft_consensus.cc:399] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:55.427693 23950 raft_consensus.cc:493] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:55.427920 23950 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.432899 23950 raft_consensus.cc:515] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d768674e8707438e9f056125e7c36c7e" member_type: VOTER }
I20260709 12:12:55.433450 23950 leader_election.cc:304] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d768674e8707438e9f056125e7c36c7e; no voters: 
I20260709 12:12:55.434654 23950 leader_election.cc:290] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:55.434993 23953 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.436378 23953 raft_consensus.cc:697] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 1 LEADER]: Becoming Leader. State: Replica: d768674e8707438e9f056125e7c36c7e, State: Running, Role: LEADER
I20260709 12:12:55.437134 23953 consensus_queue.cc:237] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d768674e8707438e9f056125e7c36c7e" member_type: VOTER }
I20260709 12:12:55.437608 23950 sys_catalog.cc:565] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:55.443780 23955 sys_catalog.cc:455] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d768674e8707438e9f056125e7c36c7e. Latest consensus state: current_term: 1 leader_uuid: "d768674e8707438e9f056125e7c36c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d768674e8707438e9f056125e7c36c7e" member_type: VOTER } }
I20260709 12:12:55.444502 23955 sys_catalog.cc:458] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:55.444954 23954 sys_catalog.cc:455] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d768674e8707438e9f056125e7c36c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d768674e8707438e9f056125e7c36c7e" member_type: VOTER } }
I20260709 12:12:55.445616 23954 sys_catalog.cc:458] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:55.446739 23961 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:55.454169 23961 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:55.455188 16125 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:55.463371 23961 catalog_manager.cc:1383] Generated new cluster ID: 3fdf9c9c4e0b474d9f6486ae1fc71782
I20260709 12:12:55.463739 23961 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:55.491215 23961 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:55.492596 23961 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:55.511188 23961 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e: Generated new TSK 0
I20260709 12:12:55.511824 23961 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:55.522274 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:55.528820 23971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.530194 23972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.531543 23974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.532466 16125 server_base.cc:1061] running on GCE node
I20260709 12:12:55.534698 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:55.534898 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:55.535112 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599175535065 us; error 0 us; skew 500 ppm
I20260709 12:12:55.535679 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:55.538004 16125 webserver.cc:533] Webserver started at http://127.15.191.65:37079/ using document root <none> and password file <none>
I20260709 12:12:55.538543 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:55.538731 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:55.539000 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:55.540247 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/instance:
uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.545105 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:55.549084 23979 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.549969 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:55.550319 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.550595 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:55.567477 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:55.568675 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:55.570256 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:55.572764 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:55.572955 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.573212 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:55.573370 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.615717 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:39103
I20260709 12:12:55.615818 24041 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:39103 every 8 connection(s)
I20260709 12:12:55.621250 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:55.629734 24046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.630928 24047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.634948 24049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.635007 16125 server_base.cc:1061] running on GCE node
I20260709 12:12:55.638289 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:55.638597 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:55.638814 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599175638794 us; error 0 us; skew 500 ppm
I20260709 12:12:55.639207 24042 heartbeater.cc:344] Connected to a master server at 127.15.191.126:35665
I20260709 12:12:55.639551 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:55.639622 24042 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:55.640590 24042 heartbeater.cc:507] Master 127.15.191.126:35665 requested a full tablet report, sending...
I20260709 12:12:55.642675 16125 webserver.cc:533] Webserver started at http://127.15.191.66:46617/ using document root <none> and password file <none>
I20260709 12:12:55.643186 23915 ts_manager.cc:194] Registered new tserver with Master: 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:55.643457 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:55.643749 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:55.644093 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:55.645800 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/instance:
uuid: "7beb24294eb94c1c8cf7659b8c507b46"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.645903 23915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51206
I20260709 12:12:55.651247 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:55.655150 24054 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.655982 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:12:55.656256 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-1-root
uuid: "7beb24294eb94c1c8cf7659b8c507b46"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.656507 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:55.671316 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:55.672628 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:55.674081 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:55.676438 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:55.676627 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.676869 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:55.677019 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.720444 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.66:38037
I20260709 12:12:55.720533 24116 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.66:38037 every 8 connection(s)
I20260709 12:12:55.725950 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:55.734148 24120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.735252 24121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.738586 16125 server_base.cc:1061] running on GCE node
W20260709 12:12:55.738696 24123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.740026 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:55.740082 24117 heartbeater.cc:344] Connected to a master server at 127.15.191.126:35665
W20260709 12:12:55.740382 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:55.740564 24117 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:55.740609 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599175740588 us; error 0 us; skew 500 ppm
I20260709 12:12:55.741596 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:55.741726 24117 heartbeater.cc:507] Master 127.15.191.126:35665 requested a full tablet report, sending...
I20260709 12:12:55.744217 23915 ts_manager.cc:194] Registered new tserver with Master: 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:55.744475 16125 webserver.cc:533] Webserver started at http://127.15.191.67:46841/ using document root <none> and password file <none>
I20260709 12:12:55.745002 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:55.745180 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:55.745427 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:55.745793 23915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51216
I20260709 12:12:55.746834 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/instance:
uuid: "64549835910a439993d28800bb571368"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.751682 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:12:55.755532 24128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.756294 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:12:55.756644 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-2-root
uuid: "64549835910a439993d28800bb571368"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.757025 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:55.767256 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:55.768486 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:55.769954 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:55.772668 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:55.772927 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.773193 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:55.773339 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.815392 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.67:35877
I20260709 12:12:55.815501 24190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.67:35877 every 8 connection(s)
I20260709 12:12:55.820376 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:55.828030 24194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.829608 24195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.831350 16125 server_base.cc:1061] running on GCE node
W20260709 12:12:55.832088 24197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.833192 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:55.833489 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:55.833711 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599175833690 us; error 0 us; skew 500 ppm
I20260709 12:12:55.834298 24191 heartbeater.cc:344] Connected to a master server at 127.15.191.126:35665
I20260709 12:12:55.834481 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:55.834702 24191 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:55.835588 24191 heartbeater.cc:507] Master 127.15.191.126:35665 requested a full tablet report, sending...
I20260709 12:12:55.837211 16125 webserver.cc:533] Webserver started at http://127.15.191.68:35667/ using document root <none> and password file <none>
I20260709 12:12:55.837774 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:55.837962 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:55.837883 23915 ts_manager.cc:194] Registered new tserver with Master: 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:55.838446 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:55.839704 23915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51224
I20260709 12:12:55.839747 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-3-root/instance:
uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.844868 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:55.848546 24202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.849407 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:55.849726 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-3-root
uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:12:55.850006 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:55.868250 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:55.869565 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:55.871146 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:55.873436 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:55.873658 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.873885 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:55.874040 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.916025 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.68:38373
I20260709 12:12:55.916123 24264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.68:38373 every 8 connection(s)
I20260709 12:12:55.931545 24265 heartbeater.cc:344] Connected to a master server at 127.15.191.126:35665
I20260709 12:12:55.931984 24265 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:55.933097 24265 heartbeater.cc:507] Master 127.15.191.126:35665 requested a full tablet report, sending...
I20260709 12:12:55.935181 23915 ts_manager.cc:194] Registered new tserver with Master: a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:55.936110 16125 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016641998s
I20260709 12:12:55.936885 23915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51228
I20260709 12:12:55.964828 23915 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51234:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:12:56.212786 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 9b9e9352fdad40bca805117f2fdbaaa3 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:56.214412 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9e9352fdad40bca805117f2fdbaaa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.215847 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 407b0af97117450fb56d6991d8fa8649 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:56.217307 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407b0af97117450fb56d6991d8fa8649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.213956 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 172aa0d42e8646ce8e9b3ef01f4628d6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:56.218978 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172aa0d42e8646ce8e9b3ef01f4628d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.223404 24155 tablet_service.cc:1511] Processing CreateTablet for tablet 07bf8aa11eb9402cbf4870c19cce296a (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:56.224447 24152 tablet_service.cc:1511] Processing CreateTablet for tablet 255ee2f56d7d4b8fa52384cf5cb1def8 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:56.227094 24151 tablet_service.cc:1511] Processing CreateTablet for tablet 890a157efb254124a8fa371cfcda5616 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:56.231333 24229 tablet_service.cc:1511] Processing CreateTablet for tablet df9e86df293f4b48931332e8e90ea10e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:56.232774 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df9e86df293f4b48931332e8e90ea10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.235356 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 407b0af97117450fb56d6991d8fa8649 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:56.236845 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407b0af97117450fb56d6991d8fa8649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.238124 24007 tablet_service.cc:1511] Processing CreateTablet for tablet 07bf8aa11eb9402cbf4870c19cce296a (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:56.239661 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bf8aa11eb9402cbf4870c19cce296a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.241180 24226 tablet_service.cc:1511] Processing CreateTablet for tablet 255ee2f56d7d4b8fa52384cf5cb1def8 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:56.243337 24006 tablet_service.cc:1511] Processing CreateTablet for tablet df9e86df293f4b48931332e8e90ea10e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:56.243753 24225 tablet_service.cc:1511] Processing CreateTablet for tablet 890a157efb254124a8fa371cfcda5616 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:56.244942 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df9e86df293f4b48931332e8e90ea10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.246475 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 7559f65287ff4852a45d740197ae4aba (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:56.247273 24005 tablet_service.cc:1511] Processing CreateTablet for tablet 407b0af97117450fb56d6991d8fa8649 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:56.239284 24227 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdd42c9876a43b087358f4d8b08b81b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:56.229524 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 9b9e9352fdad40bca805117f2fdbaaa3 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:56.224937 24155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bf8aa11eb9402cbf4870c19cce296a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.248886 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407b0af97117450fb56d6991d8fa8649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.250476 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 172aa0d42e8646ce8e9b3ef01f4628d6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:56.252214 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172aa0d42e8646ce8e9b3ef01f4628d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.252822 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255ee2f56d7d4b8fa52384cf5cb1def8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.254207 24151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890a157efb254124a8fa371cfcda5616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.254618 24003 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdd42c9876a43b087358f4d8b08b81b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:56.255487 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7559f65287ff4852a45d740197ae4aba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.256261 24003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdd42c9876a43b087358f4d8b08b81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.258638 24002 tablet_service.cc:1511] Processing CreateTablet for tablet 255ee2f56d7d4b8fa52384cf5cb1def8 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:56.260488 24002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255ee2f56d7d4b8fa52384cf5cb1def8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.260890 24227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdd42c9876a43b087358f4d8b08b81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.262220 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9e9352fdad40bca805117f2fdbaaa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.262864 24001 tablet_service.cc:1511] Processing CreateTablet for tablet 7559f65287ff4852a45d740197ae4aba (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:56.263499 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890a157efb254124a8fa371cfcda5616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.264593 24001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7559f65287ff4852a45d740197ae4aba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.264963 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255ee2f56d7d4b8fa52384cf5cb1def8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.269636 24149 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca6ef4edba6432d990cf875232d420b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:56.271442 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca6ef4edba6432d990cf875232d420b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.272482 23999 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca6ef4edba6432d990cf875232d420b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:56.270220 24000 tablet_service.cc:1511] Processing CreateTablet for tablet 86266bc0f0914a64b02089b09f4d3b72 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:56.275624 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca6ef4edba6432d990cf875232d420b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.277082 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86266bc0f0914a64b02089b09f4d3b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.293120 24148 tablet_service.cc:1511] Processing CreateTablet for tablet b4028cf0a93848479c9e713d7e2bc5d6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:56.294708 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4028cf0a93848479c9e713d7e2bc5d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.299911 23998 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9744f06e3f482d89a3a72e5a9c09bf (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:56.301497 23998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9744f06e3f482d89a3a72e5a9c09bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.303194 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9744f06e3f482d89a3a72e5a9c09bf (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:56.304620 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9744f06e3f482d89a3a72e5a9c09bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.308241 24224 tablet_service.cc:1511] Processing CreateTablet for tablet 86266bc0f0914a64b02089b09f4d3b72 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:56.309768 24224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86266bc0f0914a64b02089b09f4d3b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.309595 24147 tablet_service.cc:1511] Processing CreateTablet for tablet 06cfd576beb2433d8ab615466d50bcc2 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:56.311203 24147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cfd576beb2433d8ab615466d50bcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.311792 24223 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca6ef4edba6432d990cf875232d420b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:56.318516 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca6ef4edba6432d990cf875232d420b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.291602 24282 tablet_bootstrap.cc:492] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:56.339265 24222 tablet_service.cc:1511] Processing CreateTablet for tablet b4028cf0a93848479c9e713d7e2bc5d6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:56.340782 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4028cf0a93848479c9e713d7e2bc5d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.343953 24221 tablet_service.cc:1511] Processing CreateTablet for tablet 3e594133f84a47ecacfe0bf75b3bc5fc (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:56.345472 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e594133f84a47ecacfe0bf75b3bc5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.363720 24282 tablet_bootstrap.cc:654] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.388278 24148 tablet_service.cc:1511] Processing CreateTablet for tablet f203904cd1b94afca969b8b361e196b8 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:56.389791 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f203904cd1b94afca969b8b361e196b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.392743 24147 tablet_service.cc:1511] Processing CreateTablet for tablet 436b14790f4a4768ae4f66430c025d3b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:56.378240 24006 tablet_service.cc:1511] Processing CreateTablet for tablet 3e594133f84a47ecacfe0bf75b3bc5fc (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:56.394893 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e594133f84a47ecacfe0bf75b3bc5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.405292 24147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436b14790f4a4768ae4f66430c025d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.425835 24284 tablet_bootstrap.cc:492] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:56.437196 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 06cfd576beb2433d8ab615466d50bcc2 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:56.441785 24155 tablet_service.cc:1511] Processing CreateTablet for tablet 222f5f64725d4c94803b2d55242cc5dd (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:56.443262 24155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222f5f64725d4c94803b2d55242cc5dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:56.450639 23963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:56.469982 24285 tablet_bootstrap.cc:492] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:56.471160 24004 tablet_service.cc:1511] Processing CreateTablet for tablet b860e1a11c0242ad8dae706485a5419b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:56.472594 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b860e1a11c0242ad8dae706485a5419b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.450438 24007 tablet_service.cc:1511] Processing CreateTablet for tablet 06cfd576beb2433d8ab615466d50bcc2 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:56.476452 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cfd576beb2433d8ab615466d50bcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.468443 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cfd576beb2433d8ab615466d50bcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.482753 24284 tablet_bootstrap.cc:654] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.493835 24006 tablet_service.cc:1511] Processing CreateTablet for tablet 222f5f64725d4c94803b2d55242cc5dd (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:56.495261 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222f5f64725d4c94803b2d55242cc5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.483098 24152 tablet_service.cc:1511] Processing CreateTablet for tablet 3e13faa2c04f46039c7c9b1d8021cbd0 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:56.498611 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e13faa2c04f46039c7c9b1d8021cbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.499712 24282 tablet_bootstrap.cc:492] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:56.500263 24282 ts_tablet_manager.cc:1403] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.209s	user 0.020s	sys 0.013s
I20260709 12:12:56.503098 24003 tablet_service.cc:1511] Processing CreateTablet for tablet 436b14790f4a4768ae4f66430c025d3b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:56.504485 24003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436b14790f4a4768ae4f66430c025d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.505328 23998 tablet_service.cc:1511] Processing CreateTablet for tablet 236a44f6e6b740ebbf1fb3b1f367f36a (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:56.468165 24224 tablet_service.cc:1511] Processing CreateTablet for tablet bd24d61e68c14dc19d3ad5de5931d613 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:56.514364 24149 tablet_service.cc:1511] Processing CreateTablet for tablet c34a6dd30e6245b78f15838141fac042 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:56.515730 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 222f5f64725d4c94803b2d55242cc5dd (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:56.483810 24153 tablet_service.cc:1511] Processing CreateTablet for tablet b860e1a11c0242ad8dae706485a5419b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:56.523013 24282 raft_consensus.cc:359] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:56.515650 24224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24d61e68c14dc19d3ad5de5931d613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.523845 24282 raft_consensus.cc:385] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.524187 24282 raft_consensus.cc:740] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.450438 24225 tablet_service.cc:1511] Processing CreateTablet for tablet f203904cd1b94afca969b8b361e196b8 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:56.489511 24002 tablet_service.cc:1511] Processing CreateTablet for tablet bd24d61e68c14dc19d3ad5de5931d613 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:56.527091 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdd42c9876a43b087358f4d8b08b81b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:56.531178 24075 tablet_service.cc:1511] Processing CreateTablet for tablet 86266bc0f0914a64b02089b09f4d3b72 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:56.532073 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdd42c9876a43b087358f4d8b08b81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.533035 24074 tablet_service.cc:1511] Processing CreateTablet for tablet b4028cf0a93848479c9e713d7e2bc5d6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:56.533470 24080 tablet_service.cc:1511] Processing CreateTablet for tablet df9e86df293f4b48931332e8e90ea10e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:56.528160 24227 tablet_service.cc:1511] Processing CreateTablet for tablet 236a44f6e6b740ebbf1fb3b1f367f36a (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:56.534948 24227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236a44f6e6b740ebbf1fb3b1f367f36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.535208 24077 tablet_service.cc:1511] Processing CreateTablet for tablet 890a157efb254124a8fa371cfcda5616 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:56.535769 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f203904cd1b94afca969b8b361e196b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.537001 24076 tablet_service.cc:1511] Processing CreateTablet for tablet 7559f65287ff4852a45d740197ae4aba (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:56.534883 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df9e86df293f4b48931332e8e90ea10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.540253 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 07bf8aa11eb9402cbf4870c19cce296a (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:56.541734 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bf8aa11eb9402cbf4870c19cce296a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.528882 24079 tablet_service.cc:1511] Processing CreateTablet for tablet 172aa0d42e8646ce8e9b3ef01f4628d6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:56.531368 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 9b9e9352fdad40bca805117f2fdbaaa3 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:56.549332 24075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86266bc0f0914a64b02089b09f4d3b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.515658 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34a6dd30e6245b78f15838141fac042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.550465 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9e9352fdad40bca805117f2fdbaaa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.552079 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890a157efb254124a8fa371cfcda5616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.558565 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172aa0d42e8646ce8e9b3ef01f4628d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.558908 24228 tablet_service.cc:1511] Processing CreateTablet for tablet c34a6dd30e6245b78f15838141fac042 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:56.560281 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34a6dd30e6245b78f15838141fac042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.527551 24223 tablet_service.cc:1511] Processing CreateTablet for tablet 3e13faa2c04f46039c7c9b1d8021cbd0 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:56.561305 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7559f65287ff4852a45d740197ae4aba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.561842 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e13faa2c04f46039c7c9b1d8021cbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.563124 24282 consensus_queue.cc:260] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:56.566510 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4028cf0a93848479c9e713d7e2bc5d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.570480 24221 tablet_service.cc:1511] Processing CreateTablet for tablet eaf1985e29d943909e299c616813e9a6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:56.574859 23998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236a44f6e6b740ebbf1fb3b1f367f36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.579280 24002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24d61e68c14dc19d3ad5de5931d613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.579416 24073 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9744f06e3f482d89a3a72e5a9c09bf (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:56.580864 24073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9744f06e3f482d89a3a72e5a9c09bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.586273 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b860e1a11c0242ad8dae706485a5419b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.590370 23999 tablet_service.cc:1511] Processing CreateTablet for tablet c34a6dd30e6245b78f15838141fac042 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:56.591918 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34a6dd30e6245b78f15838141fac042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.626490 24191 heartbeater.cc:499] Master 127.15.191.126:35665 was elected leader, sending a full tablet report...
I20260709 12:12:56.636715 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222f5f64725d4c94803b2d55242cc5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.637768 24284 tablet_bootstrap.cc:492] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:56.638424 24284 ts_tablet_manager.cc:1403] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.213s	user 0.030s	sys 0.028s
I20260709 12:12:56.639695 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf1985e29d943909e299c616813e9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.642236 24284 raft_consensus.cc:359] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:56.649237 24042 heartbeater.cc:499] Master 127.15.191.126:35665 was elected leader, sending a full tablet report...
I20260709 12:12:56.650070 24148 tablet_service.cc:1511] Processing CreateTablet for tablet eaf1985e29d943909e299c616813e9a6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:56.682773 24282 ts_tablet_manager.cc:1434] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.182s	user 0.017s	sys 0.003s
W20260709 12:12:56.690296 23902 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.191.68:38373, user_credentials={real_user=slave}} blocked reactor thread for 67670.5us
I20260709 12:12:56.671859 24284 raft_consensus.cc:385] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.697350 24074 tablet_service.cc:1511] Processing CreateTablet for tablet b860e1a11c0242ad8dae706485a5419b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:56.697935 24284 raft_consensus.cc:740] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.698689 24000 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1cc59fceea40e599cdbcb075f486d6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:56.701247 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1cc59fceea40e599cdbcb075f486d6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:56.699076 24284 consensus_queue.cc:260] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:56.715174 24226 tablet_service.cc:1511] Processing CreateTablet for tablet 0501208ef99042209ace59e3d1f4bb67 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:56.716629 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0501208ef99042209ace59e3d1f4bb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.700103 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1cc59fceea40e599cdbcb075f486d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.720911 24282 tablet_bootstrap.cc:492] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:56.729810 24282 tablet_bootstrap.cc:654] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.729683 24285 tablet_bootstrap.cc:654] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.739105 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf1985e29d943909e299c616813e9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.739710 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b860e1a11c0242ad8dae706485a5419b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.748531 24117 heartbeater.cc:499] Master 127.15.191.126:35665 was elected leader, sending a full tablet report...
I20260709 12:12:56.763199 24079 tablet_service.cc:1511] Processing CreateTablet for tablet 3e13faa2c04f46039c7c9b1d8021cbd0 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:56.774547 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1cc59fceea40e599cdbcb075f486d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.795784 24288 tablet_bootstrap.cc:492] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:56.800355 24075 tablet_service.cc:1511] Processing CreateTablet for tablet f203904cd1b94afca969b8b361e196b8 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:56.801433 24080 tablet_service.cc:1511] Processing CreateTablet for tablet 3e594133f84a47ecacfe0bf75b3bc5fc (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:56.811053 24078 tablet_service.cc:1511] Processing CreateTablet for tablet eaf1985e29d943909e299c616813e9a6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:56.812059 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 436b14790f4a4768ae4f66430c025d3b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:56.809516 24073 tablet_service.cc:1511] Processing CreateTablet for tablet bd24d61e68c14dc19d3ad5de5931d613 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:56.817399 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e13faa2c04f46039c7c9b1d8021cbd0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:56.820066 24192 tablet.cc:2406] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:56.855487 24075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f203904cd1b94afca969b8b361e196b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.859225 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e594133f84a47ecacfe0bf75b3bc5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.860244 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf1985e29d943909e299c616813e9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.813143 24007 tablet_service.cc:1511] Processing CreateTablet for tablet 0501208ef99042209ace59e3d1f4bb67 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:56.868881 24149 tablet_service.cc:1511] Processing CreateTablet for tablet 5e842427bd574b6092b1d303499a2269 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:56.869148 24226 tablet_service.cc:1511] Processing CreateTablet for tablet 5e842427bd574b6092b1d303499a2269 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:56.870648 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e842427bd574b6092b1d303499a2269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.870335 23999 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0b9a2a93994fa2b4a1b3f3448a7744 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:56.871001 24000 tablet_service.cc:1511] Processing CreateTablet for tablet abb87e12877743478bd71c5023fe4335 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:56.871668 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0b9a2a93994fa2b4a1b3f3448a7744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.870576 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e842427bd574b6092b1d303499a2269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.874362 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0501208ef99042209ace59e3d1f4bb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.835352 24228 tablet_service.cc:1511] Processing CreateTablet for tablet abb87e12877743478bd71c5023fe4335 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:56.875275 24152 tablet_service.cc:1511] Processing CreateTablet for tablet abb87e12877743478bd71c5023fe4335 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:56.816111 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 236a44f6e6b740ebbf1fb3b1f367f36a (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:56.877903 24289 raft_consensus.cc:493] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.878636 24073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24d61e68c14dc19d3ad5de5931d613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.879159 24288 tablet_bootstrap.cc:654] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.890552 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436b14790f4a4768ae4f66430c025d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.891300 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236a44f6e6b740ebbf1fb3b1f367f36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.891093 24077 tablet_service.cc:1511] Processing CreateTablet for tablet 0501208ef99042209ace59e3d1f4bb67 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:56.891887 24076 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1cc59fceea40e599cdbcb075f486d6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:56.893231 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb87e12877743478bd71c5023fe4335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.898913 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb87e12877743478bd71c5023fe4335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.880535 24284 ts_tablet_manager.cc:1434] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.238s	user 0.010s	sys 0.010s
I20260709 12:12:56.900494 24284 tablet_bootstrap.cc:492] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:56.908214 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0b9a2a93994fa2b4a1b3f3448a7744 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:56.909709 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0b9a2a93994fa2b4a1b3f3448a7744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.905285 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb87e12877743478bd71c5023fe4335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.912914 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0501208ef99042209ace59e3d1f4bb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.903752 24289 raft_consensus.cc:515] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:56.920137 24288 tablet_bootstrap.cc:492] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:56.931490 24288 ts_tablet_manager.cc:1403] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.005s
I20260709 12:12:56.932336 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1cc59fceea40e599cdbcb075f486d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.940197 24265 heartbeater.cc:499] Master 127.15.191.126:35665 was elected leader, sending a full tablet report...
I20260709 12:12:56.973181 24229 tablet_service.cc:1511] Processing CreateTablet for tablet a74ffb149b7a4384b643ebcc07463911 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:56.974690 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74ffb149b7a4384b643ebcc07463911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.977558 24285 tablet_bootstrap.cc:492] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:56.978165 24285 ts_tablet_manager.cc:1403] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.509s	user 0.029s	sys 0.005s
I20260709 12:12:56.979285 24002 tablet_service.cc:1511] Processing CreateTablet for tablet a74ffb149b7a4384b643ebcc07463911 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:56.983388 24282 tablet_bootstrap.cc:492] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:56.984041 24282 ts_tablet_manager.cc:1403] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.263s	user 0.023s	sys 0.005s
I20260709 12:12:56.983906 24153 tablet_service.cc:1511] Processing CreateTablet for tablet dc0615d91a3b4e4b9b9d501f055a3116 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:56.990772 24289 leader_election.cc:290] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:56.996297 24002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74ffb149b7a4384b643ebcc07463911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.998643 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0615d91a3b4e4b9b9d501f055a3116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.003731 24285 raft_consensus.cc:359] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.004565 24285 raft_consensus.cc:385] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.004944 24285 raft_consensus.cc:740] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.004468 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 5e842427bd574b6092b1d303499a2269 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:57.008188 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e842427bd574b6092b1d303499a2269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.032759 24284 tablet_bootstrap.cc:654] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.032455 24080 tablet_service.cc:1511] Processing CreateTablet for tablet a74ffb149b7a4384b643ebcc07463911 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:57.032307 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0b9a2a93994fa2b4a1b3f3448a7744 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:57.033905 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a74ffb149b7a4384b643ebcc07463911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.034324 24287 raft_consensus.cc:493] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.037355 24287 raft_consensus.cc:515] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.040443 24287 leader_election.cc:290] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:57.005744 24285 consensus_queue.cc:260] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.052299 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0b9a2a93994fa2b4a1b3f3448a7744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.082235 24228 tablet_service.cc:1511] Processing CreateTablet for tablet bf5b9f7ee4754dc8bcef9a96c67021d7 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:57.083879 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5b9f7ee4754dc8bcef9a96c67021d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.087301 24004 tablet_service.cc:1511] Processing CreateTablet for tablet dc0615d91a3b4e4b9b9d501f055a3116 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:57.091812 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0615d91a3b4e4b9b9d501f055a3116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.082235 24226 tablet_service.cc:1511] Processing CreateTablet for tablet dc0615d91a3b4e4b9b9d501f055a3116 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:57.092849 23999 tablet_service.cc:1511] Processing CreateTablet for tablet 93d640b1b4aa4e8597d224281ede6bad (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:57.094271 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d640b1b4aa4e8597d224281ede6bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.096118 24284 tablet_bootstrap.cc:492] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:57.096735 24284 ts_tablet_manager.cc:1403] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.020s
I20260709 12:12:57.098685 24288 raft_consensus.cc:359] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.099488 24288 raft_consensus.cc:385] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.099785 24288 raft_consensus.cc:740] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.100630 24073 tablet_service.cc:1511] Processing CreateTablet for tablet bf5b9f7ee4754dc8bcef9a96c67021d7 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:57.100780 24288 consensus_queue.cc:260] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.093350 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0615d91a3b4e4b9b9d501f055a3116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.115000 24073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5b9f7ee4754dc8bcef9a96c67021d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.115278 24282 raft_consensus.cc:359] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.122809 24282 raft_consensus.cc:385] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.123126 24282 raft_consensus.cc:740] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.123958 24282 consensus_queue.cc:260] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.150861 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:57.151288 24284 raft_consensus.cc:359] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.152087 24284 raft_consensus.cc:385] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.152398 24284 raft_consensus.cc:740] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
W20260709 12:12:57.152778 23983 leader_election.cc:343] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.153753 24282 ts_tablet_manager.cc:1434] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.169s	user 0.010s	sys 0.000s
I20260709 12:12:57.154942 24282 tablet_bootstrap.cc:492] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:57.168390 24284 consensus_queue.cc:260] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.171197 24284 ts_tablet_manager.cc:1434] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 12:12:57.172490 24284 tablet_bootstrap.cc:492] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:57.178735 24288 ts_tablet_manager.cc:1434] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.247s	user 0.005s	sys 0.022s
I20260709 12:12:57.183770 24287 raft_consensus.cc:493] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.184370 24287 raft_consensus.cc:515] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.186918 24287 leader_election.cc:290] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:57.200024 24079 tablet_service.cc:1511] Processing CreateTablet for tablet 93d640b1b4aa4e8597d224281ede6bad (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:57.204577 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d640b1b4aa4e8597d224281ede6bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.205603 24226 tablet_service.cc:1511] Processing CreateTablet for tablet b5d21190dc1a46b8bfecc2773603fe9d (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:57.207207 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d21190dc1a46b8bfecc2773603fe9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.215425 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:57.216262 24092 raft_consensus.cc:2468] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:12:57.219575 23982 leader_election.cc:304] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:57.221976 24289 raft_consensus.cc:2804] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.222427 24289 raft_consensus.cc:493] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.222779 24289 raft_consensus.cc:3060] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.223218 24284 tablet_bootstrap.cc:654] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.224763 24285 ts_tablet_manager.cc:1434] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.246s	user 0.029s	sys 0.023s
I20260709 12:12:57.225986 24285 tablet_bootstrap.cc:492] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:57.234321 24289 raft_consensus.cc:515] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.247103 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:57.248485 24074 tablet_service.cc:1511] Processing CreateTablet for tablet b5d21190dc1a46b8bfecc2773603fe9d (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 12:12:57.248835 23983 leader_election.cc:343] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.250880 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d21190dc1a46b8bfecc2773603fe9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.252774 24004 tablet_service.cc:1511] Processing CreateTablet for tablet b5d21190dc1a46b8bfecc2773603fe9d (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:57.254195 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d21190dc1a46b8bfecc2773603fe9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.244212 24288 tablet_bootstrap.cc:492] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:57.257606 24282 tablet_bootstrap.cc:654] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.273396 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4028cf0a93848479c9e713d7e2bc5d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:12:57.279688 24131 leader_election.cc:343] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.285028 24154 tablet_service.cc:1511] Processing CreateTablet for tablet bf5b9f7ee4754dc8bcef9a96c67021d7 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:57.286492 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5b9f7ee4754dc8bcef9a96c67021d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.289351 24289 leader_election.cc:290] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:57.290925 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:57.291612 24285 tablet_bootstrap.cc:654] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.291761 24092 raft_consensus.cc:3060] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.292644 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 697dc1c079f448c0af165ab489b3160c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:57.294067 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697dc1c079f448c0af165ab489b3160c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.294396 24300 raft_consensus.cc:493] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.297596 24300 raft_consensus.cc:515] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.300532 24300 leader_election.cc:290] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:57.306015 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:12:57.310283 24132 leader_election.cc:343] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.291419 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 93d640b1b4aa4e8597d224281ede6bad (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:57.311329 24092 raft_consensus.cc:2468] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:12:57.312103 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d640b1b4aa4e8597d224281ede6bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.313170 23982 leader_election.cc:304] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:57.314457 24289 raft_consensus.cc:2804] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.315217 24289 raft_consensus.cc:697] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:12:57.316092 24289 consensus_queue.cc:237] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.324733 24226 tablet_service.cc:1511] Processing CreateTablet for tablet 697dc1c079f448c0af165ab489b3160c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:57.327829 23999 tablet_service.cc:1511] Processing CreateTablet for tablet 697dc1c079f448c0af165ab489b3160c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:57.329932 24152 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3ede10da664710af54f48f42e1ab43 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:57.333113 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3ede10da664710af54f48f42e1ab43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.343354 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4028cf0a93848479c9e713d7e2bc5d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:57.346185 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:57.348865 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697dc1c079f448c0af165ab489b3160c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:57.349377 24132 leader_election.cc:343] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.348543 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3ede10da664710af54f48f42e1ab43 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:57.349963 24132 leader_election.cc:304] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
W20260709 12:12:57.351980 24132 leader_election.cc:343] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.352393 24287 raft_consensus.cc:2749] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.352511 24132 leader_election.cc:304] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:57.340350 24284 tablet_bootstrap.cc:492] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:57.356269 24284 ts_tablet_manager.cc:1403] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.184s	user 0.034s	sys 0.013s
I20260709 12:12:57.356269 24287 raft_consensus.cc:2749] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.361124 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3ede10da664710af54f48f42e1ab43 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:57.370587 24074 tablet_service.cc:1511] Processing CreateTablet for tablet 4c60f2ad0a90425db97febd2ea86c08a (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:57.361462 24284 raft_consensus.cc:359] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:57.372224 24284 raft_consensus.cc:385] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.372583 24284 raft_consensus.cc:740] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.372753 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 4c60f2ad0a90425db97febd2ea86c08a (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:57.373533 24284 consensus_queue.cc:260] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:57.375622 24288 tablet_bootstrap.cc:654] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.376605 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c60f2ad0a90425db97febd2ea86c08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.377308 24284 ts_tablet_manager.cc:1434] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:12:57.378307 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3ede10da664710af54f48f42e1ab43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.380451 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c60f2ad0a90425db97febd2ea86c08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.383150 24284 tablet_bootstrap.cc:492] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:57.398187 24284 tablet_bootstrap.cc:654] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.402343 24285 tablet_bootstrap.cc:492] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:57.402243 24229 tablet_service.cc:1511] Processing CreateTablet for tablet cebff22f432748299ffa8b2a93663d6b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:57.403028 24285 ts_tablet_manager.cc:1403] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.177s	user 0.021s	sys 0.015s
I20260709 12:12:57.406299 24285 raft_consensus.cc:359] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.407050 24285 raft_consensus.cc:385] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.407353 24285 raft_consensus.cc:740] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.400141 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697dc1c079f448c0af165ab489b3160c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:57.411540 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:38373, user_credentials={real_user=slave}} blocked reactor thread for 59584.7us
I20260709 12:12:57.417107 24000 tablet_service.cc:1511] Processing CreateTablet for tablet cebff22f432748299ffa8b2a93663d6b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:57.413734 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3ede10da664710af54f48f42e1ab43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.420467 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebff22f432748299ffa8b2a93663d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.420810 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 4c60f2ad0a90425db97febd2ea86c08a (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:57.421846 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c60f2ad0a90425db97febd2ea86c08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.429032 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86266bc0f0914a64b02089b09f4d3b72" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:57.414934 24285 consensus_queue.cc:260] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
W20260709 12:12:57.431017 24205 leader_election.cc:343] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.432943 24285 ts_tablet_manager.cc:1434] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:12:57.434087 24285 tablet_bootstrap.cc:492] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:57.431130 23913 catalog_manager.cc:5697] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.439019 24282 tablet_bootstrap.cc:492] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:57.439670 24282 ts_tablet_manager.cc:1403] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.285s	user 0.022s	sys 0.006s
I20260709 12:12:57.441018 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebff22f432748299ffa8b2a93663d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.443511 24282 raft_consensus.cc:359] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:57.444494 24282 raft_consensus.cc:385] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.444861 24282 raft_consensus.cc:740] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.445858 24282 consensus_queue.cc:260] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:57.448365 24082 tablet_service.cc:1511] Processing CreateTablet for tablet cebff22f432748299ffa8b2a93663d6b (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:57.449841 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebff22f432748299ffa8b2a93663d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.455894 24282 ts_tablet_manager.cc:1434] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
W20260709 12:12:57.464707 23963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:57.465309 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9c43c99da4449caafff73d83486d50 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:57.466732 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9c43c99da4449caafff73d83486d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.467121 24282 tablet_bootstrap.cc:492] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:57.472064 24221 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9c43c99da4449caafff73d83486d50 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:57.473177 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9c43c99da4449caafff73d83486d50 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:57.476459 24311 raft_consensus.cc:493] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.477332 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9c43c99da4449caafff73d83486d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.477049 24311 raft_consensus.cc:515] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:57.466745 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86266bc0f0914a64b02089b09f4d3b72" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:12:57.479471 24206 leader_election.cc:343] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.479951 24206 leader_election.cc:304] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:57.474450 24081 tablet_service.cc:1511] Processing CreateTablet for tablet bce9b63ea2f94082afd9e5a2fb11cc9c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:57.481272 24152 tablet_service.cc:1511] Processing CreateTablet for tablet bce9b63ea2f94082afd9e5a2fb11cc9c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:57.481792 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce9b63ea2f94082afd9e5a2fb11cc9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.473575 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9c43c99da4449caafff73d83486d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.480767 24300 raft_consensus.cc:2749] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.483978 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce9b63ea2f94082afd9e5a2fb11cc9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.488498 24311 leader_election.cc:290] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:57.489264 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:57.491911 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:12:57.493507 24132 leader_election.cc:343] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.494727 24132 leader_election.cc:343] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.495227 24132 leader_election.cc:304] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:57.496409 24311 raft_consensus.cc:2749] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.497102 24285 tablet_bootstrap.cc:654] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.501940 24223 tablet_service.cc:1511] Processing CreateTablet for tablet bce9b63ea2f94082afd9e5a2fb11cc9c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:57.505779 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce9b63ea2f94082afd9e5a2fb11cc9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.512182 24289 raft_consensus.cc:493] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.512781 24289 raft_consensus.cc:515] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.515053 24289 leader_election.cc:290] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:57.515931 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9e86df293f4b48931332e8e90ea10e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:57.521898 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9e86df293f4b48931332e8e90ea10e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:12:57.523490 23982 leader_election.cc:343] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.524971 23983 leader_election.cc:343] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.525425 23983 leader_election.cc:304] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:57.526631 24289 raft_consensus.cc:2749] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.526392 24074 tablet_service.cc:1511] Processing CreateTablet for tablet 72b8c550cc124fddb066006c81a6b29e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:57.529178 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b8c550cc124fddb066006c81a6b29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.530405 24282 tablet_bootstrap.cc:654] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.530968 24288 tablet_bootstrap.cc:492] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:57.536985 24000 tablet_service.cc:1511] Processing CreateTablet for tablet 72b8c550cc124fddb066006c81a6b29e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:57.537189 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 72b8c550cc124fddb066006c81a6b29e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:57.539340 24288 ts_tablet_manager.cc:1403] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.311s	user 0.024s	sys 0.004s
I20260709 12:12:57.540040 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b8c550cc124fddb066006c81a6b29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.541260 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b8c550cc124fddb066006c81a6b29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.543169 24288 raft_consensus.cc:359] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.543962 24288 raft_consensus.cc:385] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.544250 24288 raft_consensus.cc:740] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.544305 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 17c227f268a94d11b528c1a35d162d3c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:57.545154 24288 consensus_queue.cc:260] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.545765 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c227f268a94d11b528c1a35d162d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.560021 24284 tablet_bootstrap.cc:492] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:57.560673 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 17c227f268a94d11b528c1a35d162d3c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:57.562191 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c227f268a94d11b528c1a35d162d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.564339 24288 ts_tablet_manager.cc:1434] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:12:57.565558 24288 tablet_bootstrap.cc:492] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:57.585683 24288 tablet_bootstrap.cc:654] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.560675 24284 ts_tablet_manager.cc:1403] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.178s	user 0.010s	sys 0.024s
I20260709 12:12:57.593593 24282 tablet_bootstrap.cc:492] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:57.589881 24285 tablet_bootstrap.cc:492] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:57.597597 24285 ts_tablet_manager.cc:1403] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.164s	user 0.018s	sys 0.004s
I20260709 12:12:57.597646 24156 tablet_service.cc:1511] Processing CreateTablet for tablet dd67df6137e94222b5862ed8999d37cc (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:57.599062 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd67df6137e94222b5862ed8999d37cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.599189 24284 raft_consensus.cc:359] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:57.599951 24284 raft_consensus.cc:385] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.600245 24284 raft_consensus.cc:740] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.600574 24285 raft_consensus.cc:359] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.601438 24285 raft_consensus.cc:385] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.601763 24285 raft_consensus.cc:740] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.602780 24285 consensus_queue.cc:260] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.600992 24284 consensus_queue.cc:260] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:57.607513 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 7976327d03e6414599da68409facb2f6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:57.608938 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7976327d03e6414599da68409facb2f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.609515 24284 ts_tablet_manager.cc:1434] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:12:57.610733 24284 tablet_bootstrap.cc:492] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:57.611860 24229 tablet_service.cc:1511] Processing CreateTablet for tablet dd67df6137e94222b5862ed8999d37cc (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:57.619549 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd67df6137e94222b5862ed8999d37cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.614312 24282 ts_tablet_manager.cc:1403] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.156s	user 0.020s	sys 0.006s
I20260709 12:12:57.620353 24004 tablet_service.cc:1511] Processing CreateTablet for tablet dd67df6137e94222b5862ed8999d37cc (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:57.625694 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd67df6137e94222b5862ed8999d37cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.621206 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 7976327d03e6414599da68409facb2f6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:57.607511 24285 ts_tablet_manager.cc:1434] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 12:12:57.627758 24282 raft_consensus.cc:359] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:57.628558 24282 raft_consensus.cc:385] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.630650 24000 tablet_service.cc:1511] Processing CreateTablet for tablet 2220bd387f5e420da98f649ad6b2c37e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:57.632053 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2220bd387f5e420da98f649ad6b2c37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.613381 24074 tablet_service.cc:1511] Processing CreateTablet for tablet 17c227f268a94d11b528c1a35d162d3c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:57.627820 24285 tablet_bootstrap.cc:492] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:57.633065 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c227f268a94d11b528c1a35d162d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.617364 24284 tablet_bootstrap.cc:654] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.637368 24288 tablet_bootstrap.cc:492] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:57.637514 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7976327d03e6414599da68409facb2f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.638011 24288 ts_tablet_manager.cc:1403] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.003s
I20260709 12:12:57.631722 24223 tablet_service.cc:1511] Processing CreateTablet for tablet 7976327d03e6414599da68409facb2f6 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:57.639593 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7976327d03e6414599da68409facb2f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.628852 24282 raft_consensus.cc:740] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.648887 24282 consensus_queue.cc:260] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:57.652055 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 2220bd387f5e420da98f649ad6b2c37e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:57.654568 24285 tablet_bootstrap.cc:654] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.655735 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2220bd387f5e420da98f649ad6b2c37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.643512 24288 raft_consensus.cc:359] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.659556 24288 raft_consensus.cc:385] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.659936 24288 raft_consensus.cc:740] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.662226 24289 raft_consensus.cc:493] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.661953 24288 consensus_queue.cc:260] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.662768 24289 raft_consensus.cc:515] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:57.665239 24289 leader_election.cc:290] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:57.666860 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bf8aa11eb9402cbf4870c19cce296a" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:12:57.668956 23982 leader_election.cc:343] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.668890 24288 ts_tablet_manager.cc:1434] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:12:57.673434 24300 raft_consensus.cc:493] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.674047 24300 raft_consensus.cc:515] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.651410 24282 ts_tablet_manager.cc:1434] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:12:57.679173 24282 tablet_bootstrap.cc:492] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:57.681125 24300 leader_election.cc:290] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:57.681921 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890a157efb254124a8fa371cfcda5616" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:12:57.686019 24205 leader_election.cc:343] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.698695 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 2220bd387f5e420da98f649ad6b2c37e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:57.700098 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2220bd387f5e420da98f649ad6b2c37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.709100 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 7918e606532f446790aa9cebeb9a352c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:57.710701 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7918e606532f446790aa9cebeb9a352c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.717200 24282 tablet_bootstrap.cc:654] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.722131 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bf8aa11eb9402cbf4870c19cce296a" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:12:57.725112 23983 leader_election.cc:343] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.725682 23983 leader_election.cc:304] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:57.726922 24289 raft_consensus.cc:2749] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.731818 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 7918e606532f446790aa9cebeb9a352c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:57.733130 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7918e606532f446790aa9cebeb9a352c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.740407 24288 tablet_bootstrap.cc:492] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:57.754371 24300 raft_consensus.cc:493] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.754979 24300 raft_consensus.cc:515] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:57.757062 24300 leader_election.cc:290] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:57.759093 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 7918e606532f446790aa9cebeb9a352c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:57.760712 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7918e606532f446790aa9cebeb9a352c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.762526 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 60dc51b1981640db8864178385eb2de3 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:57.763211 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9e9352fdad40bca805117f2fdbaaa3" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:57.764026 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dc51b1981640db8864178385eb2de3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:57.764714 24205 leader_election.cc:343] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.772231 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 681e0b6a8f05478181aa1dc9948e0733 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:57.773156 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9e9352fdad40bca805117f2fdbaaa3" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:57.777259 24303 raft_consensus.cc:493] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:57.777869 24206 leader_election.cc:343] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.777851 24303 raft_consensus.cc:515] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.773785 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890a157efb254124a8fa371cfcda5616" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:57.778502 24206 leader_election.cc:304] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:57.779765 24300 raft_consensus.cc:2749] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:57.780862 24206 leader_election.cc:343] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.781399 24206 leader_election.cc:304] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:57.780704 24289 consensus_queue.cc:1048] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.783499 24000 tablet_service.cc:1511] Processing CreateTablet for tablet 60dc51b1981640db8864178385eb2de3 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:57.783927 24300 raft_consensus.cc:2749] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.760727 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 60dc51b1981640db8864178385eb2de3 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:57.785848 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dc51b1981640db8864178385eb2de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.779721 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681e0b6a8f05478181aa1dc9948e0733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.787984 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dc51b1981640db8864178385eb2de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.790706 24303 leader_election.cc:290] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:57.808063 24223 tablet_service.cc:1511] Processing CreateTablet for tablet 681e0b6a8f05478181aa1dc9948e0733 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:57.809437 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681e0b6a8f05478181aa1dc9948e0733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.812525 24288 tablet_bootstrap.cc:654] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.813946 24311 raft_consensus.cc:493] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.814491 24311 raft_consensus.cc:515] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:57.814800 23999 tablet_service.cc:1511] Processing CreateTablet for tablet bc5d631983484182a825fde0a0978a80 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:57.815105 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 681e0b6a8f05478181aa1dc9948e0733 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:57.816115 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5d631983484182a825fde0a0978a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.816362 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681e0b6a8f05478181aa1dc9948e0733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.816660 24311 leader_election.cc:290] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:57.818876 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:57.820348 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
W20260709 12:12:57.822062 24132 leader_election.cc:343] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.822809 24132 leader_election.cc:343] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.823236 24132 leader_election.cc:304] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:57.824469 24311 raft_consensus.cc:2749] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.830197 24284 tablet_bootstrap.cc:492] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:57.830777 24284 ts_tablet_manager.cc:1403] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.220s	user 0.029s	sys 0.062s
W20260709 12:12:57.831007 23983 consensus_peers.cc:597] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 -> Peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Couldn't send request to peer a09fd0dde7fc4241aecc9690b427e9e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:57.831736 24285 tablet_bootstrap.cc:492] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:57.832074 24282 tablet_bootstrap.cc:492] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:57.832832 24074 tablet_service.cc:1511] Processing CreateTablet for tablet bc5d631983484182a825fde0a0978a80 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:57.839021 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5d631983484182a825fde0a0978a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.839679 24284 raft_consensus.cc:359] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:57.840425 24284 raft_consensus.cc:385] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.842350 24284 raft_consensus.cc:740] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.843163 24284 consensus_queue.cc:260] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:57.850452 24282 ts_tablet_manager.cc:1403] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.033s
I20260709 12:12:57.852293 24284 ts_tablet_manager.cc:1434] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 12:12:57.854633 24285 ts_tablet_manager.cc:1403] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.227s	user 0.027s	sys 0.030s
I20260709 12:12:57.855242 24284 tablet_bootstrap.cc:492] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:57.858886 24282 raft_consensus.cc:359] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:57.869730 24154 tablet_service.cc:1511] Processing CreateTablet for tablet bc5d631983484182a825fde0a0978a80 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:57.871519 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9e86df293f4b48931332e8e90ea10e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:57.877920 24017 raft_consensus.cc:2468] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:57.873852 24226 tablet_service.cc:1511] Processing CreateTablet for tablet a875213f1f8a4efd8894c71d54fa8a48 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:57.879115 24004 tablet_service.cc:1511] Processing CreateTablet for tablet a875213f1f8a4efd8894c71d54fa8a48 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:57.879325 24058 leader_election.cc:304] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:57.879570 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a875213f1f8a4efd8894c71d54fa8a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.881450 24329 raft_consensus.cc:2804] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.881877 24329 raft_consensus.cc:493] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.882251 24329 raft_consensus.cc:3060] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.877322 24282 raft_consensus.cc:385] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.882939 24282 raft_consensus.cc:740] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.883602 24282 consensus_queue.cc:260] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:57.885313 24282 ts_tablet_manager.cc:1434] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.000s
I20260709 12:12:57.880268 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a875213f1f8a4efd8894c71d54fa8a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.888293 24282 tablet_bootstrap.cc:492] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:57.880282 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5d631983484182a825fde0a0978a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.912756 24282 tablet_bootstrap.cc:654] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.918226 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 85c9cc57f4f24208a3b0775820818bad (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:57.922194 24223 tablet_service.cc:1511] Processing CreateTablet for tablet 85c9cc57f4f24208a3b0775820818bad (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:57.925987 24288 tablet_bootstrap.cc:492] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:57.926203 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c9cc57f4f24208a3b0775820818bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.900606 24285 raft_consensus.cc:359] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.927239 24285 raft_consensus.cc:385] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.927556 24285 raft_consensus.cc:740] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.928332 24285 consensus_queue.cc:260] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.929472 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9e86df293f4b48931332e8e90ea10e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:57.930228 24240 raft_consensus.cc:2468] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:57.931686 24329 raft_consensus.cc:515] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:57.930320 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c9cc57f4f24208a3b0775820818bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.939345 24285 ts_tablet_manager.cc:1434] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 12:12:57.936411 24288 ts_tablet_manager.cc:1403] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.196s	user 0.024s	sys 0.010s
I20260709 12:12:57.941208 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 85c9cc57f4f24208a3b0775820818bad (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:57.942453 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c9cc57f4f24208a3b0775820818bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.943527 24288 raft_consensus.cc:359] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:57.944272 24288 raft_consensus.cc:385] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.947495 24285 tablet_bootstrap.cc:492] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:57.949287 24284 tablet_bootstrap.cc:654] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.949156 24156 tablet_service.cc:1511] Processing CreateTablet for tablet a8150bdbea834ed8bab225a9388ab34e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:57.939000 24074 tablet_service.cc:1511] Processing CreateTablet for tablet a875213f1f8a4efd8894c71d54fa8a48 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:57.954483 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a875213f1f8a4efd8894c71d54fa8a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.944561 24288 raft_consensus.cc:740] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.959937 24078 tablet_service.cc:1511] Processing CreateTablet for tablet a8150bdbea834ed8bab225a9388ab34e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:57.978015 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8150bdbea834ed8bab225a9388ab34e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.975659 24288 consensus_queue.cc:260] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:57.981724 24288 ts_tablet_manager.cc:1434] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.006s
I20260709 12:12:57.991160 24329 leader_election.cc:290] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:57.992357 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9e86df293f4b48931332e8e90ea10e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:57.993031 24240 raft_consensus.cc:3060] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.994424 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8150bdbea834ed8bab225a9388ab34e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.994262 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df9e86df293f4b48931332e8e90ea10e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:57.994894 24017 raft_consensus.cc:3060] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.005236 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1ebf08df17449aa47d4ffc0d7b03d3 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:58.009649 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 96e8cb56d54f4d83939a14ea7ffdd5c4 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:58.011050 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e8cb56d54f4d83939a14ea7ffdd5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.011623 24282 tablet_bootstrap.cc:492] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:58.011946 24303 raft_consensus.cc:493] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.012144 24282 ts_tablet_manager.cc:1403] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.008s
I20260709 12:12:58.012502 24303 raft_consensus.cc:515] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.014896 24303 leader_election.cc:290] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:58.015559 24282 raft_consensus.cc:359] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.016338 24282 raft_consensus.cc:385] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.016644 24282 raft_consensus.cc:740] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.017524 24282 consensus_queue.cc:260] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.018930 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1ebf08df17449aa47d4ffc0d7b03d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.019215 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4028cf0a93848479c9e713d7e2bc5d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:58.019872 24282 ts_tablet_manager.cc:1434] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:58.023242 24017 raft_consensus.cc:2468] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:58.024971 24073 tablet_service.cc:1511] Processing CreateTablet for tablet 7e57bd7f92b1482cb38beba49eccfb37 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:58.026367 24073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e57bd7f92b1482cb38beba49eccfb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.025880 24229 tablet_service.cc:1511] Processing CreateTablet for tablet a8150bdbea834ed8bab225a9388ab34e (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:58.027451 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 96e8cb56d54f4d83939a14ea7ffdd5c4 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:58.027927 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 09559716fd22441c954a4dbae0e41bee (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:58.029506 24000 tablet_service.cc:1511] Processing CreateTablet for tablet 96e8cb56d54f4d83939a14ea7ffdd5c4 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:58.030349 24221 tablet_service.cc:1511] Processing CreateTablet for tablet 09559716fd22441c954a4dbae0e41bee (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:58.030881 24152 tablet_service.cc:1511] Processing CreateTablet for tablet 7e57bd7f92b1482cb38beba49eccfb37 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:58.031584 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1ebf08df17449aa47d4ffc0d7b03d3 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:58.031750 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1ebf08df17449aa47d4ffc0d7b03d3 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:58.030894 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e8cb56d54f4d83939a14ea7ffdd5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.032810 24058 leader_election.cc:304] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
W20260709 12:12:58.033826 24058 leader_election.cc:343] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.027863 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8150bdbea834ed8bab225a9388ab34e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.035349 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1ebf08df17449aa47d4ffc0d7b03d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.039846 24002 tablet_service.cc:1511] Processing CreateTablet for tablet 09559716fd22441c954a4dbae0e41bee (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:58.036000 24329 raft_consensus.cc:493] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.041218 24002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09559716fd22441c954a4dbae0e41bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.036337 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09559716fd22441c954a4dbae0e41bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.037955 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09559716fd22441c954a4dbae0e41bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.042707 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e8cb56d54f4d83939a14ea7ffdd5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.040848 24329 raft_consensus.cc:515] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.044768 24329 leader_election.cc:290] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.046517 24303 raft_consensus.cc:2804] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.047151 24303 raft_consensus.cc:697] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:12:58.048065 24303 consensus_queue.cc:237] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.050303 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e57bd7f92b1482cb38beba49eccfb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.050992 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1ebf08df17449aa47d4ffc0d7b03d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.055214 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4028cf0a93848479c9e713d7e2bc5d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.055979 24166 raft_consensus.cc:2468] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:58.057035 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172aa0d42e8646ce8e9b3ef01f4628d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.057717 24165 raft_consensus.cc:2468] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:58.059604 24058 leader_election.cc:304] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:58.065662 24288 tablet_bootstrap.cc:492] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:58.066335 24329 raft_consensus.cc:2804] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.066596 24284 tablet_bootstrap.cc:492] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:58.066912 24329 raft_consensus.cc:493] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.067390 24329 raft_consensus.cc:3060] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.068087 24282 tablet_bootstrap.cc:492] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:58.067165 24284 ts_tablet_manager.cc:1403] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.212s	user 0.005s	sys 0.015s
I20260709 12:12:58.074286 24240 raft_consensus.cc:2468] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:58.085080 24329 raft_consensus.cc:515] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.086036 24285 tablet_bootstrap.cc:654] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.086966 24226 tablet_service.cc:1511] Processing CreateTablet for tablet 7e57bd7f92b1482cb38beba49eccfb37 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:58.083215 24282 tablet_bootstrap.cc:654] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.099364 24329 leader_election.cc:290] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:58.094914 24289 raft_consensus.cc:493] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.118062 24074 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb82c3e798f4870b3983a6831c6d557 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:58.118844 24289 raft_consensus.cc:515] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.119961 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb82c3e798f4870b3983a6831c6d557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.120947 24289 leader_election.cc:290] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:58.109735 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e57bd7f92b1482cb38beba49eccfb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.110548 24007 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb82c3e798f4870b3983a6831c6d557 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:58.122704 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb82c3e798f4870b3983a6831c6d557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.123615 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:58.124845 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:12:58.126657 23983 leader_election.cc:343] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:58.127367 23983 leader_election.cc:343] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.127790 23983 leader_election.cc:304] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:58.131289 24289 raft_consensus.cc:2749] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.083007 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172aa0d42e8646ce8e9b3ef01f4628d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.133184 24017 raft_consensus.cc:2468] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:58.144932 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb82c3e798f4870b3983a6831c6d557 (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:58.146308 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb82c3e798f4870b3983a6831c6d557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.086970 24284 raft_consensus.cc:359] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.152418 24285 tablet_bootstrap.cc:492] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.159122 24285 ts_tablet_manager.cc:1403] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.212s	user 0.021s	sys 0.005s
I20260709 12:12:58.162895 24285 raft_consensus.cc:359] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.163722 24285 raft_consensus.cc:385] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.164098 24285 raft_consensus.cc:740] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.164925 24285 consensus_queue.cc:260] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.167397 24285 ts_tablet_manager.cc:1434] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:58.170293 24285 tablet_bootstrap.cc:492] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.154990 24284 raft_consensus.cc:385] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.169852 24221 tablet_service.cc:1511] Processing CreateTablet for tablet e0856b61c9894cf4b8c1c263d489820c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:12:58.144258 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 84253.8us
I20260709 12:12:58.167546 24080 tablet_service.cc:1511] Processing CreateTablet for tablet e0856b61c9894cf4b8c1c263d489820c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:58.186659 24058 leader_election.cc:304] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:58.189667 24288 tablet_bootstrap.cc:654] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.187024 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0856b61c9894cf4b8c1c263d489820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.199703 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0856b61c9894cf4b8c1c263d489820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.203995 23913 catalog_manager.cc:5697] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.205766 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4028cf0a93848479c9e713d7e2bc5d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:58.206506 24165 raft_consensus.cc:3060] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.212558 24303 raft_consensus.cc:2804] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.213542 24303 raft_consensus.cc:493] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.213963 24303 raft_consensus.cc:3060] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.213364 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4028cf0a93848479c9e713d7e2bc5d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
W20260709 12:12:58.221715 24058 leader_election.cc:343] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.224826 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 07d527b984d44ebd82ac7b1d7d81efbf (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:58.226547 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d527b984d44ebd82ac7b1d7d81efbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.194648 24284 raft_consensus.cc:740] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.229704 24285 tablet_bootstrap.cc:654] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.235417 23999 tablet_service.cc:1511] Processing CreateTablet for tablet e0856b61c9894cf4b8c1c263d489820c (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:58.238724 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0856b61c9894cf4b8c1c263d489820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.238582 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 07d527b984d44ebd82ac7b1d7d81efbf (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:58.241858 24282 tablet_bootstrap.cc:492] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:58.242465 24282 ts_tablet_manager.cc:1403] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.175s	user 0.021s	sys 0.011s
I20260709 12:12:58.244794 24311 raft_consensus.cc:493] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.245283 24311 raft_consensus.cc:515] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.245674 24282 raft_consensus.cc:359] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.246447 24282 raft_consensus.cc:385] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.246734 24282 raft_consensus.cc:740] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.247563 24311 leader_election.cc:290] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:58.247555 24282 consensus_queue.cc:260] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.248795 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bf8aa11eb9402cbf4870c19cce296a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.249456 24017 raft_consensus.cc:2468] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 0.
I20260709 12:12:58.250198 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bf8aa11eb9402cbf4870c19cce296a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:58.248759 24223 tablet_service.cc:1511] Processing CreateTablet for tablet 07d527b984d44ebd82ac7b1d7d81efbf (DEFAULT_TABLE table=test-workload [id=b039b718ead2455eacf00ca2c4016e0f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:58.252588 24132 leader_election.cc:304] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:12:58.253477 24282 ts_tablet_manager.cc:1434] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
W20260709 12:12:58.256922 24131 leader_election.cc:343] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.257100 24284 consensus_queue.cc:260] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.258534 24311 raft_consensus.cc:2804] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.259075 24311 raft_consensus.cc:493] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.259440 24311 raft_consensus.cc:3060] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.261302 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d527b984d44ebd82ac7b1d7d81efbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.269620 24288 tablet_bootstrap.cc:492] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:58.263860 24284 ts_tablet_manager.cc:1434] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.183s	user 0.004s	sys 0.004s
I20260709 12:12:58.271896 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d527b984d44ebd82ac7b1d7d81efbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.273011 24282 tablet_bootstrap.cc:492] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:58.270937 24165 raft_consensus.cc:2468] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:58.284614 24058 leader_election.cc:304] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:58.285605 24338 raft_consensus.cc:2804] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.286213 24338 raft_consensus.cc:697] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:12:58.286348 24288 ts_tablet_manager.cc:1403] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.221s	user 0.025s	sys 0.029s
I20260709 12:12:58.287381 24338 consensus_queue.cc:237] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.290416 24282 tablet_bootstrap.cc:654] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.294203 24284 tablet_bootstrap.cc:492] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:58.289655 24288 raft_consensus.cc:359] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.294531 24311 raft_consensus.cc:515] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.295608 24300 raft_consensus.cc:493] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.296126 24300 raft_consensus.cc:515] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.297046 24285 tablet_bootstrap.cc:492] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.297580 24285 ts_tablet_manager.cc:1403] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.128s	user 0.017s	sys 0.000s
I20260709 12:12:58.298269 24300 leader_election.cc:290] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:58.299938 24311 leader_election.cc:290] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:58.300534 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bf8aa11eb9402cbf4870c19cce296a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:58.295353 24288 raft_consensus.cc:385] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.301062 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bf8aa11eb9402cbf4870c19cce296a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:58.306444 24288 raft_consensus.cc:740] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.301409 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.307394 24288 consensus_queue.cc:260] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.308086 24016 raft_consensus.cc:2468] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:12:58.300531 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.302614 24285 raft_consensus.cc:359] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:12:58.309505 24131 leader_election.cc:343] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.306488 24017 raft_consensus.cc:3060] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.309551 24303 raft_consensus.cc:515] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.321585 24303 leader_election.cc:290] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.324102 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172aa0d42e8646ce8e9b3ef01f4628d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:58.324909 24016 raft_consensus.cc:3060] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.318607 24206 leader_election.cc:304] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
W20260709 12:12:58.326833 24206 leader_election.cc:343] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.327986 24300 raft_consensus.cc:2804] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.328534 24300 raft_consensus.cc:493] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.328896 24300 raft_consensus.cc:3060] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.313088 24285 raft_consensus.cc:385] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.329542 24285 raft_consensus.cc:740] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.330506 24285 consensus_queue.cc:260] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.329192 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172aa0d42e8646ce8e9b3ef01f4628d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:58.332368 24165 raft_consensus.cc:3060] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.345652 24165 raft_consensus.cc:2468] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:58.356575 24058 leader_election.cc:304] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:58.357708 24303 raft_consensus.cc:2804] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.352232 24017 raft_consensus.cc:2468] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:12:58.358464 24303 raft_consensus.cc:697] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:12:58.359457 24303 consensus_queue.cc:237] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.360998 24284 tablet_bootstrap.cc:654] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.355968 24288 ts_tablet_manager.cc:1434] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.001s
I20260709 12:12:58.362607 24132 leader_election.cc:304] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:58.363317 24288 tablet_bootstrap.cc:492] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:58.364010 24311 raft_consensus.cc:2804] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.357859 24300 raft_consensus.cc:515] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.369953 24300 leader_election.cc:290] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:58.372037 24285 ts_tablet_manager.cc:1434] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.004s
I20260709 12:12:58.372570 24288 tablet_bootstrap.cc:654] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.373010 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:58.370179 24282 tablet_bootstrap.cc:492] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:58.373770 24017 raft_consensus.cc:3060] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.374037 24282 ts_tablet_manager.cc:1403] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.025s
I20260709 12:12:58.380159 24285 tablet_bootstrap.cc:492] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.380719 24282 raft_consensus.cc:359] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.381526 24282 raft_consensus.cc:385] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.381793 24282 raft_consensus.cc:740] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.383739 24282 consensus_queue.cc:260] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.377894 24311 raft_consensus.cc:697] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 1 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:12:58.386878 24311 consensus_queue.cc:237] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.390864 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:58.391714 24165 raft_consensus.cc:3060] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.399266 24240 raft_consensus.cc:3060] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.404788 24017 raft_consensus.cc:2468] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:12:58.406641 24206 leader_election.cc:304] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:58.407701 24348 raft_consensus.cc:2804] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.408236 24348 raft_consensus.cc:697] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:12:58.375463 24016 raft_consensus.cc:2468] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:58.409269 24348 consensus_queue.cc:237] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.416289 24165 raft_consensus.cc:2468] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:12:58.418372 24288 tablet_bootstrap.cc:492] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:58.418998 24288 ts_tablet_manager.cc:1403] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.031s
I20260709 12:12:58.426640 24285 tablet_bootstrap.cc:654] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.427219 24288 raft_consensus.cc:359] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.428102 24288 raft_consensus.cc:385] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.428400 24288 raft_consensus.cc:740] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.434269 24282 ts_tablet_manager.cc:1434] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.004s
I20260709 12:12:58.435395 24282 tablet_bootstrap.cc:492] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:58.435258 23913 catalog_manager.cc:5697] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.437678 23913 catalog_manager.cc:5697] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.438476 23915 catalog_manager.cc:5697] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.439574 24311 raft_consensus.cc:493] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.440089 24311 raft_consensus.cc:515] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.429217 24288 consensus_queue.cc:260] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.447046 24311 leader_election.cc:290] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:58.448303 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.449816 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:58.451628 24284 tablet_bootstrap.cc:492] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:58.452205 24284 ts_tablet_manager.cc:1403] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.158s	user 0.006s	sys 0.008s
I20260709 12:12:58.452529 24288 ts_tablet_manager.cc:1434] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
W20260709 12:12:58.452930 24131 leader_election.cc:343] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.453632 24288 tablet_bootstrap.cc:492] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
W20260709 12:12:58.455549 24132 leader_election.cc:343] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.456053 24132 leader_election.cc:304] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:58.456965 24355 raft_consensus.cc:2749] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.460009 24284 raft_consensus.cc:359] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.460935 24284 raft_consensus.cc:385] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.461256 24284 raft_consensus.cc:740] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.462065 24288 tablet_bootstrap.cc:654] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.464802 24284 consensus_queue.cc:260] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:12:58.469064 23963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:58.471272 24282 tablet_bootstrap.cc:654] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.481592 24284 ts_tablet_manager.cc:1434] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 12:12:58.481961 24285 tablet_bootstrap.cc:492] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.482560 24285 ts_tablet_manager.cc:1403] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.014s
I20260709 12:12:58.482820 24284 tablet_bootstrap.cc:492] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:58.484052 24282 tablet_bootstrap.cc:492] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:58.484589 24282 ts_tablet_manager.cc:1403] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.003s
I20260709 12:12:58.485129 24285 raft_consensus.cc:359] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.485718 24285 raft_consensus.cc:385] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.485946 24285 raft_consensus.cc:740] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.488492 24285 consensus_queue.cc:260] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.490626 24288 tablet_bootstrap.cc:492] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:58.491079 24285 ts_tablet_manager.cc:1434] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:58.492290 24285 tablet_bootstrap.cc:492] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.494544 24284 tablet_bootstrap.cc:654] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.491223 24288 ts_tablet_manager.cc:1403] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.003s
I20260709 12:12:58.496668 23911 catalog_manager.cc:5697] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.498616 24285 tablet_bootstrap.cc:654] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.498494 24288 raft_consensus.cc:359] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.501420 24288 raft_consensus.cc:385] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.501171 24282 raft_consensus.cc:359] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.501756 24288 raft_consensus.cc:740] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.501876 24282 raft_consensus.cc:385] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.502254 24282 raft_consensus.cc:740] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.502822 24288 consensus_queue.cc:260] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.503095 24282 consensus_queue.cc:260] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.505235 24288 ts_tablet_manager.cc:1434] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:12:58.506383 24288 tablet_bootstrap.cc:492] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:58.508327 24282 ts_tablet_manager.cc:1434] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:12:58.509352 24282 tablet_bootstrap.cc:492] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:58.514436 24288 tablet_bootstrap.cc:654] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.516091 24282 tablet_bootstrap.cc:654] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.519390 24284 tablet_bootstrap.cc:492] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:58.519949 24284 ts_tablet_manager.cc:1403] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.001s
I20260709 12:12:58.520612 24285 tablet_bootstrap.cc:492] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.521116 24285 ts_tablet_manager.cc:1403] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.015s
I20260709 12:12:58.522979 24284 raft_consensus.cc:359] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.523723 24284 raft_consensus.cc:385] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.523990 24284 raft_consensus.cc:740] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.524065 24285 raft_consensus.cc:359] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.524799 24285 raft_consensus.cc:385] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.524824 24303 raft_consensus.cc:493] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.524837 24284 consensus_queue.cc:260] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.525456 24285 raft_consensus.cc:740] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.525795 24303 raft_consensus.cc:515] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.526470 24285 consensus_queue.cc:260] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.528017 24303 leader_election.cc:290] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:58.528649 24285 ts_tablet_manager.cc:1434] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:58.529645 24285 tablet_bootstrap.cc:492] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.530280 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9e9352fdad40bca805117f2fdbaaa3" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:12:58.532256 24058 leader_election.cc:343] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.532461 24284 ts_tablet_manager.cc:1434] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:12:58.533474 24284 tablet_bootstrap.cc:492] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:58.533555 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9e9352fdad40bca805117f2fdbaaa3" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:58.534365 24240 raft_consensus.cc:2468] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:58.535660 24058 leader_election.cc:304] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:12:58.536919 24303 raft_consensus.cc:2804] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.537338 24303 raft_consensus.cc:493] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.537655 24285 tablet_bootstrap.cc:654] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.537691 24303 raft_consensus.cc:3060] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.541589 24289 raft_consensus.cc:493] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.542223 24289 raft_consensus.cc:515] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.544679 24284 tablet_bootstrap.cc:654] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.546479 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
W20260709 12:12:58.548117 23983 leader_election.cc:343] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.549502 24285 tablet_bootstrap.cc:492] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.544706 24289 leader_election.cc:290] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:58.550175 24285 ts_tablet_manager.cc:1403] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:12:58.549584 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.550962 24165 raft_consensus.cc:2468] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:12:58.552615 23983 leader_election.cc:304] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:58.553385 24285 raft_consensus.cc:359] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.554016 24289 raft_consensus.cc:2804] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.554148 24285 raft_consensus.cc:385] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.554525 24289 raft_consensus.cc:493] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.554591 24285 raft_consensus.cc:740] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.554953 24289 raft_consensus.cc:3060] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.555371 24284 tablet_bootstrap.cc:492] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:58.555886 24284 ts_tablet_manager.cc:1403] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:12:58.555506 24285 consensus_queue.cc:260] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.558015 24285 ts_tablet_manager.cc:1434] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:58.559029 24285 tablet_bootstrap.cc:492] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.564139 24284 raft_consensus.cc:359] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.564710 24289 raft_consensus.cc:515] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.564881 24284 raft_consensus.cc:385] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.567409 24284 raft_consensus.cc:740] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.568020 24285 tablet_bootstrap.cc:654] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.568507 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:58.569126 24165 raft_consensus.cc:3060] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.568148 24284 consensus_queue.cc:260] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.582285 24348 raft_consensus.cc:493] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.582866 24348 raft_consensus.cc:515] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.575289 24303 raft_consensus.cc:515] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.583683 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:58.584280 24289 leader_election.cc:290] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:58.584417 24239 raft_consensus.cc:3060] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.584992 24348 leader_election.cc:290] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.586977 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.587100 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.587706 24166 raft_consensus.cc:2468] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:12:58.589102 24206 leader_election.cc:304] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:58.590358 24329 consensus_queue.cc:1048] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.590843 24348 raft_consensus.cc:2804] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.591243 24348 raft_consensus.cc:493] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.591588 24348 raft_consensus.cc:3060] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.592160 24338 consensus_queue.cc:1048] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.587903 24016 raft_consensus.cc:2468] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:12:58.598740 24285 tablet_bootstrap.cc:492] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.599303 24285 ts_tablet_manager.cc:1403] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.005s
I20260709 12:12:58.598811 24300 raft_consensus.cc:493] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.601989 24300 raft_consensus.cc:515] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.604195 24300 leader_election.cc:290] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:58.605165 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.605690 24348 raft_consensus.cc:515] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.605928 24017 raft_consensus.cc:2468] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:12:58.606077 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:58.607672 24206 leader_election.cc:304] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
W20260709 12:12:58.608588 24205 leader_election.cc:343] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.609172 24284 ts_tablet_manager.cc:1434] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.003s
I20260709 12:12:58.610244 24284 tablet_bootstrap.cc:492] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:58.610442 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:58.611137 24166 raft_consensus.cc:3060] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.614173 24165 raft_consensus.cc:2468] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:12:58.616371 24284 tablet_bootstrap.cc:654] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.615927 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:58.603935 24285 raft_consensus.cc:359] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.616860 24285 raft_consensus.cc:385] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.617175 24285 raft_consensus.cc:740] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.617686 23983 leader_election.cc:304] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:12:58.617894 24285 consensus_queue.cc:260] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.618713 24289 raft_consensus.cc:2804] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.616698 24300 raft_consensus.cc:2804] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.620051 24289 raft_consensus.cc:697] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:12:58.620683 24017 raft_consensus.cc:3060] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.623872 24166 raft_consensus.cc:2468] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:12:58.625365 24206 leader_election.cc:304] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:58.624127 24289 consensus_queue.cc:237] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.619989 24285 ts_tablet_manager.cc:1434] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:12:58.631016 24285 tablet_bootstrap.cc:492] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.619912 24300 raft_consensus.cc:493] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.635529 24355 raft_consensus.cc:493] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.636176 24355 raft_consensus.cc:515] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.638473 24285 tablet_bootstrap.cc:654] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.638924 24300 raft_consensus.cc:3060] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.639633 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.641093 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:12:58.641875 24132 leader_election.cc:343] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.640017 24355 leader_election.cc:290] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
W20260709 12:12:58.642390 24131 leader_election.cc:343] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.642822 24131 leader_election.cc:304] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:58.644488 24355 raft_consensus.cc:2749] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.622751 24239 raft_consensus.cc:2468] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:12:58.650039 24282 tablet_bootstrap.cc:492] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:58.650765 24282 ts_tablet_manager.cc:1403] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.004s
I20260709 12:12:58.607884 24348 leader_election.cc:290] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.640239 24017 raft_consensus.cc:2468] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:12:58.656066 24348 raft_consensus.cc:2804] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.656598 24348 raft_consensus.cc:697] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:12:58.660327 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9e9352fdad40bca805117f2fdbaaa3" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:58.660091 24282 raft_consensus.cc:359] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
W20260709 12:12:58.661887 24058 leader_election.cc:343] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.661728 24348 consensus_queue.cc:237] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.661003 24282 raft_consensus.cc:385] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.662974 24282 raft_consensus.cc:740] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.663702 24282 consensus_queue.cc:260] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.655694 24303 leader_election.cc:290] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:58.665546 24282 ts_tablet_manager.cc:1434] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:12:58.666653 24282 tablet_bootstrap.cc:492] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:58.662014 24300 raft_consensus.cc:515] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.668720 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9e9352fdad40bca805117f2fdbaaa3" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:58.669399 24284 tablet_bootstrap.cc:492] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:58.669992 24284 ts_tablet_manager.cc:1403] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.003s
I20260709 12:12:58.670172 24300 leader_election.cc:290] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:58.669353 24239 raft_consensus.cc:3060] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.670718 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:58.671270 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:58.671360 24017 raft_consensus.cc:3060] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.674474 24205 leader_election.cc:343] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.681342 24288 tablet_bootstrap.cc:492] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:58.681947 24288 ts_tablet_manager.cc:1403] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.176s	user 0.034s	sys 0.060s
I20260709 12:12:58.681628 24284 raft_consensus.cc:359] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.682367 24284 raft_consensus.cc:385] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.682659 24284 raft_consensus.cc:740] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.683561 24284 consensus_queue.cc:260] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.685299 24288 raft_consensus.cc:359] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.685904 24239 raft_consensus.cc:2468] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:58.686053 24288 raft_consensus.cc:385] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.687212 24288 raft_consensus.cc:740] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.687494 24058 leader_election.cc:304] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:12:58.688010 24017 raft_consensus.cc:2468] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:12:58.687892 24288 consensus_queue.cc:260] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.688257 24338 raft_consensus.cc:2804] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.689416 24206 leader_election.cc:304] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:58.689946 24338 raft_consensus.cc:697] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:12:58.690091 24288 ts_tablet_manager.cc:1434] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:12:58.690713 24300 raft_consensus.cc:2804] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.691248 24288 tablet_bootstrap.cc:492] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:58.691246 24300 raft_consensus.cc:697] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:12:58.691012 24338 consensus_queue.cc:237] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.692348 24300 consensus_queue.cc:237] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.685959 24284 ts_tablet_manager.cc:1434] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:12:58.694293 24284 tablet_bootstrap.cc:492] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:58.696890 24303 raft_consensus.cc:493] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.697171 24282 tablet_bootstrap.cc:654] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.699754 24285 tablet_bootstrap.cc:492] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.708915 24285 ts_tablet_manager.cc:1403] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.011s
I20260709 12:12:58.711978 24285 raft_consensus.cc:359] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.715601 24383 raft_consensus.cc:493] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.714190 24303 raft_consensus.cc:515] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.718247 24303 leader_election.cc:290] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:58.704298 24288 tablet_bootstrap.cc:654] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.715606 24285 raft_consensus.cc:385] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.719892 24285 raft_consensus.cc:740] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.720808 24285 consensus_queue.cc:260] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.725427 24285 ts_tablet_manager.cc:1434] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:12:58.725957 24383 raft_consensus.cc:515] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.700807 24284 tablet_bootstrap.cc:654] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.729470 24383 leader_election.cc:290] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.731518 24285 tablet_bootstrap.cc:492] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.739886 24288 tablet_bootstrap.cc:492] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:58.740674 24288 ts_tablet_manager.cc:1403] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.006s
I20260709 12:12:58.743140 24284 tablet_bootstrap.cc:492] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:58.743695 24284 ts_tablet_manager.cc:1403] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.003s
I20260709 12:12:58.743367 23915 catalog_manager.cc:5697] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.744284 24288 raft_consensus.cc:359] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.745150 24288 raft_consensus.cc:385] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.745498 24288 raft_consensus.cc:740] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.746436 24288 consensus_queue.cc:260] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.748001 24288 ts_tablet_manager.cc:1434] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:58.750341 24288 tablet_bootstrap.cc:492] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:58.750603 24368 raft_consensus.cc:493] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.751132 24368 raft_consensus.cc:515] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.753875 24368 leader_election.cc:290] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.749258 23911 catalog_manager.cc:5697] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.754858 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:58.755616 24092 raft_consensus.cc:2468] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:12:58.756879 23982 leader_election.cc:304] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:58.757308 24288 tablet_bootstrap.cc:654] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.757939 24368 raft_consensus.cc:2804] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.758929 24368 raft_consensus.cc:493] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.758962 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.759531 24368 raft_consensus.cc:3060] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.761030 23983 leader_election.cc:343] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.764299 24285 tablet_bootstrap.cc:654] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.758414 24284 raft_consensus.cc:359] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.767863 24284 raft_consensus.cc:385] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.768257 24284 raft_consensus.cc:740] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.769191 24284 consensus_queue.cc:260] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.772569 24285 tablet_bootstrap.cc:492] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.773110 24285 ts_tablet_manager.cc:1403] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.004s
I20260709 12:12:58.774380 24288 tablet_bootstrap.cc:492] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:58.774979 24288 ts_tablet_manager.cc:1403] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
W20260709 12:12:58.775416 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:38373, user_credentials={real_user=slave}} blocked reactor thread for 58397us
I20260709 12:12:58.776021 24285 raft_consensus.cc:359] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.776705 24285 raft_consensus.cc:385] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.776978 24285 raft_consensus.cc:740] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.777102 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890a157efb254124a8fa371cfcda5616" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.778138 24288 raft_consensus.cc:359] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.778688 24285 consensus_queue.cc:260] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.779772 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890a157efb254124a8fa371cfcda5616" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:58.780171 24284 ts_tablet_manager.cc:1434] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:12:58.780443 24240 raft_consensus.cc:2468] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:58.780668 24288 raft_consensus.cc:385] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.781040 24288 raft_consensus.cc:740] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.781158 24285 ts_tablet_manager.cc:1434] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:58.781766 24288 consensus_queue.cc:260] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.782229 24285 tablet_bootstrap.cc:492] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.783710 24284 tablet_bootstrap.cc:492] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:58.784926 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.790016 24285 tablet_bootstrap.cc:654] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.791499 24288 ts_tablet_manager.cc:1434] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:12:58.792843 24288 tablet_bootstrap.cc:492] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:58.794420 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.798904 24288 tablet_bootstrap.cc:654] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.790122 24284 tablet_bootstrap.cc:654] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.801716 24285 tablet_bootstrap.cc:492] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.803025 24285 ts_tablet_manager.cc:1403] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:12:58.803470 24240 raft_consensus.cc:3060] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.805873 24285 raft_consensus.cc:359] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.806722 24285 raft_consensus.cc:385] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.807001 24285 raft_consensus.cc:740] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.807837 24285 consensus_queue.cc:260] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:58.810240 24285 ts_tablet_manager.cc:1434] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:12:58.811156 24285 tablet_bootstrap.cc:492] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.812592 24329 raft_consensus.cc:493] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.812795 24368 raft_consensus.cc:515] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.813220 24329 raft_consensus.cc:515] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.815455 24329 leader_election.cc:290] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:58.816191 24017 raft_consensus.cc:2393] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 in current term 1: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:12:58.816632 24288 tablet_bootstrap.cc:492] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:58.817229 24288 ts_tablet_manager.cc:1403] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 12:12:58.815723 23914 catalog_manager.cc:5697] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.818208 24285 tablet_bootstrap.cc:654] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.819273 24058 leader_election.cc:304] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:58.820639 24329 raft_consensus.cc:2804] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.821038 24329 raft_consensus.cc:493] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.821372 24329 raft_consensus.cc:3060] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.824587 24284 tablet_bootstrap.cc:492] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:58.825137 24284 ts_tablet_manager.cc:1403] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.002s
I20260709 12:12:58.825184 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:58.825857 24092 raft_consensus.cc:3060] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.828644 24058 leader_election.cc:343] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.830485 24386 consensus_queue.cc:1048] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:12:58.830873 24058 leader_election.cc:343] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.819005 23914 catalog_manager.cc:5697] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.831025 24329 raft_consensus.cc:515] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.829752 24285 tablet_bootstrap.cc:492] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:58.822960 24288 raft_consensus.cc:359] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.832235 24288 raft_consensus.cc:385] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.828289 24284 raft_consensus.cc:359] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.832389 24285 ts_tablet_manager.cc:1403] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 12:12:58.832547 24288 raft_consensus.cc:740] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.833205 24092 raft_consensus.cc:2468] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:12:58.833676 24288 consensus_queue.cc:260] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.838235 24386 consensus_queue.cc:1048] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.832866 24284 raft_consensus.cc:385] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.839495 24284 raft_consensus.cc:740] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.840332 24284 consensus_queue.cc:260] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.841480 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86266bc0f0914a64b02089b09f4d3b72" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:58.842250 24240 raft_consensus.cc:2468] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:58.835614 24368 leader_election.cc:290] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.842429 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86266bc0f0914a64b02089b09f4d3b72" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.835937 24285 raft_consensus.cc:359] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.843148 24017 raft_consensus.cc:2468] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:58.843756 24284 ts_tablet_manager.cc:1434] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:12:58.843154 24285 raft_consensus.cc:385] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.844667 24285 raft_consensus.cc:740] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.845043 23982 leader_election.cc:304] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:58.837632 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:58.845283 24284 tablet_bootstrap.cc:492] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:58.846314 24058 leader_election.cc:304] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
W20260709 12:12:58.847198 23983 leader_election.cc:343] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.847805 24338 raft_consensus.cc:2749] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.848678 24338 consensus_queue.cc:1048] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.849107 24058 leader_election.cc:304] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:58.849953 24386 raft_consensus.cc:2804] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.850411 24386 raft_consensus.cc:493] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.850804 24386 raft_consensus.cc:3060] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.851415 24284 tablet_bootstrap.cc:654] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.851737 24282 tablet_bootstrap.cc:492] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:58.852320 24282 ts_tablet_manager.cc:1403] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.023s
I20260709 12:12:58.848382 24368 raft_consensus.cc:2804] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.853518 24368 raft_consensus.cc:697] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:12:58.843032 24288 ts_tablet_manager.cc:1434] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:12:58.854533 24368 consensus_queue.cc:237] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.855064 24288 tablet_bootstrap.cc:492] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:58.855383 24282 raft_consensus.cc:359] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.856105 24282 raft_consensus.cc:385] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.856354 24282 raft_consensus.cc:740] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.837190 24329 leader_election.cc:290] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:58.860018 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890a157efb254124a8fa371cfcda5616" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:58.845463 24285 consensus_queue.cc:260] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.862651 24288 tablet_bootstrap.cc:654] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.863197 24285 ts_tablet_manager.cc:1434] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 12:12:58.864307 24285 tablet_bootstrap.cc:492] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:58.870173 24338 raft_consensus.cc:493] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.870746 24338 raft_consensus.cc:515] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.872884 24338 leader_election.cc:290] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:58.874218 24311 consensus_queue.cc:1048] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.879990 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236a44f6e6b740ebbf1fb3b1f367f36a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:58.880200 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236a44f6e6b740ebbf1fb3b1f367f36a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.880714 24239 raft_consensus.cc:2468] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:58.882513 24300 consensus_queue.cc:1048] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.885257 24391 raft_consensus.cc:493] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.885774 24391 raft_consensus.cc:515] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.888406 24391 leader_election.cc:290] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.889307 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:58.890168 24092 raft_consensus.cc:2468] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:12:58.890681 24338 consensus_queue.cc:1048] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.891610 24383 raft_consensus.cc:493] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.891880 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.891991 23982 leader_election.cc:304] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:58.892158 24383 raft_consensus.cc:515] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.892554 24164 raft_consensus.cc:2468] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:12:58.893332 24289 raft_consensus.cc:2804] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.893783 24289 raft_consensus.cc:493] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.894178 24289 raft_consensus.cc:3060] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.894325 24383 leader_election.cc:290] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.895865 24058 leader_election.cc:304] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:58.898648 24386 raft_consensus.cc:515] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:58.905652 24338 raft_consensus.cc:2804] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.906569 24338 raft_consensus.cc:493] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.906975 24338 raft_consensus.cc:3060] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.911767 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890a157efb254124a8fa371cfcda5616" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:58.913486 24240 raft_consensus.cc:3060] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.914305 24289 raft_consensus.cc:515] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.917507 24285 tablet_bootstrap.cc:654] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.918579 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:58.919341 24092 raft_consensus.cc:3060] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.914215 24058 leader_election.cc:343] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.922474 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bf8aa11eb9402cbf4870c19cce296a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.922479 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bf8aa11eb9402cbf4870c19cce296a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:58.927022 24300 consensus_queue.cc:1048] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.930532 24091 raft_consensus.cc:3060] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.932441 24092 raft_consensus.cc:2468] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:12:58.934003 23982 leader_election.cc:304] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:58.941699 24386 leader_election.cc:290] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:58.862562 24282 consensus_queue.cc:260] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.946163 24355 consensus_queue.cc:1048] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.948506 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86266bc0f0914a64b02089b09f4d3b72" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:58.950721 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86266bc0f0914a64b02089b09f4d3b72" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:58.953117 24238 raft_consensus.cc:3060] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.953152 24014 raft_consensus.cc:3060] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.956372 24300 raft_consensus.cc:493] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.956916 24300 raft_consensus.cc:515] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:58.960754 24300 leader_election.cc:290] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.961138 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f203904cd1b94afca969b8b361e196b8" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:58.961841 24162 raft_consensus.cc:2468] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:12:58.967020 24238 raft_consensus.cc:2468] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:58.967306 24206 leader_election.cc:304] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:58.968230 24300 raft_consensus.cc:2804] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.968822 24300 raft_consensus.cc:493] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.969149 24300 raft_consensus.cc:3060] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.969053 24368 raft_consensus.cc:2804] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.972234 24368 raft_consensus.cc:697] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:12:58.972637 24014 raft_consensus.cc:2468] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:58.973260 24368 consensus_queue.cc:237] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:58.974161 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f203904cd1b94afca969b8b361e196b8" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:12:58.977057 24205 leader_election.cc:343] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.978308 24166 raft_consensus.cc:3060] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.975298 24058 leader_election.cc:304] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:12:58.981236 24058 leader_election.cc:304] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:58.979362 24289 leader_election.cc:290] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:58.979592 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:58.982165 24162 raft_consensus.cc:3060] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.984287 24288 tablet_bootstrap.cc:492] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:58.984902 24288 ts_tablet_manager.cc:1403] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.007s
I20260709 12:12:58.987069 24166 raft_consensus.cc:2468] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:58.990077 24162 raft_consensus.cc:2468] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:12:58.992103 24282 ts_tablet_manager.cc:1434] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.139s	user 0.006s	sys 0.000s
I20260709 12:12:58.993198 24282 tablet_bootstrap.cc:492] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:58.944566 24338 raft_consensus.cc:515] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.003533 24338 leader_election.cc:290] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:59.007189 24329 raft_consensus.cc:2749] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.008003 24329 raft_consensus.cc:2804] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.010489 24288 raft_consensus.cc:359] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.012071 24288 raft_consensus.cc:385] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.013036 24288 raft_consensus.cc:740] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.013715 24288 consensus_queue.cc:260] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.015753 24288 ts_tablet_manager.cc:1434] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:12:59.016716 24288 tablet_bootstrap.cc:492] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:59.018162 24329 raft_consensus.cc:697] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:12:59.019229 24329 consensus_queue.cc:237] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.025372 24288 tablet_bootstrap.cc:654] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:59.036314 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.68:38373, user_credentials={real_user=slave}} blocked reactor thread for 55170.1us
I20260709 12:12:59.038998 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236a44f6e6b740ebbf1fb3b1f367f36a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:59.039727 24238 raft_consensus.cc:3060] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.050004 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236a44f6e6b740ebbf1fb3b1f367f36a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:59.051749 24285 tablet_bootstrap.cc:492] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:59.051299 24058 leader_election.cc:304] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:59.052635 24285 ts_tablet_manager.cc:1403] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.189s	user 0.010s	sys 0.004s
I20260709 12:12:59.053370 24382 raft_consensus.cc:2804] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.053956 24382 raft_consensus.cc:697] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:12:59.054840 24382 consensus_queue.cc:237] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.055905 24285 raft_consensus.cc:359] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.061113 23912 catalog_manager.cc:5697] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.066419 24348 raft_consensus.cc:493] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.066768 24371 raft_consensus.cc:493] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.068284 24285 raft_consensus.cc:385] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.069022 24285 raft_consensus.cc:740] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.068738 24371 raft_consensus.cc:515] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.070341 24285 consensus_queue.cc:260] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.084478 24409 raft_consensus.cc:493] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.084731 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:59.085500 24284 tablet_bootstrap.cc:492] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:59.086055 24284 ts_tablet_manager.cc:1403] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.241s	user 0.071s	sys 0.109s
I20260709 12:12:59.074551 24348 raft_consensus.cc:515] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.089740 24285 ts_tablet_manager.cc:1434] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:12:59.085094 24409 raft_consensus.cc:515] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
W20260709 12:12:59.086905 24205 leader_election.cc:343] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.094990 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:59.095446 24348 leader_election.cc:290] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:59.072829 24300 raft_consensus.cc:515] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.096165 24284 raft_consensus.cc:359] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.096896 24284 raft_consensus.cc:385] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.097159 24284 raft_consensus.cc:740] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.097988 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:59.098582 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f203904cd1b94afca969b8b361e196b8" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
W20260709 12:12:59.099359 24206 leader_election.cc:343] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:59.100234 24205 leader_election.cc:343] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.071239 24371 leader_election.cc:290] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:59.103626 24409 leader_election.cc:290] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:59.103534 24371 consensus_queue.cc:1048] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.105649 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222f5f64725d4c94803b2d55242cc5dd" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:59.108317 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:59.109048 24164 raft_consensus.cc:2468] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
W20260709 12:12:59.109948 23983 leader_election.cc:343] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.110281 24206 leader_election.cc:304] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:12:59.111068 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222f5f64725d4c94803b2d55242cc5dd" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:59.111635 24371 raft_consensus.cc:2804] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.089133 24240 raft_consensus.cc:2468] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:59.113622 24371 raft_consensus.cc:493] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.114337 24285 tablet_bootstrap.cc:492] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:59.113382 24284 consensus_queue.cc:260] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.114066 24371 raft_consensus.cc:3060] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.074808 24058 leader_election.cc:343] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:59.112914 24206 leader_election.cc:343] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.117472 24288 tablet_bootstrap.cc:492] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:59.117365 24206 leader_election.cc:304] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
W20260709 12:12:59.117192 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 44226.3us
I20260709 12:12:59.118003 24288 ts_tablet_manager.cc:1403] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.005s
I20260709 12:12:59.118824 24372 raft_consensus.cc:2749] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:59.120409 23983 leader_election.cc:343] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.120884 23983 leader_election.cc:304] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:59.122562 24300 leader_election.cc:290] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.122388 23911 catalog_manager.cc:5697] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.124533 24329 raft_consensus.cc:493] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.125168 24329 raft_consensus.cc:515] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.127458 24329 leader_election.cc:290] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:59.129479 24382 consensus_queue.cc:1048] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.091730 24282 tablet_bootstrap.cc:654] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.131850 24409 raft_consensus.cc:2749] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.124488 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f203904cd1b94afca969b8b361e196b8" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:59.137040 24165 raft_consensus.cc:3060] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.138072 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1985e29d943909e299c616813e9a6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:59.139122 24238 raft_consensus.cc:2468] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:12:59.143517 24288 raft_consensus.cc:359] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.144375 24288 raft_consensus.cc:385] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.144913 24288 raft_consensus.cc:740] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.145381 24284 ts_tablet_manager.cc:1434] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.001s
I20260709 12:12:59.143534 24371 raft_consensus.cc:515] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.145676 24288 consensus_queue.cc:260] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.147522 24391 consensus_queue.cc:1048] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.149088 24404 consensus_queue.cc:1048] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.151144 24284 tablet_bootstrap.cc:492] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:59.150002 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:59.154623 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:59.155767 24162 raft_consensus.cc:3060] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.158464 24058 leader_election.cc:343] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.161262 24338 raft_consensus.cc:493] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.161839 24338 raft_consensus.cc:515] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.165606 24338 leader_election.cc:290] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:59.167579 24162 raft_consensus.cc:2468] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:12:59.153203 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1985e29d943909e299c616813e9a6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:59.168188 24285 tablet_bootstrap.cc:654] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.168591 24058 leader_election.cc:304] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
W20260709 12:12:59.169994 24206 leader_election.cc:343] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.172108 24165 raft_consensus.cc:2468] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:12:59.151846 24371 leader_election.cc:290] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:59.174679 24288 ts_tablet_manager.cc:1434] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:12:59.180173 24288 tablet_bootstrap.cc:492] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:59.180541 24338 raft_consensus.cc:2804] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.181512 24338 raft_consensus.cc:697] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:12:59.178627 24206 leader_election.cc:304] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:12:59.183626 24206 leader_election.cc:304] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:59.184271 24371 raft_consensus.cc:2804] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.184940 24371 raft_consensus.cc:697] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:12:59.184451 24284 tablet_bootstrap.cc:654] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.186283 24371 consensus_queue.cc:237] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.186197 24338 consensus_queue.cc:237] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.189767 24091 raft_consensus.cc:3060] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.199363 23911 catalog_manager.cc:5697] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.208137 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:59.208961 24288 tablet_bootstrap.cc:654] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.220234 24372 consensus_queue.cc:1048] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.230974 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:59.236258 24418 raft_consensus.cc:2804] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.238745 24418 raft_consensus.cc:697] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
W20260709 12:12:59.246582 24058 leader_election.cc:343] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.256283 24058 leader_election.cc:304] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:59.240265 24418 consensus_queue.cc:237] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.259981 24338 raft_consensus.cc:2749] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.262534 24372 consensus_queue.cc:1048] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:59.265863 24284 tablet_bootstrap.cc:492] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:59.266453 24284 ts_tablet_manager.cc:1403] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.004s
I20260709 12:12:59.269654 24284 raft_consensus.cc:359] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.272732 24284 raft_consensus.cc:385] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.273067 24284 raft_consensus.cc:740] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.277158 24284 consensus_queue.cc:260] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.278442 24282 tablet_bootstrap.cc:492] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:59.278965 24282 ts_tablet_manager.cc:1403] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.286s	user 0.024s	sys 0.000s
I20260709 12:12:59.281876 24058 leader_election.cc:304] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:59.282902 24382 raft_consensus.cc:2749] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.284381 24371 consensus_queue.cc:1048] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.288444 24284 ts_tablet_manager.cc:1434] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 12:12:59.289724 24284 tablet_bootstrap.cc:492] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:59.270826 23912 catalog_manager.cc:5697] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.297969 24282 raft_consensus.cc:359] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.299001 24282 raft_consensus.cc:385] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.299283 24282 raft_consensus.cc:740] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.299966 24282 consensus_queue.cc:260] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.302255 24282 ts_tablet_manager.cc:1434] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:12:59.303282 24282 tablet_bootstrap.cc:492] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:59.304708 24288 tablet_bootstrap.cc:492] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:59.305344 24288 ts_tablet_manager.cc:1403] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.126s	user 0.027s	sys 0.016s
I20260709 12:12:59.310289 24288 raft_consensus.cc:359] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.311136 24288 raft_consensus.cc:385] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.311404 24288 raft_consensus.cc:740] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.312726 24288 consensus_queue.cc:260] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.314976 24288 ts_tablet_manager.cc:1434] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:12:59.316033 24288 tablet_bootstrap.cc:492] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:59.317698 23911 catalog_manager.cc:5697] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.320111 23915 catalog_manager.cc:5697] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.326627 24288 tablet_bootstrap.cc:654] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.327263 24282 tablet_bootstrap.cc:654] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.328447 24285 tablet_bootstrap.cc:492] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:59.328856 24285 ts_tablet_manager.cc:1403] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.235s	user 0.003s	sys 0.013s
I20260709 12:12:59.335711 24284 tablet_bootstrap.cc:654] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.336529 24409 raft_consensus.cc:493] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.337073 24409 raft_consensus.cc:515] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.332367 24285 raft_consensus.cc:359] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.337972 24285 raft_consensus.cc:385] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.339191 24285 raft_consensus.cc:740] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.341894 24409 leader_election.cc:290] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
W20260709 12:12:59.343631 24058 consensus_peers.cc:597] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.344194 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:59.345065 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:59.345746 24166 raft_consensus.cc:2468] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:12:59.350605 24285 consensus_queue.cc:260] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
W20260709 12:12:59.351578 23982 leader_election.cc:343] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.351631 24288 tablet_bootstrap.cc:492] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:59.352442 24288 ts_tablet_manager.cc:1403] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.009s
I20260709 12:12:59.353116 24285 ts_tablet_manager.cc:1434] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:12:59.354225 24285 tablet_bootstrap.cc:492] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:59.355451 24288 raft_consensus.cc:359] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.355887 23983 leader_election.cc:304] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:59.362135 24285 tablet_bootstrap.cc:654] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.362649 24409 raft_consensus.cc:2804] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.363113 24409 raft_consensus.cc:493] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.363479 24409 raft_consensus.cc:3060] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.356232 24288 raft_consensus.cc:385] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.364035 24288 raft_consensus.cc:740] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.363950 24391 consensus_queue.cc:1048] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.364969 24288 consensus_queue.cc:260] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.368403 24288 ts_tablet_manager.cc:1434] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:12:59.369544 24288 tablet_bootstrap.cc:492] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:59.377390 24288 tablet_bootstrap.cc:654] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.378057 24409 raft_consensus.cc:515] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.380833 24409 leader_election.cc:290] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.381181 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:59.382391 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:59.383057 24166 raft_consensus.cc:3060] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.383180 23982 leader_election.cc:343] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.384408 24282 tablet_bootstrap.cc:492] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:59.390213 24282 ts_tablet_manager.cc:1403] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.000s
I20260709 12:12:59.391902 24391 consensus_queue.cc:1048] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.393146 24282 raft_consensus.cc:359] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.393915 24282 raft_consensus.cc:385] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.395910 24282 raft_consensus.cc:740] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.398635 24284 tablet_bootstrap.cc:492] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:59.399215 24284 ts_tablet_manager.cc:1403] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.006s
I20260709 12:12:59.402482 24282 consensus_queue.cc:260] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.403499 24284 raft_consensus.cc:359] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.404254 24284 raft_consensus.cc:385] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.403723 23913 catalog_manager.cc:5697] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.407647 24282 ts_tablet_manager.cc:1434] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:12:59.408715 24282 tablet_bootstrap.cc:492] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:59.404549 24284 raft_consensus.cc:740] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.414877 24285 tablet_bootstrap.cc:492] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:59.414707 24284 consensus_queue.cc:260] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.415438 24285 ts_tablet_manager.cc:1403] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.020s
I20260709 12:12:59.418062 24285 raft_consensus.cc:359] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.418783 24285 raft_consensus.cc:385] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.419065 24285 raft_consensus.cc:740] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.420853 24285 consensus_queue.cc:260] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.421265 24166 raft_consensus.cc:2468] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:12:59.422039 24418 raft_consensus.cc:493] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.422832 24284 ts_tablet_manager.cc:1434] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:12:59.423110 24285 ts_tablet_manager.cc:1434] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:12:59.424052 24284 tablet_bootstrap.cc:492] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:59.424136 24285 tablet_bootstrap.cc:492] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:59.429070 23983 leader_election.cc:304] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:59.430071 24368 raft_consensus.cc:2804] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.430615 24368 raft_consensus.cc:697] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
W20260709 12:12:59.430799 23983 consensus_peers.cc:597] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.422999 24418 raft_consensus.cc:515] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.431710 24368 consensus_queue.cc:237] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.434378 24288 tablet_bootstrap.cc:492] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:59.434934 24288 ts_tablet_manager.cc:1403] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.003s
I20260709 12:12:59.435299 24418 leader_election.cc:290] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.437014 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e13faa2c04f46039c7c9b1d8021cbd0" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:59.437752 24090 raft_consensus.cc:2468] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:12:59.437954 24288 raft_consensus.cc:359] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.432400 24282 tablet_bootstrap.cc:654] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.438553 24382 consensus_queue.cc:1048] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.438891 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e13faa2c04f46039c7c9b1d8021cbd0" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:59.441679 24288 raft_consensus.cc:385] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.442018 24288 raft_consensus.cc:740] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.439409 24205 leader_election.cc:304] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
W20260709 12:12:59.443780 24206 leader_election.cc:343] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.445313 24418 raft_consensus.cc:2804] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.445811 24418 raft_consensus.cc:493] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.442767 24288 consensus_queue.cc:260] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.446238 24418 raft_consensus.cc:3060] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.448078 24404 consensus_queue.cc:1048] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.455643 24288 ts_tablet_manager.cc:1434] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:12:59.456693 24288 tablet_bootstrap.cc:492] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:59.456984 24409 raft_consensus.cc:493] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.457546 24409 raft_consensus.cc:515] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.458782 24284 tablet_bootstrap.cc:654] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.460210 24404 raft_consensus.cc:493] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.460714 24404 raft_consensus.cc:515] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.462443 24288 tablet_bootstrap.cc:654] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.462159 24418 raft_consensus.cc:515] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.463418 24404 leader_election.cc:290] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:59.464303 24418 leader_election.cc:290] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.465188 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236a44f6e6b740ebbf1fb3b1f367f36a" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:59.465734 24409 leader_election.cc:290] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.466018 24240 raft_consensus.cc:2393] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c4e12b81e44dae8a76443acdf7b9c9 in current term 1: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:12:59.467177 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:12:59.468776 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:59.469544 24089 raft_consensus.cc:2468] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:12:59.475638 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e13faa2c04f46039c7c9b1d8021cbd0" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
W20260709 12:12:59.477245 24206 leader_election.cc:343] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.467571 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e13faa2c04f46039c7c9b1d8021cbd0" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:59.478681 24090 raft_consensus.cc:3060] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.479202 24285 tablet_bootstrap.cc:654] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:59.468818 23983 leader_election.cc:343] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.483464 23982 leader_election.cc:304] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:12:59.484390 24409 raft_consensus.cc:2804] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.484833 24409 raft_consensus.cc:493] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.485226 24409 raft_consensus.cc:3060] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.489657 24090 raft_consensus.cc:2468] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:12:59.490636 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236a44f6e6b740ebbf1fb3b1f367f36a" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:59.509498 24418 raft_consensus.cc:493] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.542269 24418 raft_consensus.cc:515] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.543190 23982 leader_election.cc:304] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:59.544607 24404 raft_consensus.cc:3060] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.544837 24418 leader_election.cc:290] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.514808 24382 consensus_queue.cc:1048] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.548278 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1985e29d943909e299c616813e9a6" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:12:59.549901 24206 leader_election.cc:343] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.522863 24285 tablet_bootstrap.cc:492] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:59.553494 24404 raft_consensus.cc:2749] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.555246 24205 leader_election.cc:304] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:12:59.531569 24409 raft_consensus.cc:515] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.558753 24418 raft_consensus.cc:2804] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.559633 24418 raft_consensus.cc:697] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:12:59.562269 24418 consensus_queue.cc:237] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
W20260709 12:12:59.573110 23963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:59.587322 24382 consensus_queue.cc:1048] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:59.589911 24338 consensus_queue.cc:1048] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.586889 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1985e29d943909e299c616813e9a6" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:59.585412 24285 ts_tablet_manager.cc:1403] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.161s	user 0.012s	sys 0.006s
I20260709 12:12:59.593283 24092 raft_consensus.cc:2468] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:12:59.593515 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:59.594208 24090 raft_consensus.cc:3060] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.594599 24205 leader_election.cc:304] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:12:59.595788 24348 raft_consensus.cc:2804] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.596171 24348 raft_consensus.cc:493] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.596479 24348 raft_consensus.cc:3060] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.600294 24285 raft_consensus.cc:359] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.601076 24285 raft_consensus.cc:385] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.601339 24285 raft_consensus.cc:740] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.601908 24090 raft_consensus.cc:2468] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:12:59.602445 24285 consensus_queue.cc:260] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.603178 23982 leader_election.cc:304] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:12:59.604276 24404 raft_consensus.cc:2804] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.604771 24404 raft_consensus.cc:697] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:12:59.604501 24348 raft_consensus.cc:515] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.606578 24355 raft_consensus.cc:493] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.607100 24355 raft_consensus.cc:515] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.609352 24355 leader_election.cc:290] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:12:59.611588 24285 ts_tablet_manager.cc:1434] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:12:59.605654 24404 consensus_queue.cc:237] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.611477 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9e9352fdad40bca805117f2fdbaaa3" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:59.614921 24288 tablet_bootstrap.cc:492] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:59.615552 24288 ts_tablet_manager.cc:1403] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.159s	user 0.040s	sys 0.065s
I20260709 12:12:59.616983 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9e9352fdad40bca805117f2fdbaaa3" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:59.615432 23911 catalog_manager.cc:5697] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.618402 24131 leader_election.cc:304] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:59.619695 24355 raft_consensus.cc:2749] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.623266 24409 leader_election.cc:290] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.623705 24285 tablet_bootstrap.cc:492] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:59.624171 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1985e29d943909e299c616813e9a6" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:59.624825 24090 raft_consensus.cc:3060] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.625555 24348 leader_election.cc:290] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.628422 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
W20260709 12:12:59.630229 23983 leader_election.cc:343] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.630663 23915 catalog_manager.cc:5697] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.632910 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1985e29d943909e299c616813e9a6" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:12:59.629667 24288 raft_consensus.cc:359] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:12:59.637210 24206 leader_election.cc:343] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.636513 24288 raft_consensus.cc:385] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.638029 24288 raft_consensus.cc:740] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.638903 24090 raft_consensus.cc:2468] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:12:59.638877 24288 consensus_queue.cc:260] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.640295 24205 leader_election.cc:304] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:12:59.641175 24288 ts_tablet_manager.cc:1434] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:12:59.641557 24348 raft_consensus.cc:2804] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.642069 24348 raft_consensus.cc:697] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:12:59.642247 24288 tablet_bootstrap.cc:492] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:59.642938 24348 consensus_queue.cc:237] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.633980 24329 consensus_queue.cc:1048] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.648729 24288 tablet_bootstrap.cc:654] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.635661 24285 tablet_bootstrap.cc:654] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.668253 24288 tablet_bootstrap.cc:492] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:59.668807 24288 ts_tablet_manager.cc:1403] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.005s
I20260709 12:12:59.671680 24288 raft_consensus.cc:359] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.672442 24288 raft_consensus.cc:385] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.673010 24288 raft_consensus.cc:740] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.673769 24282 tablet_bootstrap.cc:492] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:59.673791 24329 raft_consensus.cc:493] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.673708 24288 consensus_queue.cc:260] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.671788 24382 consensus_queue.cc:1048] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:59.674505 24329 raft_consensus.cc:515] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.674499 24282 ts_tablet_manager.cc:1403] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.266s	user 0.016s	sys 0.020s
I20260709 12:12:59.676131 24288 ts_tablet_manager.cc:1434] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:59.677178 24288 tablet_bootstrap.cc:492] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:59.676813 24329 leader_election.cc:290] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:59.678521 24282 raft_consensus.cc:359] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.679286 24282 raft_consensus.cc:385] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.679563 24282 raft_consensus.cc:740] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.680254 24282 consensus_queue.cc:260] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.681622 24355 raft_consensus.cc:493] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.682018 24355 raft_consensus.cc:515] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.684012 24288 tablet_bootstrap.cc:654] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.684321 24355 leader_election.cc:290] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:59.685528 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:59.686058 24240 raft_consensus.cc:2468] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 0.
I20260709 12:12:59.686316 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:59.687057 24238 raft_consensus.cc:2468] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:12:59.687248 24132 leader_election.cc:304] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:59.687631 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:59.688210 24355 raft_consensus.cc:2804] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.688565 24355 raft_consensus.cc:493] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.688898 24355 raft_consensus.cc:3060] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.689428 24058 leader_election.cc:304] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:59.694365 24282 ts_tablet_manager.cc:1434] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:12:59.695343 24282 tablet_bootstrap.cc:492] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:59.698482 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:12:59.699481 24132 leader_election.cc:343] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:59.705127 24058 leader_election.cc:343] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.706532 24288 tablet_bootstrap.cc:492] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:59.707474 24288 ts_tablet_manager.cc:1403] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.004s
I20260709 12:12:59.708945 24284 tablet_bootstrap.cc:492] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:12:59.709524 24284 ts_tablet_manager.cc:1403] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.286s	user 0.017s	sys 0.019s
I20260709 12:12:59.710629 24288 raft_consensus.cc:359] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.711445 24288 raft_consensus.cc:385] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.711719 24288 raft_consensus.cc:740] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.712747 24284 raft_consensus.cc:359] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.713615 24284 raft_consensus.cc:385] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.716594 24418 consensus_queue.cc:1048] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.702359 24329 raft_consensus.cc:2804] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.717583 24329 raft_consensus.cc:493] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.718083 24329 raft_consensus.cc:3060] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.713958 24284 raft_consensus.cc:740] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.718940 24288 consensus_queue.cc:260] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:12:59.719470 24284 consensus_queue.cc:260] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.700511 23912 catalog_manager.cc:5697] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.742514 23911 catalog_manager.cc:5697] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.746912 24284 ts_tablet_manager.cc:1434] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:12:59.748138 24284 tablet_bootstrap.cc:492] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:12:59.753095 24090 raft_consensus.cc:3060] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.754678 24355 raft_consensus.cc:515] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
W20260709 12:12:59.755620 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 49321.9us
I20260709 12:12:59.761360 24288 ts_tablet_manager.cc:1434] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
W20260709 12:12:59.762482 24206 consensus_peers.cc:597] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.763321 24348 consensus_queue.cc:1048] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.764832 24282 tablet_bootstrap.cc:654] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.766904 24288 tablet_bootstrap.cc:492] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:59.768095 24456 raft_consensus.cc:493] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.768630 24456 raft_consensus.cc:515] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.765916 24418 raft_consensus.cc:493] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.773031 24329 raft_consensus.cc:515] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.773285 24418 raft_consensus.cc:515] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.775465 24418 leader_election.cc:290] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:59.776918 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0501208ef99042209ace59e3d1f4bb67" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:59.781039 24165 raft_consensus.cc:3060] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.797580 24288 tablet_bootstrap.cc:654] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.797806 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0501208ef99042209ace59e3d1f4bb67" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:59.798334 24409 raft_consensus.cc:493] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.798516 24092 raft_consensus.cc:2468] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:12:59.798878 24409 raft_consensus.cc:515] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:12:59.795506 24206 leader_election.cc:343] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.800355 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222f5f64725d4c94803b2d55242cc5dd" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:12:59.801566 24409 leader_election.cc:290] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:59.801613 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222f5f64725d4c94803b2d55242cc5dd" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:59.803162 24017 raft_consensus.cc:2468] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 0.
I20260709 12:12:59.803755 24205 leader_election.cc:304] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:12:59.804721 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:12:59.805311 24418 raft_consensus.cc:2804] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.805541 24092 raft_consensus.cc:2393] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c4e12b81e44dae8a76443acdf7b9c9 in current term 1: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:12:59.806039 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
W20260709 12:12:59.806484 24132 leader_election.cc:343] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.806979 24418 raft_consensus.cc:493] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.807353 24418 raft_consensus.cc:3060] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.808589 24456 leader_election.cc:290] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:59.807260 24132 leader_election.cc:304] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:59.806718 24240 raft_consensus.cc:2468] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:12:59.815267 24456 raft_consensus.cc:2804] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.833374 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:59.834071 24238 raft_consensus.cc:3060] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.836122 24329 leader_election.cc:290] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:59.831079 24456 raft_consensus.cc:493] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.838758 23983 leader_election.cc:304] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:59.849210 24288 tablet_bootstrap.cc:492] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:59.849756 24288 ts_tablet_manager.cc:1403] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.014s
I20260709 12:12:59.849056 24409 raft_consensus.cc:2804] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.854362 24409 raft_consensus.cc:493] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.854629 24238 raft_consensus.cc:2468] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:12:59.856017 24132 leader_election.cc:304] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:12:59.857137 24288 raft_consensus.cc:359] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.857774 24288 raft_consensus.cc:385] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.857995 24288 raft_consensus.cc:740] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.858795 24288 consensus_queue.cc:260] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.854737 24409 raft_consensus.cc:3060] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.860991 24288 ts_tablet_manager.cc:1434] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:12:59.862005 24288 tablet_bootstrap.cc:492] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:12:59.867029 24355 leader_election.cc:290] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:12:59.859181 24458 raft_consensus.cc:2804] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.867748 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:59.868078 24458 raft_consensus.cc:697] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 1 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
W20260709 12:12:59.869347 24132 leader_election.cc:343] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.869582 24409 raft_consensus.cc:515] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.873620 24284 tablet_bootstrap.cc:654] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.875573 24285 tablet_bootstrap.cc:492] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:12:59.846432 24456 raft_consensus.cc:3060] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.876281 24285 ts_tablet_manager.cc:1403] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.253s	user 0.008s	sys 0.034s
I20260709 12:12:59.879838 24288 tablet_bootstrap.cc:654] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.882313 24285 raft_consensus.cc:359] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.883086 24285 raft_consensus.cc:385] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.883512 24285 raft_consensus.cc:740] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.884285 24285 consensus_queue.cc:260] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.887029 24285 ts_tablet_manager.cc:1434] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:59.888214 24285 tablet_bootstrap.cc:492] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:12:59.890161 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:59.891010 24238 raft_consensus.cc:3060] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.894649 24285 tablet_bootstrap.cc:654] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.869532 24458 consensus_queue.cc:237] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.908004 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:59.910790 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:59.911773 24017 raft_consensus.cc:2393] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 in current term 1: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:12:59.912904 24348 consensus_queue.cc:1048] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.919162 24382 raft_consensus.cc:493] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.919816 24382 raft_consensus.cc:515] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.921967 24382 leader_election.cc:290] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.942237 24409 leader_election.cc:290] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:12:59.945271 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:12:59.943362 24058 leader_election.cc:304] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:12:59.931571 24418 raft_consensus.cc:515] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.954591 24092 raft_consensus.cc:2393] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79c4e12b81e44dae8a76443acdf7b9c9 in current term 1: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:12:59.958323 24382 raft_consensus.cc:2749] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.960956 24238 raft_consensus.cc:2468] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:12:59.961351 24407 consensus_queue.cc:1048] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.963745 23983 leader_election.cc:304] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:12:59.964208 24282 tablet_bootstrap.cc:492] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:12:59.964761 24282 ts_tablet_manager.cc:1403] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.270s	user 0.027s	sys 0.037s
I20260709 12:12:59.964964 23913 catalog_manager.cc:5697] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.967815 24407 raft_consensus.cc:2804] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.968829 24407 raft_consensus.cc:697] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:12:59.969825 24407 consensus_queue.cc:237] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:12:59.972757 24282 raft_consensus.cc:359] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.973510 24282 raft_consensus.cc:385] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.973762 24282 raft_consensus.cc:740] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.974593 24282 consensus_queue.cc:260] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.976970 24282 ts_tablet_manager.cc:1434] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:12:59.978027 24282 tablet_bootstrap.cc:492] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:12:59.981271 24288 tablet_bootstrap.cc:492] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:12:59.981864 24288 ts_tablet_manager.cc:1403] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.005s
W20260709 12:12:59.982290 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 45773.4us
I20260709 12:12:59.984306 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:12:59.984680 24288 raft_consensus.cc:359] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.985404 24288 raft_consensus.cc:385] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.975302 24456 raft_consensus.cc:515] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:12:59.985630 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:12:59.987152 24058 leader_election.cc:343] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:59.987938 24058 leader_election.cc:343] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.988370 24058 leader_election.cc:304] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:12:59.989152 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222f5f64725d4c94803b2d55242cc5dd" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:12:59.989840 24238 raft_consensus.cc:3060] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.985680 24288 raft_consensus.cc:740] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
W20260709 12:12:59.990315 23982 consensus_peers.cc:597] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.992257 24382 raft_consensus.cc:493] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.992120 24288 consensus_queue.cc:260] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.992901 24382 raft_consensus.cc:515] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:12:59.993824 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222f5f64725d4c94803b2d55242cc5dd" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:12:59.994493 24017 raft_consensus.cc:3060] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.990901 24282 tablet_bootstrap.cc:654] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.995173 24382 leader_election.cc:290] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:12:59.995088 24288 ts_tablet_manager.cc:1434] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:13:00.002892 24288 tablet_bootstrap.cc:492] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:00.004303 24285 tablet_bootstrap.cc:492] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:00.004791 24285 ts_tablet_manager.cc:1403] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.006s
I20260709 12:12:59.990376 24456 leader_election.cc:290] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:00.010001 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0501208ef99042209ace59e3d1f4bb67" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
W20260709 12:13:00.011780 24206 leader_election.cc:343] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.008082 24382 raft_consensus.cc:2749] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.025238 24418 leader_election.cc:290] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:00.033214 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:00.033210 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0501208ef99042209ace59e3d1f4bb67" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:00.035559 24090 raft_consensus.cc:3060] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.039076 24468 consensus_queue.cc:1048] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:00.035444 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.046839 23913 catalog_manager.cc:5697] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.056521 24409 consensus_queue.cc:1048] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:13:00.045248 24058 leader_election.cc:343] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.064117 24284 tablet_bootstrap.cc:492] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:00.064630 24284 ts_tablet_manager.cc:1403] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.317s	user 0.011s	sys 0.006s
I20260709 12:13:00.071759 24017 raft_consensus.cc:2468] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:00.073547 24238 raft_consensus.cc:2468] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:00.074692 24132 leader_election.cc:304] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:00.075927 24284 raft_consensus.cc:359] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.076709 24284 raft_consensus.cc:385] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.076975 24284 raft_consensus.cc:740] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.076295 24456 raft_consensus.cc:2804] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.079273 24456 raft_consensus.cc:697] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 1 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
W20260709 12:13:00.080014 24058 leader_election.cc:343] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.080144 24456 consensus_queue.cc:237] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.080610 24058 leader_election.cc:304] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:00.077610 24284 consensus_queue.cc:260] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.066452 24090 raft_consensus.cc:2468] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:00.090562 24205 leader_election.cc:304] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:00.093073 24372 raft_consensus.cc:2804] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.094033 24284 ts_tablet_manager.cc:1434] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:13:00.096165 24382 raft_consensus.cc:2749] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.097174 24372 raft_consensus.cc:697] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:00.098436 24284 tablet_bootstrap.cc:492] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:00.098968 24164 raft_consensus.cc:3060] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.100793 24372 consensus_queue.cc:237] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:13:00.099057 24206 consensus_peers.cc:597] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.102667 24288 tablet_bootstrap.cc:654] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:00.104595 24206 consensus_peers.cc:597] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.088760 24285 raft_consensus.cc:359] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.106832 24285 raft_consensus.cc:385] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.107128 24285 raft_consensus.cc:740] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.107829 24285 consensus_queue.cc:260] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.109480 24407 consensus_queue.cc:1048] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.114801 24285 ts_tablet_manager.cc:1434] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.110s	user 0.003s	sys 0.006s
I20260709 12:13:00.116042 24285 tablet_bootstrap.cc:492] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:00.129992 24282 tablet_bootstrap.cc:492] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:00.130645 24282 ts_tablet_manager.cc:1403] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.013s
I20260709 12:13:00.135592 24372 consensus_queue.cc:1048] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:00.123345 24284 tablet_bootstrap.cc:654] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.147369 24288 tablet_bootstrap.cc:492] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:00.147938 24288 ts_tablet_manager.cc:1403] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.145s	user 0.007s	sys 0.010s
I20260709 12:13:00.152591 24282 raft_consensus.cc:359] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
W20260709 12:13:00.153394 24472 log.cc:927] Time spent T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Append to log took a long time: real 0.108s	user 0.003s	sys 0.000s
I20260709 12:13:00.155264 24285 tablet_bootstrap.cc:654] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.153416 24282 raft_consensus.cc:385] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.163870 24282 raft_consensus.cc:740] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.160895 24288 raft_consensus.cc:359] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.164620 24288 raft_consensus.cc:385] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.164965 24288 raft_consensus.cc:740] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.164700 24282 consensus_queue.cc:260] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.166256 24288 consensus_queue.cc:260] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.167273 24282 ts_tablet_manager.cc:1434] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:13:00.168324 24282 tablet_bootstrap.cc:492] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:00.167928 23912 catalog_manager.cc:5697] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.169709 24288 ts_tablet_manager.cc:1434] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:13:00.170811 24288 tablet_bootstrap.cc:492] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:00.183221 24285 tablet_bootstrap.cc:492] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:00.186806 24288 tablet_bootstrap.cc:654] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.192453 23915 catalog_manager.cc:5697] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.193606 24285 ts_tablet_manager.cc:1403] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.000s
I20260709 12:13:00.198493 24284 tablet_bootstrap.cc:492] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:00.199051 24284 ts_tablet_manager.cc:1403] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.002s
I20260709 12:13:00.201818 24284 raft_consensus.cc:359] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.202566 24284 raft_consensus.cc:385] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.202836 24284 raft_consensus.cc:740] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.203670 24288 tablet_bootstrap.cc:492] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:00.204211 24288 ts_tablet_manager.cc:1403] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.004s
I20260709 12:13:00.206586 24282 tablet_bootstrap.cc:654] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.207072 24288 raft_consensus.cc:359] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.207821 24288 raft_consensus.cc:385] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.208083 24288 raft_consensus.cc:740] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.208822 24288 consensus_queue.cc:260] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.208981 24284 consensus_queue.cc:260] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.211387 24288 ts_tablet_manager.cc:1434] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:00.211589 24284 ts_tablet_manager.cc:1434] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:13:00.212509 24288 tablet_bootstrap.cc:492] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:00.212666 24284 tablet_bootstrap.cc:492] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:00.196733 24285 raft_consensus.cc:359] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.216981 24285 raft_consensus.cc:385] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.217308 24285 raft_consensus.cc:740] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.218152 24285 consensus_queue.cc:260] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.219190 24288 tablet_bootstrap.cc:654] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.221127 24285 ts_tablet_manager.cc:1434] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:13:00.222198 24285 tablet_bootstrap.cc:492] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:00.223485 24284 tablet_bootstrap.cc:654] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.226671 24282 tablet_bootstrap.cc:492] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:00.227182 24282 ts_tablet_manager.cc:1403] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.000s
I20260709 12:13:00.228320 24456 raft_consensus.cc:493] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.228919 24456 raft_consensus.cc:515] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.231400 24456 leader_election.cc:290] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:00.233850 24285 tablet_bootstrap.cc:654] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.234201 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:00.229885 24282 raft_consensus.cc:359] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.235634 24282 raft_consensus.cc:385] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.236008 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:00.235922 24282 raft_consensus.cc:740] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.238905 24132 leader_election.cc:304] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:00.238821 24282 consensus_queue.cc:260] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.240015 24458 raft_consensus.cc:2749] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.251495 24282 ts_tablet_manager.cc:1434] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:13:00.257103 24329 raft_consensus.cc:493] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.257741 24329 raft_consensus.cc:515] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.259982 24329 leader_election.cc:290] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:00.261597 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:00.262220 24282 tablet_bootstrap.cc:492] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368: Bootstrap starting.
W20260709 12:13:00.263249 24058 leader_election.cc:343] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.264175 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.265821 24409 raft_consensus.cc:493] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.266441 24409 raft_consensus.cc:515] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
W20260709 12:13:00.268442 24058 leader_election.cc:343] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.269038 24058 leader_election.cc:304] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:00.269850 24329 raft_consensus.cc:2749] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.270989 24284 tablet_bootstrap.cc:492] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:00.271580 24284 ts_tablet_manager.cc:1403] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.011s
I20260709 12:13:00.270989 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:00.272728 24238 raft_consensus.cc:2393] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c4e12b81e44dae8a76443acdf7b9c9 in current term 1: Already voted for candidate 64549835910a439993d28800bb571368 in this term.
I20260709 12:13:00.272997 24288 tablet_bootstrap.cc:492] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:00.268575 24409 leader_election.cc:290] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:00.274014 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.274614 24284 raft_consensus.cc:359] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.275327 24284 raft_consensus.cc:385] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.275629 24284 raft_consensus.cc:740] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.276038 23983 leader_election.cc:304] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:00.276695 24282 tablet_bootstrap.cc:654] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.277456 24409 raft_consensus.cc:3060] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.278198 24285 tablet_bootstrap.cc:492] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:00.278707 24285 ts_tablet_manager.cc:1403] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 12:13:00.274241 24288 ts_tablet_manager.cc:1403] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.062s	user 0.021s	sys 0.015s
I20260709 12:13:00.281636 24285 raft_consensus.cc:359] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.282191 24285 raft_consensus.cc:385] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.282403 24284 consensus_queue.cc:260] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.282475 24285 raft_consensus.cc:740] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.284804 24284 ts_tablet_manager.cc:1434] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:13:00.286347 24409 raft_consensus.cc:2749] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.284228 24285 consensus_queue.cc:260] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.287890 24329 raft_consensus.cc:493] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.288684 24284 tablet_bootstrap.cc:492] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:00.288417 24329 raft_consensus.cc:515] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.290680 24329 leader_election.cc:290] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:00.291462 24372 raft_consensus.cc:493] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.292361 24282 tablet_bootstrap.cc:492] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:00.292017 24372 raft_consensus.cc:515] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.292865 24282 ts_tablet_manager.cc:1403] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:13:00.293404 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.294131 24372 leader_election.cc:290] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:00.294709 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:00.294795 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74ffb149b7a4384b643ebcc07463911" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:00.295760 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74ffb149b7a4384b643ebcc07463911" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:13:00.296293 24206 leader_election.cc:343] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.296424 24092 raft_consensus.cc:2468] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
W20260709 12:13:00.296826 24058 leader_election.cc:343] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:00.297554 24058 leader_election.cc:343] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.297797 24205 leader_election.cc:304] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:00.297989 24058 leader_election.cc:304] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:00.299225 24372 raft_consensus.cc:2804] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.299449 24329 raft_consensus.cc:2749] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.299633 24372 raft_consensus.cc:493] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.300108 24372 raft_consensus.cc:3060] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.282382 24288 raft_consensus.cc:359] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.301182 24288 raft_consensus.cc:385] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.301451 24288 raft_consensus.cc:740] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.302331 24288 consensus_queue.cc:260] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.304050 24285 ts_tablet_manager.cc:1434] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:13:00.305150 24285 tablet_bootstrap.cc:492] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:00.309322 24284 tablet_bootstrap.cc:654] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.311074 24285 tablet_bootstrap.cc:654] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.313664 24282 raft_consensus.cc:359] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.315265 24288 ts_tablet_manager.cc:1434] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:13:00.314708 24372 raft_consensus.cc:515] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.316362 24288 tablet_bootstrap.cc:492] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:00.318172 24282 raft_consensus.cc:385] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.318732 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74ffb149b7a4384b643ebcc07463911" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:00.318006 24372 leader_election.cc:290] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:00.319548 24092 raft_consensus.cc:3060] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.319620 24282 raft_consensus.cc:740] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.321682 24282 consensus_queue.cc:260] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.323230 24288 tablet_bootstrap.cc:654] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.325366 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a74ffb149b7a4384b643ebcc07463911" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
W20260709 12:13:00.327230 24206 leader_election.cc:343] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.329043 24092 raft_consensus.cc:2468] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:00.329586 24456 consensus_queue.cc:1048] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.336942 24288 tablet_bootstrap.cc:492] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:00.337644 24288 ts_tablet_manager.cc:1403] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 12:13:00.339596 24282 ts_tablet_manager.cc:1434] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 12:13:00.345709 24205 leader_election.cc:304] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:00.344424 24288 raft_consensus.cc:359] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.347824 24288 raft_consensus.cc:385] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.348145 24288 raft_consensus.cc:740] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.349426 24368 raft_consensus.cc:493] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.351274 24368 raft_consensus.cc:515] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.351477 24288 consensus_queue.cc:260] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.353914 24386 raft_consensus.cc:493] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.354519 24386 raft_consensus.cc:515] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.355881 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.356829 24386 leader_election.cc:290] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:00.357944 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e842427bd574b6092b1d303499a2269" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.358541 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e842427bd574b6092b1d303499a2269" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:00.358717 24164 raft_consensus.cc:2468] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:13:00.359295 24240 raft_consensus.cc:2468] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:13:00.360971 24058 leader_election.cc:304] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:00.363993 24386 raft_consensus.cc:2804] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.361399 24368 leader_election.cc:290] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:00.373821 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:00.348409 24372 raft_consensus.cc:2804] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.368100 24386 raft_consensus.cc:493] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.376452 23983 leader_election.cc:304] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:00.377218 24372 raft_consensus.cc:697] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:00.377554 24409 raft_consensus.cc:2749] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.364328 24288 ts_tablet_manager.cc:1434] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:13:00.380681 24372 consensus_queue.cc:237] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.382647 24288 tablet_bootstrap.cc:492] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:00.376814 24386 raft_consensus.cc:3060] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.388863 24355 consensus_queue.cc:1048] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.391558 24284 tablet_bootstrap.cc:492] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:00.392110 24284 ts_tablet_manager.cc:1403] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.014s
I20260709 12:13:00.395040 24284 raft_consensus.cc:359] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.395744 24284 raft_consensus.cc:385] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.396011 24284 raft_consensus.cc:740] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.396046 24285 tablet_bootstrap.cc:492] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:00.397352 24285 ts_tablet_manager.cc:1403] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.017s
I20260709 12:13:00.397650 24282 tablet_bootstrap.cc:492] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:00.401932 24285 raft_consensus.cc:359] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.402973 24285 raft_consensus.cc:385] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.403244 24285 raft_consensus.cc:740] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.404484 24288 tablet_bootstrap.cc:654] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.408567 24386 raft_consensus.cc:515] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.411304 23915 catalog_manager.cc:5697] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.412500 24386 leader_election.cc:290] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:00.413874 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e842427bd574b6092b1d303499a2269" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:00.414603 24164 raft_consensus.cc:3060] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.409693 24282 tablet_bootstrap.cc:654] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.404927 24284 consensus_queue.cc:260] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.417356 24165 raft_consensus.cc:3060] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.417985 24284 ts_tablet_manager.cc:1434] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:13:00.403885 24285 consensus_queue.cc:260] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.419894 24285 ts_tablet_manager.cc:1434] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.002s
I20260709 12:13:00.421384 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e842427bd574b6092b1d303499a2269" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:00.423537 24284 tablet_bootstrap.cc:492] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:00.425122 24288 tablet_bootstrap.cc:492] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:00.425654 24288 ts_tablet_manager.cc:1403] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.003s
I20260709 12:13:00.428581 24288 raft_consensus.cc:359] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.429894 24284 tablet_bootstrap.cc:654] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.429250 24288 raft_consensus.cc:385] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.440356 24288 raft_consensus.cc:740] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.430277 24285 tablet_bootstrap.cc:492] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:00.445271 24288 consensus_queue.cc:260] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.440021 24240 raft_consensus.cc:3060] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.449714 24288 ts_tablet_manager.cc:1434] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 12:13:00.451359 24288 tablet_bootstrap.cc:492] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:00.456691 24240 raft_consensus.cc:2468] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:00.457572 24288 tablet_bootstrap.cc:654] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.460152 24285 tablet_bootstrap.cc:654] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.465678 24058 leader_election.cc:304] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:00.466898 24386 raft_consensus.cc:2804] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.467476 24386 raft_consensus.cc:697] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:00.468493 24386 consensus_queue.cc:237] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.459064 24164 raft_consensus.cc:2468] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:00.485080 24092 raft_consensus.cc:3060] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.486151 24368 consensus_queue.cc:1048] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:00.497609 24282 tablet_bootstrap.cc:492] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:00.500202 24282 ts_tablet_manager.cc:1403] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.004s
I20260709 12:13:00.503280 24284 tablet_bootstrap.cc:492] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:00.503960 24284 ts_tablet_manager.cc:1403] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.000s
I20260709 12:13:00.504459 24164 raft_consensus.cc:3060] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.507350 24284 raft_consensus.cc:359] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.508287 24284 raft_consensus.cc:385] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.508575 24284 raft_consensus.cc:740] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.509421 24284 consensus_queue.cc:260] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.512614 24284 ts_tablet_manager.cc:1434] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:00.515506 24282 raft_consensus.cc:359] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.516271 24282 raft_consensus.cc:385] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.516744 24282 raft_consensus.cc:740] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.516206 24284 tablet_bootstrap.cc:492] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:00.518239 24282 consensus_queue.cc:260] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.522030 24282 ts_tablet_manager.cc:1434] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:13:00.523141 24282 tablet_bootstrap.cc:492] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:00.522159 24288 tablet_bootstrap.cc:492] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:00.529968 24288 ts_tablet_manager.cc:1403] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.079s	user 0.029s	sys 0.010s
I20260709 12:13:00.536701 23913 catalog_manager.cc:5697] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.537904 24284 tablet_bootstrap.cc:654] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.540843 24460 consensus_queue.cc:1048] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:00.546481 24282 tablet_bootstrap.cc:654] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.540679 24288 raft_consensus.cc:359] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.548117 24288 raft_consensus.cc:385] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.548480 24288 raft_consensus.cc:740] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.552192 24368 raft_consensus.cc:493] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.553128 24368 raft_consensus.cc:515] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.555382 24368 leader_election.cc:290] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:00.556082 24458 consensus_queue.cc:1048] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.549355 24288 consensus_queue.cc:260] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.558872 24285 tablet_bootstrap.cc:492] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:00.559536 24285 ts_tablet_manager.cc:1403] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.025s
I20260709 12:13:00.562816 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.563092 24288 ts_tablet_manager.cc:1434] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 12:13:00.566200 24348 raft_consensus.cc:493] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.567579 24348 raft_consensus.cc:515] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
W20260709 12:13:00.568307 23983 leader_election.cc:343] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.570474 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:00.570928 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb87e12877743478bd71c5023fe4335" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.571190 24091 raft_consensus.cc:2468] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:00.572233 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb87e12877743478bd71c5023fe4335" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:00.572383 24206 leader_election.cc:343] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:00.574290 24206 leader_election.cc:343] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.574769 24206 leader_election.cc:304] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:00.570640 24348 leader_election.cc:290] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:00.579599 24288 tablet_bootstrap.cc:492] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:00.576519 23982 leader_election.cc:304] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:00.584909 24368 raft_consensus.cc:2804] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.585304 24368 raft_consensus.cc:493] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.585614 24368 raft_consensus.cc:3060] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.585994 24404 consensus_queue.cc:1048] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.576534 24468 raft_consensus.cc:2749] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.598834 24288 tablet_bootstrap.cc:654] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.605931 24355 raft_consensus.cc:493] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a09fd0dde7fc4241aecc9690b427e9e2)
I20260709 12:13:00.606565 24355 raft_consensus.cc:515] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.608140 24016 raft_consensus.cc:3060] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.614701 24372 consensus_queue.cc:1048] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.643406 24285 raft_consensus.cc:359] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.645829 24285 raft_consensus.cc:385] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.646275 24285 raft_consensus.cc:740] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.659451 24285 consensus_queue.cc:260] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.661027 24409 raft_consensus.cc:493] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.679138 24282 tablet_bootstrap.cc:492] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:00.679849 24282 ts_tablet_manager.cc:1403] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.009s
I20260709 12:13:00.681735 24368 raft_consensus.cc:515] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.691668 24368 leader_election.cc:290] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:00.693929 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:00.695323 24468 raft_consensus.cc:493] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.695865 24468 raft_consensus.cc:515] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.698040 24282 raft_consensus.cc:359] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.699105 24282 raft_consensus.cc:385] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.700035 24285 ts_tablet_manager.cc:1434] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.002s
I20260709 12:13:00.699725 24282 raft_consensus.cc:740] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.703292 24285 tablet_bootstrap.cc:492] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:00.706952 24282 consensus_queue.cc:260] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.685235 24460 raft_consensus.cc:493] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.717463 24282 ts_tablet_manager.cc:1434] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.037s	user 0.001s	sys 0.006s
I20260709 12:13:00.698066 24468 leader_election.cc:290] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:00.718688 24282 tablet_bootstrap.cc:492] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:00.720600 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0615d91a3b4e4b9b9d501f055a3116" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.721467 24284 tablet_bootstrap.cc:492] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:00.723390 24284 ts_tablet_manager.cc:1403] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.207s	user 0.044s	sys 0.028s
I20260709 12:13:00.704766 24355 leader_election.cc:290] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:00.704276 24329 raft_consensus.cc:493] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.683393 24409 raft_consensus.cc:515] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.718328 24460 raft_consensus.cc:515] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.748178 24329 raft_consensus.cc:515] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:00.761893 24460 leader_election.cc:290] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:00.762367 24329 leader_election.cc:290] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:00.761756 24409 leader_election.cc:290] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:00.807289 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0615d91a3b4e4b9b9d501f055a3116" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:00.716668 23983 leader_election.cc:343] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:00.810986 23983 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 98753.1us
I20260709 12:13:00.813612 24017 raft_consensus.cc:3060] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.820900 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:13:00.822448 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 72176us
I20260709 12:13:00.824380 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.824898 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:00.825589 24165 raft_consensus.cc:2468] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:00.825825 24091 raft_consensus.cc:3060] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.839290 24285 tablet_bootstrap.cc:654] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:00.840242 24206 leader_election.cc:343] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.827682 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e13faa2c04f46039c7c9b1d8021cbd0" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:00.845067 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:00.846257 24089 raft_consensus.cc:2468] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:00.859275 24329 raft_consensus.cc:493] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.860357 24329 raft_consensus.cc:515] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:00.865576 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:00.868078 24329 leader_election.cc:290] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:00.868834 24013 raft_consensus.cc:2468] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 0.
I20260709 12:13:00.871804 24132 leader_election.cc:304] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:00.874312 24460 raft_consensus.cc:2804] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.874828 24460 raft_consensus.cc:493] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.875252 24460 raft_consensus.cc:3060] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.887970 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3ede10da664710af54f48f42e1ab43" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:00.888578 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:00.885934 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e13faa2c04f46039c7c9b1d8021cbd0" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:13:00.891692 24058 leader_election.cc:343] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.891822 24089 raft_consensus.cc:2468] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 0.
I20260709 12:13:00.894366 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3ede10da664710af54f48f42e1ab43" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:00.873265 24284 raft_consensus.cc:359] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:00.898869 24284 raft_consensus.cc:385] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.903538 24284 raft_consensus.cc:740] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.913501 24282 tablet_bootstrap.cc:654] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.911237 24284 consensus_queue.cc:260] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
W20260709 12:13:00.927480 24058 leader_election.cc:343] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.930090 24014 raft_consensus.cc:2468] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:00.936605 24131 leader_election.cc:304] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:00.936949 23983 leader_election.cc:304] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:00.938530 24456 raft_consensus.cc:2749] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:00.942757 24091 raft_consensus.cc:2468] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
W20260709 12:13:00.949256 24058 leader_election.cc:343] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.949863 24058 leader_election.cc:304] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:00.951169 24329 raft_consensus.cc:2749] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.958940 24284 ts_tablet_manager.cc:1434] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.235s	user 0.010s	sys 0.005s
I20260709 12:13:00.960698 24518 raft_consensus.cc:2804] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.961385 24518 raft_consensus.cc:493] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.963328 24518 raft_consensus.cc:3060] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.962931 24348 consensus_queue.cc:1048] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:13:00.966343 24206 consensus_peers.cc:597] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.967111 24206 leader_election.cc:304] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:00.968840 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:00.970908 23982 leader_election.cc:304] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:00.962342 24288 tablet_bootstrap.cc:492] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:00.960851 24284 tablet_bootstrap.cc:492] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:00.978374 24288 ts_tablet_manager.cc:1403] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.399s	user 0.018s	sys 0.015s
I20260709 12:13:00.978645 24409 raft_consensus.cc:2804] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.979312 24409 raft_consensus.cc:697] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:00.980643 24409 consensus_queue.cc:237] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.982856 24460 raft_consensus.cc:515] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:00.986161 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:00.991061 24404 raft_consensus.cc:493] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.991820 24404 raft_consensus.cc:515] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:13:00.997954 23963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:00.986613 24348 raft_consensus.cc:2804] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.999157 24404 leader_election.cc:290] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:01.005105 24518 raft_consensus.cc:515] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.008551 24348 raft_consensus.cc:493] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.008977 24348 raft_consensus.cc:3060] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.009406 24012 raft_consensus.cc:2393] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:13:01.012626 24518 leader_election.cc:290] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
W20260709 12:13:01.014550 24058 leader_election.cc:343] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:01.015065 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 48072.8us
I20260709 12:13:01.018388 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:01.019255 24164 raft_consensus.cc:2393] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79c4e12b81e44dae8a76443acdf7b9c9 in current term 1: Already voted for candidate 64549835910a439993d28800bb571368 in this term.
I20260709 12:13:01.019608 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:01.020291 24089 raft_consensus.cc:3060] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.022401 24460 leader_election.cc:290] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:01.007983 24284 tablet_bootstrap.cc:654] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.982208 24288 raft_consensus.cc:359] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.023765 24288 raft_consensus.cc:385] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.024147 24288 raft_consensus.cc:740] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.024860 24288 consensus_queue.cc:260] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.025147 24520 consensus_queue.cc:1048] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.026741 24058 leader_election.cc:304] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:01.053854 24338 raft_consensus.cc:2749] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.050678 24520 raft_consensus.cc:493] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.054244 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0501208ef99042209ace59e3d1f4bb67" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:01.054745 24520 raft_consensus.cc:515] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.052515 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0501208ef99042209ace59e3d1f4bb67" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:13:01.061602 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 47122.7us
I20260709 12:13:01.071376 24282 tablet_bootstrap.cc:492] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:01.072090 24282 ts_tablet_manager.cc:1403] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.354s	user 0.014s	sys 0.004s
I20260709 12:13:01.080081 24285 tablet_bootstrap.cc:492] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:01.081310 24288 ts_tablet_manager.cc:1434] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.103s	user 0.000s	sys 0.009s
I20260709 12:13:01.076471 24089 raft_consensus.cc:2468] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:13:01.080204 24520 leader_election.cc:290] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:01.090301 24515 consensus_queue.cc:1048] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:01.081365 23982 leader_election.cc:304] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:01.105724 24285 ts_tablet_manager.cc:1403] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.405s	user 0.007s	sys 0.022s
I20260709 12:13:01.104717 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:01.108779 24282 raft_consensus.cc:359] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.113910 24282 raft_consensus.cc:385] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.114305 24282 raft_consensus.cc:740] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.117556 24090 raft_consensus.cc:2468] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:01.104669 24348 raft_consensus.cc:515] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.125205 24523 raft_consensus.cc:2749] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:01.127465 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:01.124562 23982 leader_election.cc:304] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:01.124045 24282 consensus_queue.cc:260] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.127879 24288 tablet_bootstrap.cc:492] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:01.131116 24523 raft_consensus.cc:2804] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.135032 24523 raft_consensus.cc:697] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:01.136098 24523 consensus_queue.cc:237] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.141846 24288 tablet_bootstrap.cc:654] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.151710 24205 leader_election.cc:304] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:01.154592 24516 raft_consensus.cc:2804] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.155128 24516 raft_consensus.cc:493] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.155483 24516 raft_consensus.cc:3060] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.178886 24285 raft_consensus.cc:359] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.179844 24285 raft_consensus.cc:385] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.180452 24285 raft_consensus.cc:740] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.181438 24285 consensus_queue.cc:260] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.183396 24285 ts_tablet_manager.cc:1434] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.077s	user 0.002s	sys 0.004s
I20260709 12:13:01.184640 24285 tablet_bootstrap.cc:492] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:01.191498 24285 tablet_bootstrap.cc:654] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.194232 24515 consensus_queue.cc:1048] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.195523 24460 raft_consensus.cc:493] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.196115 24460 raft_consensus.cc:515] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
W20260709 12:13:01.198374 24206 leader_election.cc:343] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.198760 24460 leader_election.cc:290] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:01.199591 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb87e12877743478bd71c5023fe4335" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:01.200470 24239 raft_consensus.cc:2468] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 0.
I20260709 12:13:01.202456 24132 leader_election.cc:304] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:01.204048 24460 raft_consensus.cc:2804] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.204464 24460 raft_consensus.cc:493] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.205073 24460 raft_consensus.cc:3060] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.204337 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb87e12877743478bd71c5023fe4335" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:01.211238 24282 ts_tablet_manager.cc:1434] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.139s	user 0.008s	sys 0.000s
W20260709 12:13:01.211465 24132 leader_election.cc:343] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.212710 24282 tablet_bootstrap.cc:492] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:01.216697 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:01.217638 24089 raft_consensus.cc:2393] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:13:01.221320 24516 raft_consensus.cc:515] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.222692 24348 leader_election.cc:290] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:01.225551 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0615d91a3b4e4b9b9d501f055a3116" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:01.225736 24165 raft_consensus.cc:3060] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.227288 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0615d91a3b4e4b9b9d501f055a3116" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:01.227947 24017 raft_consensus.cc:3060] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.228732 23914 catalog_manager.cc:5697] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.232554 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:01.233256 24091 raft_consensus.cc:3060] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.233749 24284 tablet_bootstrap.cc:492] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:01.234264 24284 ts_tablet_manager.cc:1403] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.274s	user 0.028s	sys 0.008s
I20260709 12:13:01.237473 24284 raft_consensus.cc:359] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.239681 24284 raft_consensus.cc:385] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.239919 24284 raft_consensus.cc:740] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.250069 24284 consensus_queue.cc:260] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.250639 24131 leader_election.cc:304] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:01.253105 24456 raft_consensus.cc:2749] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.256793 24091 raft_consensus.cc:2468] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:01.258970 24285 tablet_bootstrap.cc:492] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:01.259975 24460 raft_consensus.cc:515] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.263757 24284 ts_tablet_manager.cc:1434] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:13:01.262742 24285 ts_tablet_manager.cc:1403] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.005s
W20260709 12:13:01.256860 24206 leader_election.cc:343] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.266894 24282 tablet_bootstrap.cc:654] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.273597 24205 leader_election.cc:304] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:01.277719 24288 tablet_bootstrap.cc:492] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:01.272720 24516 leader_election.cc:290] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:01.278345 24288 ts_tablet_manager.cc:1403] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.152s	user 0.024s	sys 0.021s
I20260709 12:13:01.279906 24284 tablet_bootstrap.cc:492] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:01.281415 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:01.282732 24017 raft_consensus.cc:2468] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:01.286387 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb87e12877743478bd71c5023fe4335" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:01.287082 24240 raft_consensus.cc:3060] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.287595 24284 tablet_bootstrap.cc:654] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.288525 24288 raft_consensus.cc:359] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.289435 24288 raft_consensus.cc:385] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.289789 24288 raft_consensus.cc:740] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.290908 24348 raft_consensus.cc:2804] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.293273 24288 consensus_queue.cc:260] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.291488 24348 raft_consensus.cc:697] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:01.299216 24348 consensus_queue.cc:237] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.293779 24206 leader_election.cc:304] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:01.301014 24468 raft_consensus.cc:2804] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.301522 24468 raft_consensus.cc:697] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:01.302564 24468 consensus_queue.cc:237] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.303426 24288 ts_tablet_manager.cc:1434] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:13:01.304756 24288 tablet_bootstrap.cc:492] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
W20260709 12:13:01.306766 24206 leader_election.cc:343] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.295430 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb87e12877743478bd71c5023fe4335" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:01.307837 24460 leader_election.cc:290] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:01.310326 24285 raft_consensus.cc:359] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
W20260709 12:13:01.318964 24132 leader_election.cc:343] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.322472 24285 raft_consensus.cc:385] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.322816 24285 raft_consensus.cc:740] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.324949 24240 raft_consensus.cc:2468] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:01.326797 24285 consensus_queue.cc:260] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.344611 24516 raft_consensus.cc:493] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.354004 24516 raft_consensus.cc:515] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.359344 24282 tablet_bootstrap.cc:492] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:01.359946 24282 ts_tablet_manager.cc:1403] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.148s	user 0.012s	sys 0.000s
I20260709 12:13:01.359730 24132 leader_election.cc:304] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:01.362820 24460 raft_consensus.cc:2804] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.363409 24460 raft_consensus.cc:697] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 1 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:01.359401 24285 ts_tablet_manager.cc:1434] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.095s	user 0.003s	sys 0.005s
I20260709 12:13:01.364569 24460 consensus_queue.cc:237] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.367767 24282 raft_consensus.cc:359] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.370361 24282 raft_consensus.cc:385] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.370678 24282 raft_consensus.cc:740] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.376147 24282 consensus_queue.cc:260] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.379175 24285 tablet_bootstrap.cc:492] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:01.385850 24284 tablet_bootstrap.cc:492] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:01.380421 24282 ts_tablet_manager.cc:1434] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 12:13:01.387230 24284 ts_tablet_manager.cc:1403] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.048s
I20260709 12:13:01.388119 24288 tablet_bootstrap.cc:654] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.380193 24515 raft_consensus.cc:493] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.400696 24516 leader_election.cc:290] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:01.391889 24515 raft_consensus.cc:515] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.402035 24284 raft_consensus.cc:359] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.404213 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:01.404565 24284 raft_consensus.cc:385] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.404860 24284 raft_consensus.cc:740] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.404933 24091 raft_consensus.cc:2468] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:01.405632 24284 consensus_queue.cc:260] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.405992 24515 leader_election.cc:290] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:01.407507 24284 ts_tablet_manager.cc:1434] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.006s
I20260709 12:13:01.409711 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:01.411526 24284 tablet_bootstrap.cc:492] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:01.411461 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:01.415557 24058 leader_election.cc:343] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.416925 24205 leader_election.cc:304] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:01.418128 24543 raft_consensus.cc:2804] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.418582 24543 raft_consensus.cc:493] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.418923 24543 raft_consensus.cc:3060] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.428521 24543 raft_consensus.cc:515] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:13:01.435353 24058 leader_election.cc:343] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.435945 24058 leader_election.cc:304] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:01.448997 24543 leader_election.cc:290] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:01.463640 24282 tablet_bootstrap.cc:492] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:01.510568 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:01.511261 24091 raft_consensus.cc:3060] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.520911 24285 tablet_bootstrap.cc:654] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.518464 24515 raft_consensus.cc:2749] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.522480 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:01.522704 24515 raft_consensus.cc:493] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.523667 24515 raft_consensus.cc:515] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.525728 24515 leader_election.cc:290] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
W20260709 12:13:01.526278 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 90965.5us
I20260709 12:13:01.530506 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebff22f432748299ffa8b2a93663d6b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:01.535197 24017 raft_consensus.cc:3060] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.536389 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
W20260709 12:13:01.539335 24206 leader_election.cc:343] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.546869 24468 raft_consensus.cc:493] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.550675 24468 raft_consensus.cc:515] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
W20260709 12:13:01.550801 24206 leader_election.cc:343] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.553035 24468 leader_election.cc:290] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:01.554158 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3ede10da664710af54f48f42e1ab43" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:01.555286 23914 catalog_manager.cc:5697] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.554222 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3ede10da664710af54f48f42e1ab43" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:01.557204 24092 raft_consensus.cc:2468] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:01.558593 24205 leader_election.cc:304] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:01.559755 24468 raft_consensus.cc:2804] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.560173 24468 raft_consensus.cc:493] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.560508 24468 raft_consensus.cc:3060] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:01.560557 24206 leader_election.cc:343] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.561107 24284 tablet_bootstrap.cc:654] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.565106 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebff22f432748299ffa8b2a93663d6b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:01.565479 23914 catalog_manager.cc:5697] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:01.564751 24058 leader_election.cc:343] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.582334 24547 raft_consensus.cc:493] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:01.582803 23983 consensus_peers.cc:597] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.583415 24518 consensus_queue.cc:1048] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.569307 24091 raft_consensus.cc:2468] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:01.583055 24547 raft_consensus.cc:515] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.590044 24288 tablet_bootstrap.cc:492] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:01.590745 24288 ts_tablet_manager.cc:1403] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.286s	user 0.022s	sys 0.039s
I20260709 12:13:01.593202 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:01.593502 23915 catalog_manager.cc:5697] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.589097 24547 leader_election.cc:290] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
W20260709 12:13:01.595996 24058 leader_election.cc:343] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.600459 24285 tablet_bootstrap.cc:492] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:01.600903 24058 leader_election.cc:304] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:01.601259 24285 ts_tablet_manager.cc:1403] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.222s	user 0.005s	sys 0.032s
W20260709 12:13:01.602331 24058 leader_election.cc:343] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.594077 24288 raft_consensus.cc:359] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.604022 24288 raft_consensus.cc:385] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.604244 24288 raft_consensus.cc:740] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.597121 24205 leader_election.cc:304] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:01.608088 24282 tablet_bootstrap.cc:654] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.609076 24543 raft_consensus.cc:2804] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.610507 24543 raft_consensus.cc:697] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:01.610677 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:01.611363 24016 raft_consensus.cc:2468] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:13:01.597781 24468 raft_consensus.cc:515] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.603392 24547 raft_consensus.cc:2749] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.616865 24543 consensus_queue.cc:237] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.617585 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3ede10da664710af54f48f42e1ab43" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:01.618350 24089 raft_consensus.cc:3060] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.620368 24288 consensus_queue.cc:260] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.629463 24058 leader_election.cc:304] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:01.632185 24547 raft_consensus.cc:2804] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.632700 24547 raft_consensus.cc:493] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.633111 24547 raft_consensus.cc:3060] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.644701 24089 raft_consensus.cc:2468] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:01.646075 24205 leader_election.cc:304] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:01.647221 24288 ts_tablet_manager.cc:1434] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 12:13:01.648488 23914 catalog_manager.cc:5697] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.649442 24468 leader_election.cc:290] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:01.649967 24543 raft_consensus.cc:2804] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.651206 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3ede10da664710af54f48f42e1ab43" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:01.650583 24543 raft_consensus.cc:697] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
W20260709 12:13:01.652807 24206 leader_election.cc:343] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.653676 23915 catalog_manager.cc:5697] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.656105 24284 tablet_bootstrap.cc:492] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:01.656534 24284 ts_tablet_manager.cc:1403] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.245s	user 0.020s	sys 0.009s
I20260709 12:13:01.659641 24284 raft_consensus.cc:359] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.660851 24284 raft_consensus.cc:385] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.661451 24284 raft_consensus.cc:740] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.662400 24284 consensus_queue.cc:260] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.664651 24284 ts_tablet_manager.cc:1434] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:01.653707 24543 consensus_queue.cc:237] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.633816 24285 raft_consensus.cc:359] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:13:01.665730 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 57576.6us
I20260709 12:13:01.667990 24285 raft_consensus.cc:385] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.668437 24285 raft_consensus.cc:740] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.669324 24285 consensus_queue.cc:260] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.667639 24284 tablet_bootstrap.cc:492] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:01.649181 24547 raft_consensus.cc:515] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.648499 24288 tablet_bootstrap.cc:492] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
W20260709 12:13:01.687716 24206 consensus_peers.cc:597] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.690804 24547 leader_election.cc:290] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:01.697672 24282 tablet_bootstrap.cc:492] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:01.693128 24285 ts_tablet_manager.cc:1434] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 12:13:01.696039 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:01.696764 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:01.699322 24017 raft_consensus.cc:3060] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.695320 24284 tablet_bootstrap.cc:654] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.698376 24282 ts_tablet_manager.cc:1403] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.307s	user 0.013s	sys 0.021s
I20260709 12:13:01.705436 24551 consensus_queue.cc:1048] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.708396 24285 tablet_bootstrap.cc:492] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:01.711879 24547 raft_consensus.cc:493] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.712422 24547 raft_consensus.cc:515] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.708432 24288 tablet_bootstrap.cc:654] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:01.714213 24058 leader_election.cc:343] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.718330 24282 raft_consensus.cc:359] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.719141 24282 raft_consensus.cc:385] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.719431 24282 raft_consensus.cc:740] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.721472 24547 leader_election.cc:290] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:01.722134 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:01.724120 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
W20260709 12:13:01.725833 24058 leader_election.cc:343] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.728816 24017 raft_consensus.cc:2468] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:01.729728 23913 catalog_manager.cc:5697] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.730573 24058 leader_election.cc:304] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:01.731727 24547 raft_consensus.cc:2804] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.733247 24282 consensus_queue.cc:260] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.735605 24282 ts_tablet_manager.cc:1434] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:13:01.732607 24547 raft_consensus.cc:697] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:01.746765 24284 tablet_bootstrap.cc:492] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:01.747345 24284 ts_tablet_manager.cc:1403] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.010s
I20260709 12:13:01.752064 24460 raft_consensus.cc:493] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.752683 24460 raft_consensus.cc:515] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.753216 24547 consensus_queue.cc:237] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.755328 24545 consensus_queue.cc:1048] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.757578 24282 tablet_bootstrap.cc:492] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:01.759711 24460 leader_election.cc:290] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:01.761238 24284 raft_consensus.cc:359] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.761978 24284 raft_consensus.cc:385] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.762264 24284 raft_consensus.cc:740] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.762990 24284 consensus_queue.cc:260] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.763228 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0615d91a3b4e4b9b9d501f055a3116" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:01.764592 24284 ts_tablet_manager.cc:1434] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:13:01.755230 24523 consensus_queue.cc:1048] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:13:01.765666 24284 tablet_bootstrap.cc:492] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:01.768453 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc0615d91a3b4e4b9b9d501f055a3116" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:01.769377 24016 raft_consensus.cc:2393] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate a09fd0dde7fc4241aecc9690b427e9e2 in this term.
I20260709 12:13:01.773223 24284 tablet_bootstrap.cc:654] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.778563 24132 leader_election.cc:304] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:01.779821 24285 tablet_bootstrap.cc:654] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.780267 24458 raft_consensus.cc:3060] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.785769 24017 raft_consensus.cc:3060] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.791055 24284 tablet_bootstrap.cc:492] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:01.791621 24284 ts_tablet_manager.cc:1403] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.005s
I20260709 12:13:01.794384 24284 raft_consensus.cc:359] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.795094 24284 raft_consensus.cc:385] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.795363 24284 raft_consensus.cc:740] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.795984 24458 raft_consensus.cc:2749] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.804001 24282 tablet_bootstrap.cc:654] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.808089 24545 consensus_queue.cc:1048] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:13:01.815966 24458 consensus_queue.cc:1048] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.819717 24285 tablet_bootstrap.cc:492] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:01.820326 24285 ts_tablet_manager.cc:1403] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.001s
I20260709 12:13:01.825380 24282 tablet_bootstrap.cc:492] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:01.827929 24282 ts_tablet_manager.cc:1403] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.003s
I20260709 12:13:01.828233 24285 raft_consensus.cc:359] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.830857 24285 raft_consensus.cc:385] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.831203 24285 raft_consensus.cc:740] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
W20260709 12:13:01.808487 24058 leader_election.cc:343] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.834877 24282 raft_consensus.cc:359] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.837809 24282 raft_consensus.cc:385] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.838526 24282 raft_consensus.cc:740] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.833588 24285 consensus_queue.cc:260] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.839986 24282 consensus_queue.cc:260] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.833602 24058 leader_election.cc:304] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:01.846813 24515 raft_consensus.cc:2749] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.848278 24282 ts_tablet_manager.cc:1434] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:13:01.850878 24282 tablet_bootstrap.cc:492] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:01.854135 24460 consensus_queue.cc:1048] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.855618 24460 raft_consensus.cc:493] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.856112 24460 raft_consensus.cc:515] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.858476 24460 leader_election.cc:290] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:01.861363 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:01.877652 24468 consensus_queue.cc:1048] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.886854 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:01.840893 24284 consensus_queue.cc:260] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.891981 24284 ts_tablet_manager.cc:1434] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 12:13:01.893045 24284 tablet_bootstrap.cc:492] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:01.893824 24288 tablet_bootstrap.cc:492] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:01.894457 24288 ts_tablet_manager.cc:1403] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.246s	user 0.033s	sys 0.026s
I20260709 12:13:01.897977 24288 raft_consensus.cc:359] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.898792 24288 raft_consensus.cc:385] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.899096 24288 raft_consensus.cc:740] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.899820 24288 consensus_queue.cc:260] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:01.902228 24288 ts_tablet_manager.cc:1434] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:13:01.903479 24288 tablet_bootstrap.cc:492] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:01.908589 24284 tablet_bootstrap.cc:654] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.909921 24288 tablet_bootstrap.cc:654] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.914417 24131 leader_election.cc:304] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:01.844174 24285 ts_tablet_manager.cc:1434] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:13:01.915357 24460 raft_consensus.cc:2749] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.926326 24285 tablet_bootstrap.cc:492] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:01.928732 24282 tablet_bootstrap.cc:654] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.932880 24285 tablet_bootstrap.cc:654] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.960712 24285 tablet_bootstrap.cc:492] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:01.960732 24284 tablet_bootstrap.cc:492] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:01.961735 24284 ts_tablet_manager.cc:1403] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.001s
I20260709 12:13:01.961256 24285 ts_tablet_manager.cc:1403] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.006s
I20260709 12:13:01.965646 24285 raft_consensus.cc:359] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.970813 23914 catalog_manager.cc:5697] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.966390 24285 raft_consensus.cc:385] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.972236 24285 raft_consensus.cc:740] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.973145 24285 consensus_queue.cc:260] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:01.973837 24288 tablet_bootstrap.cc:492] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:01.974373 24288 ts_tablet_manager.cc:1403] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.002s
I20260709 12:13:01.974824 24165 raft_consensus.cc:3060] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.975606 24285 ts_tablet_manager.cc:1434] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:13:01.977245 24288 raft_consensus.cc:359] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.977922 24288 raft_consensus.cc:385] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.978204 24288 raft_consensus.cc:740] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.976665 24285 tablet_bootstrap.cc:492] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:01.978930 24288 consensus_queue.cc:260] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:01.981478 24288 ts_tablet_manager.cc:1434] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:01.982980 24288 tablet_bootstrap.cc:492] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:01.985538 24285 tablet_bootstrap.cc:654] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.985263 24284 raft_consensus.cc:359] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.988332 24284 raft_consensus.cc:385] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.988646 24284 raft_consensus.cc:740] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.989308 24288 tablet_bootstrap.cc:654] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.989791 24284 consensus_queue.cc:260] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:01.993335 24284 ts_tablet_manager.cc:1434] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:13:01.994640 24284 tablet_bootstrap.cc:492] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:02.004619 24468 raft_consensus.cc:493] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.005175 24543 raft_consensus.cc:493] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.005338 24468 raft_consensus.cc:515] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.006021 24543 raft_consensus.cc:515] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.008649 24543 leader_election.cc:290] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:02.008955 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:02.009806 24089 raft_consensus.cc:2468] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:02.010677 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebff22f432748299ffa8b2a93663d6b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:02.011488 24012 raft_consensus.cc:2468] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:02.011864 24468 leader_election.cc:290] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:02.013265 24206 leader_election.cc:304] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:02.013574 24205 leader_election.cc:304] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:02.015138 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:02.015409 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebff22f432748299ffa8b2a93663d6b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:02.016209 24089 raft_consensus.cc:2468] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
W20260709 12:13:02.019467 24206 leader_election.cc:343] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.020212 24543 raft_consensus.cc:2804] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.020731 24543 raft_consensus.cc:493] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.022323 24468 raft_consensus.cc:2804] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.023211 24468 raft_consensus.cc:493] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.023674 24468 raft_consensus.cc:3060] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.024487 24543 raft_consensus.cc:3060] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.028851 24285 tablet_bootstrap.cc:492] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:02.029933 24285 ts_tablet_manager.cc:1403] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.053s	user 0.004s	sys 0.011s
I20260709 12:13:02.033425 24285 raft_consensus.cc:359] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.038932 24285 raft_consensus.cc:385] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.039654 24285 raft_consensus.cc:740] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.040915 24284 tablet_bootstrap.cc:654] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.042966 24012 raft_consensus.cc:3060] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.041326 24285 consensus_queue.cc:260] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.056052 24285 ts_tablet_manager.cc:1434] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:13:02.057876 24288 tablet_bootstrap.cc:492] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:02.058715 24288 ts_tablet_manager.cc:1403] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.038s
I20260709 12:13:02.059671 24285 tablet_bootstrap.cc:492] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:02.060794 24282 tablet_bootstrap.cc:492] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:02.062127 24282 ts_tablet_manager.cc:1403] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.213s	user 0.012s	sys 0.002s
I20260709 12:13:02.063271 24468 raft_consensus.cc:515] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.065481 24468 leader_election.cc:290] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:02.066919 24543 raft_consensus.cc:515] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.067230 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:02.069268 24543 leader_election.cc:290] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
W20260709 12:13:02.069681 24206 leader_election.cc:343] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.061691 24288 raft_consensus.cc:359] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.070640 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:02.071318 24089 raft_consensus.cc:3060] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.070640 24288 raft_consensus.cc:385] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.072418 24288 raft_consensus.cc:740] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.074664 24285 tablet_bootstrap.cc:654] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.076233 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebff22f432748299ffa8b2a93663d6b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:02.109045 24091 raft_consensus.cc:3060] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.077088 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebff22f432748299ffa8b2a93663d6b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:02.075450 24288 consensus_queue.cc:260] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.110893 24547 raft_consensus.cc:493] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.111542 24547 raft_consensus.cc:515] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
W20260709 12:13:02.112388 23963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:02.069942 24543 consensus_queue.cc:1048] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:13:02.113612 24547 leader_election.cc:290] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:02.110991 24012 raft_consensus.cc:3060] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.115646 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:02.084860 24206 consensus_peers.cc:597] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.086335 24282 raft_consensus.cc:359] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.116886 24282 raft_consensus.cc:385] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.117172 24282 raft_consensus.cc:740] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
W20260709 12:13:02.117331 24058 leader_election.cc:343] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.112469 24288 ts_tablet_manager.cc:1434] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:13:02.118512 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:02.118729 24288 tablet_bootstrap.cc:492] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
W20260709 12:13:02.122637 24058 leader_election.cc:343] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.123078 24058 leader_election.cc:304] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:02.123488 24282 consensus_queue.cc:260] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.125151 24282 ts_tablet_manager.cc:1434] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:13:02.125370 24547 raft_consensus.cc:2749] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.125339 24288 tablet_bootstrap.cc:654] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.127521 24516 consensus_queue.cc:1048] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.128455 24547 raft_consensus.cc:493] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.128979 24547 raft_consensus.cc:515] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.131439 24547 leader_election.cc:290] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:02.133019 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c227f268a94d11b528c1a35d162d3c" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:02.127682 24282 tablet_bootstrap.cc:492] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:02.133659 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c227f268a94d11b528c1a35d162d3c" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:02.137226 24058 leader_election.cc:343] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.104919 24284 tablet_bootstrap.cc:492] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
W20260709 12:13:02.137933 24058 leader_election.cc:343] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.138595 24284 ts_tablet_manager.cc:1403] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.001s
I20260709 12:13:02.138890 24058 leader_election.cc:304] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:02.143438 24547 raft_consensus.cc:2749] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.144912 24460 raft_consensus.cc:493] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.146272 24460 raft_consensus.cc:515] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.148474 24460 leader_election.cc:290] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:02.150460 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697dc1c079f448c0af165ab489b3160c" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:02.151237 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697dc1c079f448c0af165ab489b3160c" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:02.151932 24239 raft_consensus.cc:2468] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 0.
I20260709 12:13:02.152719 24091 raft_consensus.cc:2468] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:02.123334 24012 raft_consensus.cc:2468] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
W20260709 12:13:02.155108 24132 leader_election.cc:343] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.155614 24205 leader_election.cc:304] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:02.156548 24516 raft_consensus.cc:2804] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.156862 24282 tablet_bootstrap.cc:654] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.157279 24516 raft_consensus.cc:697] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:02.158226 24516 consensus_queue.cc:237] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.155932 24132 leader_election.cc:304] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:02.163765 24460 raft_consensus.cc:2804] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.164256 24460 raft_consensus.cc:493] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.164608 24460 raft_consensus.cc:3060] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.167964 24515 consensus_queue.cc:1048] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.168418 24284 raft_consensus.cc:359] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.170918 24456 raft_consensus.cc:493] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.175819 24284 raft_consensus.cc:385] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.176203 24284 raft_consensus.cc:740] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.177518 24284 consensus_queue.cc:260] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.161235 24089 raft_consensus.cc:2468] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:02.185631 24284 ts_tablet_manager.cc:1434] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 12:13:02.186831 24205 leader_election.cc:304] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:02.188196 24545 raft_consensus.cc:2804] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.188704 24545 raft_consensus.cc:697] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:02.182075 24456 raft_consensus.cc:515] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.189543 24545 consensus_queue.cc:237] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.191642 24456 leader_election.cc:290] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:02.193639 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:02.196849 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:02.197589 24284 tablet_bootstrap.cc:492] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:02.198977 24131 leader_election.cc:304] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:02.202832 24456 raft_consensus.cc:2749] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.206764 24285 tablet_bootstrap.cc:492] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:02.207351 24165 raft_consensus.cc:3060] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.207338 24285 ts_tablet_manager.cc:1403] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.001s
I20260709 12:13:02.197944 24460 raft_consensus.cc:515] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.218551 24523 raft_consensus.cc:493] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.219532 24282 tablet_bootstrap.cc:492] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:02.219174 24523 raft_consensus.cc:515] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.219257 23912 catalog_manager.cc:5697] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.225669 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:02.226449 24092 raft_consensus.cc:2468] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:02.229142 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:02.229987 23982 leader_election.cc:304] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:02.232272 24551 raft_consensus.cc:2804] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.232707 24551 raft_consensus.cc:493] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.233032 24551 raft_consensus.cc:3060] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:02.234874 23983 leader_election.cc:343] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.221771 24523 leader_election.cc:290] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:02.240460 24282 ts_tablet_manager.cc:1403] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.013s
I20260709 12:13:02.245527 24288 tablet_bootstrap.cc:492] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:02.246011 24288 ts_tablet_manager.cc:1403] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.008s
I20260709 12:13:02.240178 24285 raft_consensus.cc:359] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.247308 24285 raft_consensus.cc:385] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.247560 24285 raft_consensus.cc:740] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.257019 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697dc1c079f448c0af165ab489b3160c" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:02.257782 24240 raft_consensus.cc:3060] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.262642 24460 leader_election.cc:290] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:02.263938 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697dc1c079f448c0af165ab489b3160c" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
W20260709 12:13:02.265484 24132 leader_election.cc:343] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.267800 24288 raft_consensus.cc:359] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.268451 24288 raft_consensus.cc:385] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.268729 24288 raft_consensus.cc:740] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.269191 24240 raft_consensus.cc:2468] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:02.269387 24288 consensus_queue.cc:260] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.270278 24516 raft_consensus.cc:493] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.270782 24516 raft_consensus.cc:515] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.273346 24285 consensus_queue.cc:260] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.274798 24282 raft_consensus.cc:359] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.277688 24282 raft_consensus.cc:385] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.278004 24282 raft_consensus.cc:740] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.280871 24282 consensus_queue.cc:260] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.276082 24285 ts_tablet_manager.cc:1434] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
I20260709 12:13:02.281409 24132 leader_election.cc:304] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:02.281644 24338 consensus_queue.cc:1048] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.282580 24285 tablet_bootstrap.cc:492] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:02.284797 24460 raft_consensus.cc:2804] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.285399 24460 raft_consensus.cc:697] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 1 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:02.276713 24284 tablet_bootstrap.cc:654] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.286273 24460 consensus_queue.cc:237] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.290745 24288 ts_tablet_manager.cc:1434] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:13:02.291960 24288 tablet_bootstrap.cc:492] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:02.293514 24285 tablet_bootstrap.cc:654] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.278999 24516 leader_election.cc:290] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:02.275957 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9c43c99da4449caafff73d83486d50" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:02.300328 24543 consensus_queue.cc:1048] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:02.297845 24206 leader_election.cc:343] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.280234 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9c43c99da4449caafff73d83486d50" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:02.308751 24015 raft_consensus.cc:2468] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:02.278056 24551 raft_consensus.cc:515] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.315551 24551 leader_election.cc:290] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:02.316366 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:02.317130 24089 raft_consensus.cc:3060] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.321066 24288 tablet_bootstrap.cc:654] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.322846 24282 ts_tablet_manager.cc:1434] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 12:13:02.322866 23912 catalog_manager.cc:5697] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:02.323734 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:02.324839 24282 tablet_bootstrap.cc:492] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:02.331377 24206 leader_election.cc:304] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
W20260709 12:13:02.332504 23983 leader_election.cc:343] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.333268 24516 raft_consensus.cc:2804] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.333750 24516 raft_consensus.cc:493] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.334122 24516 raft_consensus.cc:3060] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.334914 24288 tablet_bootstrap.cc:492] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:02.335623 24288 ts_tablet_manager.cc:1403] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.005s
I20260709 12:13:02.339821 24288 raft_consensus.cc:359] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.340768 24288 raft_consensus.cc:385] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.341126 24288 raft_consensus.cc:740] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.346895 24282 tablet_bootstrap.cc:654] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.349447 24285 tablet_bootstrap.cc:492] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:02.349764 24284 tablet_bootstrap.cc:492] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:02.351323 24284 ts_tablet_manager.cc:1403] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.154s	user 0.016s	sys 0.009s
I20260709 12:13:02.350054 24288 consensus_queue.cc:260] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.353629 24288 ts_tablet_manager.cc:1434] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 12:13:02.354212 24284 raft_consensus.cc:359] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.355077 24284 raft_consensus.cc:385] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.355319 24288 tablet_bootstrap.cc:492] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:02.355937 24285 ts_tablet_manager.cc:1403] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.006s
I20260709 12:13:02.359105 24285 raft_consensus.cc:359] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.355427 24284 raft_consensus.cc:740] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.360704 24284 consensus_queue.cc:260] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.363341 24284 ts_tablet_manager.cc:1434] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:13:02.364563 24284 tablet_bootstrap.cc:492] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:02.375816 24285 raft_consensus.cc:385] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.376320 24285 raft_consensus.cc:740] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.377099 24285 consensus_queue.cc:260] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.382481 24285 ts_tablet_manager.cc:1434] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:13:02.380558 24284 tablet_bootstrap.cc:654] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.385953 24288 tablet_bootstrap.cc:654] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.387157 24285 tablet_bootstrap.cc:492] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:02.394407 24089 raft_consensus.cc:2468] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:13:02.395383 24288 tablet_bootstrap.cc:492] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:02.395944 24288 ts_tablet_manager.cc:1403] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 12:13:02.396415 23982 leader_election.cc:304] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:02.397661 24551 raft_consensus.cc:2804] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.398183 24551 raft_consensus.cc:697] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:02.398696 24288 raft_consensus.cc:359] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.399406 24288 raft_consensus.cc:385] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.399022 24551 consensus_queue.cc:237] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.399698 24288 raft_consensus.cc:740] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.400444 24288 consensus_queue.cc:260] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.404716 24288 ts_tablet_manager.cc:1434] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:02.405819 24288 tablet_bootstrap.cc:492] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:02.406136 24515 raft_consensus.cc:493] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.406682 24515 raft_consensus.cc:515] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.409431 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7976327d03e6414599da68409facb2f6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:13:02.410898 24058 leader_election.cc:343] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.411785 24288 tablet_bootstrap.cc:654] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.412904 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7976327d03e6414599da68409facb2f6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
W20260709 12:13:02.414559 24058 leader_election.cc:343] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.414974 24058 leader_election.cc:304] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:02.415735 24338 raft_consensus.cc:2749] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.417115 24515 leader_election.cc:290] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:02.415915 23913 catalog_manager.cc:5697] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.417075 24285 tablet_bootstrap.cc:654] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.426883 24288 tablet_bootstrap.cc:492] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:02.427527 24288 ts_tablet_manager.cc:1403] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.005s
I20260709 12:13:02.430634 24288 raft_consensus.cc:359] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.431481 24288 raft_consensus.cc:385] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.431815 24288 raft_consensus.cc:740] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.432705 24288 consensus_queue.cc:260] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.433297 24516 raft_consensus.cc:515] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.435546 24288 ts_tablet_manager.cc:1434] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:02.436954 24288 tablet_bootstrap.cc:492] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:02.437305 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9c43c99da4449caafff73d83486d50" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:02.439985 24338 raft_consensus.cc:493] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.440606 24338 raft_consensus.cc:515] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.443177 24338 leader_election.cc:290] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:02.444126 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:02.444739 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:02.445714 24058 leader_election.cc:343] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:02.446691 24058 leader_election.cc:343] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.447093 24058 leader_election.cc:304] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:02.448837 24338 raft_consensus.cc:2749] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:02.450407 24206 leader_election.cc:343] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.468815 24516 leader_election.cc:290] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:02.471004 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9c43c99da4449caafff73d83486d50" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:02.471859 24015 raft_consensus.cc:3060] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.473260 24288 tablet_bootstrap.cc:654] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.470603 23914 catalog_manager.cc:5697] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.498289 24288 tablet_bootstrap.cc:492] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:02.498824 24288 ts_tablet_manager.cc:1403] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.010s
I20260709 12:13:02.499737 24518 raft_consensus.cc:493] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.500294 24518 raft_consensus.cc:515] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.501878 24288 raft_consensus.cc:359] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.502751 24288 raft_consensus.cc:385] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.503021 24288 raft_consensus.cc:740] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.503793 24288 consensus_queue.cc:260] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.504235 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697dc1c079f448c0af165ab489b3160c" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:02.504559 24015 raft_consensus.cc:2468] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:02.506356 24288 ts_tablet_manager.cc:1434] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:13:02.506719 24518 leader_election.cc:290] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:02.506863 24206 leader_election.cc:304] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:02.508095 24288 tablet_bootstrap.cc:492] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:02.508360 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "697dc1c079f448c0af165ab489b3160c" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:02.508570 24516 raft_consensus.cc:2804] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.509243 24240 raft_consensus.cc:2393] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c4e12b81e44dae8a76443acdf7b9c9 in current term 1: Already voted for candidate 64549835910a439993d28800bb571368 in this term.
I20260709 12:13:02.510741 23983 leader_election.cc:304] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:02.512251 24409 raft_consensus.cc:3060] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.515280 24288 tablet_bootstrap.cc:654] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.520761 24282 tablet_bootstrap.cc:492] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:02.521353 24282 ts_tablet_manager.cc:1403] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.197s	user 0.026s	sys 0.077s
I20260709 12:13:02.521966 24285 tablet_bootstrap.cc:492] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:02.522586 24285 ts_tablet_manager.cc:1403] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.002s
I20260709 12:13:02.524051 24282 raft_consensus.cc:359] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.524494 24409 raft_consensus.cc:2749] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.524811 24282 raft_consensus.cc:385] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.525142 24282 raft_consensus.cc:740] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.525738 24285 raft_consensus.cc:359] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.525806 24282 consensus_queue.cc:260] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.526572 24285 raft_consensus.cc:385] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.528417 24282 ts_tablet_manager.cc:1434] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:13:02.528417 24516 raft_consensus.cc:697] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:02.529378 24516 consensus_queue.cc:237] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.530120 24282 tablet_bootstrap.cc:492] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:02.520829 24288 tablet_bootstrap.cc:492] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:02.534174 24288 ts_tablet_manager.cc:1403] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
I20260709 12:13:02.537124 24284 tablet_bootstrap.cc:492] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:02.537279 24282 tablet_bootstrap.cc:654] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.537773 24284 ts_tablet_manager.cc:1403] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.001s
I20260709 12:13:02.540803 24284 raft_consensus.cc:359] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.541594 24284 raft_consensus.cc:385] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.526926 24285 raft_consensus.cc:740] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.542008 24284 raft_consensus.cc:740] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.542697 24285 consensus_queue.cc:260] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.542918 24284 consensus_queue.cc:260] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.545058 24285 ts_tablet_manager.cc:1434] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.002s
I20260709 12:13:02.545189 24284 ts_tablet_manager.cc:1434] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:02.546265 24285 tablet_bootstrap.cc:492] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:02.550274 24284 tablet_bootstrap.cc:492] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:02.553326 24285 tablet_bootstrap.cc:654] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.552847 24288 raft_consensus.cc:359] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.554364 24288 raft_consensus.cc:385] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.554768 24288 raft_consensus.cc:740] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.550063 24338 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.556504 24338 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.558979 24338 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:02.555516 24288 consensus_queue.cc:260] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.566174 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:02.568706 24058 leader_election.cc:343] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.571297 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
W20260709 12:13:02.578851 24058 leader_election.cc:343] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.579404 24058 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:02.581411 24547 raft_consensus.cc:493] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.581607 24515 raft_consensus.cc:2749] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.582005 24547 raft_consensus.cc:515] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.584424 24547 leader_election.cc:290] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:02.587179 24516 consensus_queue.cc:1048] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.588318 23915 catalog_manager.cc:5697] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.591037 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:02.592445 24058 leader_election.cc:343] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.593518 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
W20260709 12:13:02.595085 24058 leader_election.cc:343] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.595511 24058 leader_election.cc:304] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:02.595865 24516 raft_consensus.cc:493] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.596441 24516 raft_consensus.cc:515] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.598670 24515 raft_consensus.cc:2749] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.598824 24285 tablet_bootstrap.cc:492] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:02.599179 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7976327d03e6414599da68409facb2f6" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:02.599536 24285 ts_tablet_manager.cc:1403] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.022s
I20260709 12:13:02.599918 24089 raft_consensus.cc:2468] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:02.601287 24205 leader_election.cc:304] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:02.603897 24288 ts_tablet_manager.cc:1434] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.002s
I20260709 12:13:02.603611 24545 raft_consensus.cc:2804] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.605288 24545 raft_consensus.cc:493] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.605726 24545 raft_consensus.cc:3060] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.606792 24285 raft_consensus.cc:359] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.607532 24285 raft_consensus.cc:385] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.607779 24285 raft_consensus.cc:740] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.608242 24282 tablet_bootstrap.cc:492] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:02.608414 24285 consensus_queue.cc:260] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.610833 24282 ts_tablet_manager.cc:1403] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.017s
I20260709 12:13:02.613673 24282 raft_consensus.cc:359] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.615139 24282 raft_consensus.cc:385] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.614056 24288 tablet_bootstrap.cc:492] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:02.614689 24516 leader_election.cc:290] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:02.615357 24545 raft_consensus.cc:515] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.615510 24282 raft_consensus.cc:740] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.616305 24285 ts_tablet_manager.cc:1434] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:13:02.618219 24282 consensus_queue.cc:260] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.618695 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7976327d03e6414599da68409facb2f6" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:02.626114 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7976327d03e6414599da68409facb2f6" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:02.626538 24282 ts_tablet_manager.cc:1434] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:13:02.626734 24089 raft_consensus.cc:3060] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.628445 24164 raft_consensus.cc:3060] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.629151 24285 tablet_bootstrap.cc:492] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
W20260709 12:13:02.634598 24206 leader_election.cc:343] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.635141 24282 tablet_bootstrap.cc:492] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:02.635462 24545 leader_election.cc:290] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:02.637917 24288 tablet_bootstrap.cc:654] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.638870 24089 raft_consensus.cc:2468] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:02.640092 24205 leader_election.cc:304] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:02.641212 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7976327d03e6414599da68409facb2f6" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:02.641731 24285 tablet_bootstrap.cc:654] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.642683 24545 raft_consensus.cc:2804] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.643918 24284 tablet_bootstrap.cc:654] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.652429 24282 tablet_bootstrap.cc:654] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.643524 24545 raft_consensus.cc:697] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:02.653921 24545 consensus_queue.cc:237] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
W20260709 12:13:02.663194 24206 leader_election.cc:343] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.665092 24348 consensus_queue.cc:1048] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:13:02.664264 24164 raft_consensus.cc:3060] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.674220 24458 raft_consensus.cc:493] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.675431 24458 raft_consensus.cc:515] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.684918 24468 consensus_queue.cc:1048] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.685542 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:02.690064 24458 leader_election.cc:290] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:02.691473 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:02.694114 24132 leader_election.cc:304] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:02.699801 24543 raft_consensus.cc:493] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.704156 24543 raft_consensus.cc:515] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.709162 24543 leader_election.cc:290] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:02.711851 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c227f268a94d11b528c1a35d162d3c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:02.712610 24015 raft_consensus.cc:2468] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:02.713096 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c227f268a94d11b528c1a35d162d3c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:02.713837 24090 raft_consensus.cc:2468] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:02.720024 23915 catalog_manager.cc:5697] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:02.719281 24458 raft_consensus.cc:2749] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.723762 24205 leader_election.cc:304] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:02.724643 24543 raft_consensus.cc:2804] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.725092 24543 raft_consensus.cc:493] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.725426 24543 raft_consensus.cc:3060] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.725697 24468 consensus_queue.cc:1048] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.732755 24285 tablet_bootstrap.cc:492] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:02.733407 24285 ts_tablet_manager.cc:1403] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.002s
I20260709 12:13:02.753434 24458 consensus_queue.cc:1048] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.761811 24288 tablet_bootstrap.cc:492] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:02.765672 24284 tablet_bootstrap.cc:492] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:02.766271 24284 ts_tablet_manager.cc:1403] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.007s
I20260709 12:13:02.769021 24284 raft_consensus.cc:359] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.769676 24284 raft_consensus.cc:385] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.769944 24284 raft_consensus.cc:740] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.762498 24288 ts_tablet_manager.cc:1403] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.149s	user 0.019s	sys 0.012s
I20260709 12:13:02.775542 24284 consensus_queue.cc:260] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.777372 24284 ts_tablet_manager.cc:1434] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:13:02.778693 24282 tablet_bootstrap.cc:492] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:02.779342 24282 ts_tablet_manager.cc:1403] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.144s	user 0.021s	sys 0.002s
I20260709 12:13:02.783090 24516 raft_consensus.cc:493] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.781966 24285 raft_consensus.cc:359] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.783900 24285 raft_consensus.cc:385] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.783628 24516 raft_consensus.cc:515] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.784197 24285 raft_consensus.cc:740] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.786209 24516 leader_election.cc:290] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:02.786332 24285 consensus_queue.cc:260] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.787993 24282 raft_consensus.cc:359] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.788142 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:02.790558 24091 raft_consensus.cc:2468] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:02.790715 24285 ts_tablet_manager.cc:1434] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.009s
I20260709 12:13:02.789630 24288 raft_consensus.cc:359] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.791265 24288 raft_consensus.cc:385] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.791559 24288 raft_consensus.cc:740] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.791918 24285 tablet_bootstrap.cc:492] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:02.791982 24205 leader_election.cc:304] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:02.788748 24282 raft_consensus.cc:385] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.793290 24282 raft_consensus.cc:740] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.793502 24288 consensus_queue.cc:260] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.794129 24516 raft_consensus.cc:2804] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.794628 24516 raft_consensus.cc:493] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.794971 24516 raft_consensus.cc:3060] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.795591 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:02.799430 24288 ts_tablet_manager.cc:1434] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:13:02.800562 24288 tablet_bootstrap.cc:492] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
W20260709 12:13:02.799353 24206 leader_election.cc:343] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.804451 24284 tablet_bootstrap.cc:492] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:02.804971 24282 consensus_queue.cc:260] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.820135 24284 tablet_bootstrap.cc:654] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.821765 24547 raft_consensus.cc:493] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.822351 24547 raft_consensus.cc:515] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:02.824522 24547 leader_election.cc:290] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:02.827854 24543 raft_consensus.cc:515] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.828897 24282 ts_tablet_manager.cc:1434] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.002s
I20260709 12:13:02.829720 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:02.829986 24282 tablet_bootstrap.cc:492] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368: Bootstrap starting.
W20260709 12:13:02.832991 24058 leader_election.cc:343] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.833451 24516 raft_consensus.cc:515] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.846648 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c227f268a94d11b528c1a35d162d3c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:02.847470 24016 raft_consensus.cc:3060] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.834964 24543 leader_election.cc:290] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:02.868160 24516 leader_election.cc:290] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:02.872650 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:02.876368 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c227f268a94d11b528c1a35d162d3c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:02.877058 24089 raft_consensus.cc:3060] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.877230 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:02.877848 24091 raft_consensus.cc:3060] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.883286 24545 raft_consensus.cc:493] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.888851 24545 raft_consensus.cc:515] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:02.891207 24545 leader_election.cc:290] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:02.892166 24458 consensus_queue.cc:1048] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.896922 24089 raft_consensus.cc:2468] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:02.898003 24338 raft_consensus.cc:493] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.898988 24205 leader_election.cc:304] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:02.898904 24338 raft_consensus.cc:515] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.900315 24468 raft_consensus.cc:2804] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.906014 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:02.904788 24468 raft_consensus.cc:697] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
W20260709 12:13:02.931766 24058 leader_election.cc:343] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.921732 24338 leader_election.cc:290] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:02.932365 24058 leader_election.cc:304] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:02.939462 24016 raft_consensus.cc:2468] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:02.940680 24288 tablet_bootstrap.cc:654] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:02.941222 24614 log.cc:927] Time spent T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:13:02.942066 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:02.944898 24282 tablet_bootstrap.cc:654] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.945276 24468 consensus_queue.cc:237] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:02.952880 24545 raft_consensus.cc:493] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.953424 24545 raft_consensus.cc:515] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:02.955703 24545 leader_election.cc:290] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
W20260709 12:13:02.959290 24206 leader_election.cc:343] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.960521 24091 raft_consensus.cc:2468] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
W20260709 12:13:02.961035 24206 leader_election.cc:343] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.961578 24338 raft_consensus.cc:2749] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.962572 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:02.979569 24240 raft_consensus.cc:2468] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:13:02.966048 24285 tablet_bootstrap.cc:654] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.999641 23914 catalog_manager.cc:5697] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.971349 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:03.026762 24089 raft_consensus.cc:2468] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:03.018365 24205 leader_election.cc:304] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:03.029855 24468 raft_consensus.cc:2804] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.032698 24468 raft_consensus.cc:697] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:03.033641 24468 consensus_queue.cc:237] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.031059 24205 leader_election.cc:304] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:03.035845 24348 raft_consensus.cc:2804] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.036262 24348 raft_consensus.cc:493] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.036604 24348 raft_consensus.cc:3060] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.022732 24058 leader_election.cc:304] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:03.045089 24617 raft_consensus.cc:2804] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.047060 24547 raft_consensus.cc:493] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.052805 24617 raft_consensus.cc:493] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:03.058193 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 87232.2us
I20260709 12:13:03.062853 24284 tablet_bootstrap.cc:492] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:03.063447 24284 ts_tablet_manager.cc:1403] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.259s	user 0.006s	sys 0.016s
I20260709 12:13:03.066272 24284 raft_consensus.cc:359] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.066977 24284 raft_consensus.cc:385] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.067234 24284 raft_consensus.cc:740] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.067911 24284 consensus_queue.cc:260] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.069475 24284 ts_tablet_manager.cc:1434] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:13:03.070547 24284 tablet_bootstrap.cc:492] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:03.055377 24547 raft_consensus.cc:515] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.073256 24547 leader_election.cc:290] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:03.060591 24617 raft_consensus.cc:3060] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.078619 24288 tablet_bootstrap.cc:492] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:03.079145 24288 ts_tablet_manager.cc:1403] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.279s	user 0.030s	sys 0.014s
I20260709 12:13:03.082047 24288 raft_consensus.cc:359] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.085170 24288 raft_consensus.cc:385] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.085408 24288 raft_consensus.cc:740] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.084435 24616 raft_consensus.cc:493] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.086643 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb82c3e798f4870b3983a6831c6d557" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:03.087321 24616 raft_consensus.cc:515] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
W20260709 12:13:03.088661 23983 consensus_peers.cc:597] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:03.090183 24616 leader_election.cc:290] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
W20260709 12:13:03.091454 24058 leader_election.cc:343] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.093966 24288 consensus_queue.cc:260] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.096854 24282 tablet_bootstrap.cc:492] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:03.097311 24282 ts_tablet_manager.cc:1403] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.268s	user 0.032s	sys 0.018s
I20260709 12:13:03.100807 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9c43c99da4449caafff73d83486d50" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:03.101915 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9c43c99da4449caafff73d83486d50" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:03.102705 24017 raft_consensus.cc:2393] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate a09fd0dde7fc4241aecc9690b427e9e2 in this term.
I20260709 12:13:03.116245 24132 leader_election.cc:304] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:03.118819 24616 raft_consensus.cc:3060] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.120036 24348 raft_consensus.cc:515] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:03.122359 24348 leader_election.cc:290] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:03.123106 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:03.123317 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:03.125556 24284 tablet_bootstrap.cc:654] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.126906 24468 consensus_queue.cc:1048] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.127297 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb82c3e798f4870b3983a6831c6d557" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:03.128782 24288 ts_tablet_manager.cc:1434] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.003s
I20260709 12:13:03.126358 24282 raft_consensus.cc:359] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.130698 24282 raft_consensus.cc:385] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.131011 24282 raft_consensus.cc:740] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.145625 24282 consensus_queue.cc:260] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.147908 24282 ts_tablet_manager.cc:1434] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:13:03.131975 24166 raft_consensus.cc:3060] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:03.156742 24058 leader_election.cc:343] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.165607 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:03.133138 23915 catalog_manager.cc:5697] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:03.167680 24058 leader_election.cc:343] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.135468 24288 tablet_bootstrap.cc:492] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:03.143137 24629 consensus_queue.cc:1048] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:03.144344 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:03.134374 24617 raft_consensus.cc:515] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:03.169811 24058 leader_election.cc:304] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:03.172279 24547 raft_consensus.cc:2749] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.174539 24284 tablet_bootstrap.cc:492] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:03.174654 24090 raft_consensus.cc:2393] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 in current term 1: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:13:03.161327 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:03.177295 24288 tablet_bootstrap.cc:654] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.175339 24284 ts_tablet_manager.cc:1403] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.004s
W20260709 12:13:03.180176 24206 leader_election.cc:343] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.143304 24616 raft_consensus.cc:2749] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.185530 24285 tablet_bootstrap.cc:492] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:03.181938 24617 leader_election.cc:290] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:03.186962 24285 ts_tablet_manager.cc:1403] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.395s	user 0.011s	sys 0.024s
I20260709 12:13:03.186817 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
W20260709 12:13:03.187196 24206 leader_election.cc:343] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.186765 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:03.188344 24206 leader_election.cc:304] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:03.188799 24239 raft_consensus.cc:2393] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 in current term 1: Already voted for candidate a09fd0dde7fc4241aecc9690b427e9e2 in this term.
I20260709 12:13:03.189216 24545 raft_consensus.cc:2749] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.248329 24284 raft_consensus.cc:359] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.249105 24284 raft_consensus.cc:385] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.249380 24284 raft_consensus.cc:740] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.250193 24284 consensus_queue.cc:260] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.255615 24282 tablet_bootstrap.cc:492] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:03.251614 24285 raft_consensus.cc:359] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.256559 24285 raft_consensus.cc:385] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.256801 24285 raft_consensus.cc:740] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
W20260709 12:13:03.259334 24206 leader_election.cc:343] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.259785 24206 leader_election.cc:304] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46
W20260709 12:13:03.261842 24058 leader_election.cc:343] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.262328 24058 leader_election.cc:304] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
W20260709 12:13:03.254390 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 55404.1us
I20260709 12:13:03.275339 24284 ts_tablet_manager.cc:1434] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.095s	user 0.011s	sys 0.000s
I20260709 12:13:03.277979 24629 raft_consensus.cc:493] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.278330 24468 raft_consensus.cc:2749] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.283008 24619 raft_consensus.cc:2749] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.268077 24547 raft_consensus.cc:493] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.291395 24284 tablet_bootstrap.cc:492] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:03.292543 24285 consensus_queue.cc:260] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.303923 24284 tablet_bootstrap.cc:654] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.291888 24629 raft_consensus.cc:515] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.292917 24547 raft_consensus.cc:515] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:03.312634 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:03.313274 24092 raft_consensus.cc:2468] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:03.313845 24547 leader_election.cc:290] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:03.315315 24288 tablet_bootstrap.cc:492] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:03.315873 24288 ts_tablet_manager.cc:1403] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.181s	user 0.010s	sys 0.011s
I20260709 12:13:03.315333 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:03.316393 23982 leader_election.cc:304] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:03.321429 24409 raft_consensus.cc:2804] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.293948 24516 raft_consensus.cc:493] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.327792 24516 raft_consensus.cc:515] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.328729 24628 raft_consensus.cc:493] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.329322 24628 raft_consensus.cc:515] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.321897 24409 raft_consensus.cc:493] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.330668 24409 raft_consensus.cc:3060] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:03.316663 24633 log.cc:927] Time spent T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:13:03.333587 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:13:03.335188 23983 leader_election.cc:343] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:03.335556 24058 leader_election.cc:343] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.339840 24628 leader_election.cc:290] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:03.341838 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:03.347010 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:03.345989 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:03.347236 24088 raft_consensus.cc:2468] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:03.349226 23982 leader_election.cc:304] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
W20260709 12:13:03.350162 24058 leader_election.cc:343] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.350647 24058 leader_election.cc:304] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:03.351497 24628 raft_consensus.cc:2804] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.335391 24282 tablet_bootstrap.cc:654] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.333705 24629 leader_election.cc:290] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
W20260709 12:13:03.353806 23983 leader_election.cc:343] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.346194 24516 leader_election.cc:290] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:03.360199 24285 ts_tablet_manager.cc:1434] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.173s	user 0.008s	sys 0.018s
I20260709 12:13:03.351905 24288 raft_consensus.cc:359] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:03.375131 24288 raft_consensus.cc:385] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.375535 24288 raft_consensus.cc:740] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.376253 24288 consensus_queue.cc:260] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:03.351830 24617 raft_consensus.cc:2749] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.382297 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:03.383419 24288 ts_tablet_manager.cc:1434] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.004s
I20260709 12:13:03.364009 24468 consensus_queue.cc:1048] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:13:03.386816 24515 raft_consensus.cc:493] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.387382 24515 raft_consensus.cc:515] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.389735 24515 leader_election.cc:290] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:03.391585 24284 tablet_bootstrap.cc:492] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:03.392906 24284 ts_tablet_manager.cc:1403] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.006s
I20260709 12:13:03.365756 24409 raft_consensus.cc:515] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.361387 24628 raft_consensus.cc:493] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.395545 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:03.396029 24284 raft_consensus.cc:359] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.400640 24284 raft_consensus.cc:385] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.400985 24284 raft_consensus.cc:740] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
W20260709 12:13:03.414057 23963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:03.414693 24285 tablet_bootstrap.cc:492] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:03.416508 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:03.419468 24284 consensus_queue.cc:260] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.401014 24628 raft_consensus.cc:3060] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:03.419103 24058 leader_election.cc:343] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.442430 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:03.444288 24545 consensus_queue.cc:1048] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.445747 24409 leader_election.cc:290] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:03.449542 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:03.454653 24628 raft_consensus.cc:515] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
W20260709 12:13:03.462762 24058 leader_election.cc:343] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.463289 24058 leader_election.cc:304] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:03.464464 24547 raft_consensus.cc:2749] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.465508 24628 leader_election.cc:290] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:03.466391 24625 raft_consensus.cc:493] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.467485 24625 raft_consensus.cc:515] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.469759 24625 leader_election.cc:290] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:03.467096 24288 tablet_bootstrap.cc:492] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
W20260709 12:13:03.480693 23983 leader_election.cc:343] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.488610 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:03.494954 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:03.496629 24132 leader_election.cc:304] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:03.497293 24458 raft_consensus.cc:2749] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.498414 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:03.499198 24089 raft_consensus.cc:3060] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.504225 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:03.504971 24088 raft_consensus.cc:3060] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.508426 24409 raft_consensus.cc:493] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.509109 24409 raft_consensus.cc:515] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.513512 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:03.515717 24285 tablet_bootstrap.cc:654] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:03.516185 23983 leader_election.cc:343] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.517014 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:13:03.520941 23983 leader_election.cc:343] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.521742 24409 leader_election.cc:290] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:03.522486 24284 ts_tablet_manager.cc:1434] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.001s
I20260709 12:13:03.525369 24284 tablet_bootstrap.cc:492] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:03.533641 24088 raft_consensus.cc:2468] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
W20260709 12:13:03.542349 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 143733us
I20260709 12:13:03.535306 24284 tablet_bootstrap.cc:654] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.535841 24089 raft_consensus.cc:2468] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:13:03.539753 24288 tablet_bootstrap.cc:654] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:03.540894 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 96405us
I20260709 12:13:03.543239 23982 leader_election.cc:304] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:03.555197 23982 leader_election.cc:304] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:03.555335 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:03.556149 24238 raft_consensus.cc:2468] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:03.544070 24282 tablet_bootstrap.cc:492] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:03.557509 24282 ts_tablet_manager.cc:1403] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.355s	user 0.006s	sys 0.012s
I20260709 12:13:03.560566 24282 raft_consensus.cc:359] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.561013 24285 tablet_bootstrap.cc:492] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:03.561295 24282 raft_consensus.cc:385] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.561604 24282 raft_consensus.cc:740] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.562295 24629 raft_consensus.cc:2804] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.562896 24629 raft_consensus.cc:697] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:03.563174 24523 raft_consensus.cc:2804] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.563791 24629 consensus_queue.cc:237] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.564538 24285 ts_tablet_manager.cc:1403] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.152s	user 0.009s	sys 0.002s
I20260709 12:13:03.563817 24523 raft_consensus.cc:697] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:03.566427 24523 consensus_queue.cc:237] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.567936 24285 raft_consensus.cc:359] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.568727 24285 raft_consensus.cc:385] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.569051 24285 raft_consensus.cc:740] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
W20260709 12:13:03.547952 24206 leader_election.cc:343] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.548866 24016 raft_consensus.cc:3060] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.569886 24282 consensus_queue.cc:260] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:03.579706 24282 ts_tablet_manager.cc:1434] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:13:03.569895 24285 consensus_queue.cc:260] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:13:03.577200 24206 consensus_peers.cc:597] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:03.577421 23983 leader_election.cc:304] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:03.582129 24285 ts_tablet_manager.cc:1434] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:13:03.583082 24518 raft_consensus.cc:2804] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.583570 24285 tablet_bootstrap.cc:492] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:03.584918 24282 tablet_bootstrap.cc:492] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368: Bootstrap starting.
W20260709 12:13:03.584100 24206 leader_election.cc:343] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.589318 24206 leader_election.cc:304] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:03.583534 24518 raft_consensus.cc:493] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.590801 24543 raft_consensus.cc:2749] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.590440 24518 raft_consensus.cc:3060] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.592126 24636 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.592603 24636 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.594753 24636 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:03.598543 24159 raft_consensus.cc:3060] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.599197 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:03.599910 24090 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:03.612665 24518 raft_consensus.cc:515] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.614415 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:03.615172 24205 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:03.616570 24543 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.616953 24543 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.617302 24543 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:03.621480 24206 leader_election.cc:343] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.622026 24516 consensus_queue.cc:1048] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.630818 24636 consensus_queue.cc:1048] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.635492 24543 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.638684 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:03.639340 24090 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.639379 24516 consensus_queue.cc:1048] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:03.647579 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:03.605929 24282 tablet_bootstrap.cc:654] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.655874 24458 raft_consensus.cc:493] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.656562 24458 raft_consensus.cc:515] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
W20260709 12:13:03.658531 24206 leader_election.cc:343] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.660085 24458 leader_election.cc:290] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:03.661640 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:03.662500 24091 raft_consensus.cc:2393] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:13:03.673063 24284 tablet_bootstrap.cc:492] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:03.673718 24284 ts_tablet_manager.cc:1403] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.031s
I20260709 12:13:03.676869 24284 raft_consensus.cc:359] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.678054 24284 raft_consensus.cc:385] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.678367 24284 raft_consensus.cc:740] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.678367 24644 consensus_queue.cc:1048] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:03.679649 24284 consensus_queue.cc:260] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.683221 24284 ts_tablet_manager.cc:1434] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:13:03.684592 24284 tablet_bootstrap.cc:492] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:03.687525 24543 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:03.697014 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:03.705308 24132 leader_election.cc:304] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:03.706601 24458 raft_consensus.cc:3060] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.706704 24090 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:03.707990 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
W20260709 12:13:03.709817 23983 leader_election.cc:343] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.711623 24205 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:03.712982 24644 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.713455 24644 raft_consensus.cc:697] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:03.718115 24644 consensus_queue.cc:237] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.727375 23915 catalog_manager.cc:5697] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.729394 23915 catalog_manager.cc:5697] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.729332 24284 tablet_bootstrap.cc:654] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.758615 24288 tablet_bootstrap.cc:492] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:03.759232 24288 ts_tablet_manager.cc:1403] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.337s	user 0.019s	sys 0.015s
I20260709 12:13:03.761198 24458 raft_consensus.cc:2749] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.763998 24288 raft_consensus.cc:359] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.772287 24288 raft_consensus.cc:385] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.772686 24288 raft_consensus.cc:740] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.773506 24288 consensus_queue.cc:260] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.774722 24284 tablet_bootstrap.cc:492] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:03.775352 24284 ts_tablet_manager.cc:1403] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.004s
I20260709 12:13:03.776356 24288 ts_tablet_manager.cc:1434] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:13:03.771037 24518 leader_election.cc:290] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:03.781462 24284 raft_consensus.cc:359] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:13:03.790460 24656 log.cc:927] Time spent T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:13:03.771221 24285 tablet_bootstrap.cc:654] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.793817 24284 raft_consensus.cc:385] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.798269 24515 raft_consensus.cc:493] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:03.799378 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 80103.3us
I20260709 12:13:03.800406 24284 raft_consensus.cc:740] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.803188 24284 consensus_queue.cc:260] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.809199 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:03.809880 24240 raft_consensus.cc:3060] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.803190 24515 raft_consensus.cc:515] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:03.835636 24515 leader_election.cc:290] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:03.833515 23914 catalog_manager.cc:5697] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.839011 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0856b61c9894cf4b8c1c263d489820c" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
W20260709 12:13:03.842111 24058 leader_election.cc:343] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.844132 24240 raft_consensus.cc:2468] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:13:03.849149 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0856b61c9894cf4b8c1c263d489820c" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:03.848706 23983 leader_election.cc:304] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
W20260709 12:13:03.855964 24058 leader_election.cc:343] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.856417 24058 leader_election.cc:304] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:03.857999 24284 ts_tablet_manager.cc:1434] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.001s
I20260709 12:13:03.857352 24629 raft_consensus.cc:2804] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.867009 24547 raft_consensus.cc:2749] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.873688 24629 raft_consensus.cc:697] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:03.874686 24629 consensus_queue.cc:237] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.875583 24282 tablet_bootstrap.cc:492] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:03.876092 24282 ts_tablet_manager.cc:1403] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.291s	user 0.039s	sys 0.031s
I20260709 12:13:03.883509 24284 tablet_bootstrap.cc:492] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:03.863986 24515 raft_consensus.cc:493] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.884378 24282 raft_consensus.cc:359] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.886889 24282 raft_consensus.cc:385] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.887250 24282 raft_consensus.cc:740] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.889545 24515 raft_consensus.cc:515] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:03.891207 24282 consensus_queue.cc:260] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.910472 24282 ts_tablet_manager.cc:1434] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 12:13:03.915766 24288 tablet_bootstrap.cc:492] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46: Bootstrap starting.
I20260709 12:13:03.911458 24518 raft_consensus.cc:493] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.922719 24518 raft_consensus.cc:515] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.926666 24518 leader_election.cc:290] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:03.927248 24288 tablet_bootstrap.cc:654] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.929507 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:03.931315 24515 leader_election.cc:290] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:03.933745 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:03.932087 24282 tablet_bootstrap.cc:492] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368: Bootstrap starting.
W20260709 12:13:03.933815 23983 leader_election.cc:343] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:03.940394 24658 log.cc:927] Time spent T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:13:03.952440 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:03.955086 24238 raft_consensus.cc:2468] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:03.959097 23983 leader_election.cc:304] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:03.959396 24282 tablet_bootstrap.cc:654] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.964165 24284 tablet_bootstrap.cc:654] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.935837 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:03.965327 24409 raft_consensus.cc:2804] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.965778 24409 raft_consensus.cc:493] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:03.966248 24058 leader_election.cc:343] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.966135 24409 raft_consensus.cc:3060] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:03.979830 24058 leader_election.cc:343] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.980301 24058 leader_election.cc:304] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:03.981370 24515 raft_consensus.cc:2749] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.993182 24409 raft_consensus.cc:515] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:03.995713 24409 leader_election.cc:290] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:04.000357 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:04.001060 24240 raft_consensus.cc:3060] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.014206 24240 raft_consensus.cc:2468] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:13:04.032219 23983 leader_election.cc:304] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:04.033241 24518 raft_consensus.cc:2804] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.033845 24518 raft_consensus.cc:697] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:04.034803 24518 consensus_queue.cc:237] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.055030 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:04.093108 24551 consensus_queue.cc:1048] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:13:04.111299 24625 raft_consensus.cc:493] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.112017 24625 raft_consensus.cc:515] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.115875 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:04.116685 24240 raft_consensus.cc:2393] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:13:04.116098 24625 leader_election.cc:290] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
W20260709 12:13:04.121632 23983 leader_election.cc:343] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.124374 24016 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.134593 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:04.136592 24132 leader_election.cc:304] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:04.137888 24625 raft_consensus.cc:3060] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.148554 24625 raft_consensus.cc:2749] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.164330 24551 consensus_queue.cc:1048] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.175305 24409 consensus_queue.cc:1048] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.186208 24285 tablet_bootstrap.cc:492] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:04.188321 24285 ts_tablet_manager.cc:1403] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.605s	user 0.018s	sys 0.005s
I20260709 12:13:04.191591 24285 raft_consensus.cc:359] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.192346 24285 raft_consensus.cc:385] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.192628 24285 raft_consensus.cc:740] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.193315 24285 consensus_queue.cc:260] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.200815 24288 tablet_bootstrap.cc:492] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46: No bootstrap required, opened a new log
I20260709 12:13:04.201403 24288 ts_tablet_manager.cc:1403] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent bootstrapping tablet: real 0.397s	user 0.024s	sys 0.000s
I20260709 12:13:04.202589 24285 ts_tablet_manager.cc:1434] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:13:04.203812 24285 tablet_bootstrap.cc:492] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
W20260709 12:13:04.230824 23983 consensus_peers.cc:597] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.233661 24285 tablet_bootstrap.cc:654] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.235545 24282 tablet_bootstrap.cc:492] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:04.236171 24282 ts_tablet_manager.cc:1403] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.304s	user 0.068s	sys 0.130s
I20260709 12:13:04.239188 24282 raft_consensus.cc:359] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.240899 24282 raft_consensus.cc:385] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.241628 24282 raft_consensus.cc:740] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.243854 24282 consensus_queue.cc:260] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.250286 24282 ts_tablet_manager.cc:1434] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:13:04.251660 24282 tablet_bootstrap.cc:492] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:04.254588 24284 tablet_bootstrap.cc:492] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:04.255187 24284 ts_tablet_manager.cc:1403] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.382s	user 0.090s	sys 0.118s
I20260709 12:13:04.260322 24288 raft_consensus.cc:359] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.264806 24288 raft_consensus.cc:385] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.265125 24288 raft_consensus.cc:740] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.263392 24284 raft_consensus.cc:359] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.266287 24284 raft_consensus.cc:385] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.266592 24284 raft_consensus.cc:740] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.267135 24282 tablet_bootstrap.cc:654] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.267277 24284 consensus_queue.cc:260] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.269449 24284 ts_tablet_manager.cc:1434] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.003s
I20260709 12:13:04.270905 24284 tablet_bootstrap.cc:492] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:04.276705 24409 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.277287 24409 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.265779 24288 consensus_queue.cc:260] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.279413 24543 consensus_queue.cc:1048] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:13:04.290715 24284 tablet_bootstrap.cc:654] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.292380 24285 tablet_bootstrap.cc:492] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:04.292761 24288 ts_tablet_manager.cc:1434] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 12:13:04.292958 24285 ts_tablet_manager.cc:1403] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.001s
I20260709 12:13:04.320854 24285 raft_consensus.cc:359] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.321563 24285 raft_consensus.cc:385] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.321846 24285 raft_consensus.cc:740] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.322553 24285 consensus_queue.cc:260] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.323974 24282 tablet_bootstrap.cc:492] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:04.324566 24282 ts_tablet_manager.cc:1403] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.017s
I20260709 12:13:04.329716 24285 ts_tablet_manager.cc:1434] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:13:04.345958 24282 raft_consensus.cc:359] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.347066 24282 raft_consensus.cc:385] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.347429 24282 raft_consensus.cc:740] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.348436 24282 consensus_queue.cc:260] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.354633 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:04.355250 24516 consensus_queue.cc:1048] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.361387 24409 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:04.364320 24282 ts_tablet_manager.cc:1434] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:13:04.365574 24282 tablet_bootstrap.cc:492] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:04.365506 24523 consensus_queue.cc:1048] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.366928 24285 tablet_bootstrap.cc:492] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:04.373624 24409 consensus_queue.cc:1048] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.374313 23913 catalog_manager.cc:5697] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.376320 23913 catalog_manager.cc:5697] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.392987 24282 tablet_bootstrap.cc:654] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.391436 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:04.398654 24088 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:13:04.400451 23982 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:04.401432 24409 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:04.401791 24409 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a09fd0dde7fc4241aecc9690b427e9e2)
I20260709 12:13:04.402153 24409 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:04.412242 24282 tablet_bootstrap.cc:492] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:04.413046 24282 ts_tablet_manager.cc:1403] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.013s
I20260709 12:13:04.412535 24285 tablet_bootstrap.cc:654] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.418126 24409 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.416144 24282 raft_consensus.cc:359] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.422676 24282 raft_consensus.cc:385] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.423080 24282 raft_consensus.cc:740] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.423846 24282 consensus_queue.cc:260] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.425845 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:04.426123 24282 ts_tablet_manager.cc:1434] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:13:04.427874 24282 tablet_bootstrap.cc:492] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:04.432761 24284 tablet_bootstrap.cc:492] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:04.433326 24284 ts_tablet_manager.cc:1403] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.163s	user 0.028s	sys 0.016s
I20260709 12:13:04.435050 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:04.436415 24284 raft_consensus.cc:359] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.437325 24284 raft_consensus.cc:385] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.437379 23982 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:04.438674 24551 raft_consensus.cc:2749] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:04.437623 24284 raft_consensus.cc:740] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.439919 24284 consensus_queue.cc:260] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.442077 24284 ts_tablet_manager.cc:1434] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:04.443394 24284 tablet_bootstrap.cc:492] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:04.435011 24409 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:04.454907 24285 tablet_bootstrap.cc:492] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:04.457378 24285 ts_tablet_manager.cc:1403] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.002s
I20260709 12:13:04.457554 24284 tablet_bootstrap.cc:654] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.460444 24282 tablet_bootstrap.cc:654] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.462580 24285 raft_consensus.cc:359] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.463718 24285 raft_consensus.cc:385] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.464021 24285 raft_consensus.cc:740] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.467729 24284 tablet_bootstrap.cc:492] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:04.468322 24284 ts_tablet_manager.cc:1403] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.006s
I20260709 12:13:04.468596 24285 consensus_queue.cc:260] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.471141 24284 raft_consensus.cc:359] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.471912 24284 raft_consensus.cc:385] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.472203 24284 raft_consensus.cc:740] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.472517 24285 ts_tablet_manager.cc:1434] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:13:04.473666 24285 tablet_bootstrap.cc:492] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:04.473860 24284 consensus_queue.cc:260] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.476065 24284 ts_tablet_manager.cc:1434] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:04.487587 24284 tablet_bootstrap.cc:492] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:04.494567 24284 tablet_bootstrap.cc:654] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.494807 24282 tablet_bootstrap.cc:492] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:04.495313 24282 ts_tablet_manager.cc:1403] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.006s
I20260709 12:13:04.505167 24282 raft_consensus.cc:359] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.505963 24282 raft_consensus.cc:385] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.506256 24282 raft_consensus.cc:740] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.506929 24282 consensus_queue.cc:260] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
W20260709 12:13:04.510931 23963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:04.516104 24285 tablet_bootstrap.cc:654] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.519019 24284 tablet_bootstrap.cc:492] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:04.519171 24282 ts_tablet_manager.cc:1434] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:13:04.519624 24284 ts_tablet_manager.cc:1403] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 12:13:04.520186 24282 tablet_bootstrap.cc:492] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:04.522540 24284 raft_consensus.cc:359] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.523272 24284 raft_consensus.cc:385] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.523545 24284 raft_consensus.cc:740] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.524329 24284 consensus_queue.cc:260] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.526808 24284 ts_tablet_manager.cc:1434] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:04.527777 24284 tablet_bootstrap.cc:492] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:04.537180 24282 tablet_bootstrap.cc:654] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.538762 24284 tablet_bootstrap.cc:654] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.552989 24285 tablet_bootstrap.cc:492] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:04.553535 24285 ts_tablet_manager.cc:1403] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.003s
I20260709 12:13:04.556016 24284 tablet_bootstrap.cc:492] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:04.556592 24284 ts_tablet_manager.cc:1403] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.004s
I20260709 12:13:04.556315 24285 raft_consensus.cc:359] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.556985 24285 raft_consensus.cc:385] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.557313 24285 raft_consensus.cc:740] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.552943 24282 tablet_bootstrap.cc:492] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:04.558758 24282 ts_tablet_manager.cc:1403] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.004s
I20260709 12:13:04.560107 24284 raft_consensus.cc:359] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.560835 24284 raft_consensus.cc:385] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.561088 24284 raft_consensus.cc:740] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.561408 24282 raft_consensus.cc:359] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.562152 24282 raft_consensus.cc:385] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.561728 24284 consensus_queue.cc:260] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.562428 24282 raft_consensus.cc:740] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.563126 24282 consensus_queue.cc:260] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.564455 24284 ts_tablet_manager.cc:1434] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:04.565547 24284 tablet_bootstrap.cc:492] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:04.558034 24285 consensus_queue.cc:260] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.571099 24285 ts_tablet_manager.cc:1434] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:13:04.571374 24284 tablet_bootstrap.cc:654] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.572113 24285 tablet_bootstrap.cc:492] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:04.579102 24282 ts_tablet_manager.cc:1434] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:13:04.580459 24282 tablet_bootstrap.cc:492] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:04.580343 24458 raft_consensus.cc:493] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.580999 24458 raft_consensus.cc:515] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.583081 24458 leader_election.cc:290] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:04.584861 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:04.585697 24240 raft_consensus.cc:2393] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate a09fd0dde7fc4241aecc9690b427e9e2 in this term.
I20260709 12:13:04.587520 24282 tablet_bootstrap.cc:654] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.589048 24285 tablet_bootstrap.cc:654] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.590572 24284 tablet_bootstrap.cc:492] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:04.591106 24284 ts_tablet_manager.cc:1403] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.000s
I20260709 12:13:04.595438 24157 raft_consensus.cc:3060] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.600220 24661 raft_consensus.cc:493] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.600818 24661 raft_consensus.cc:515] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.603008 24661 leader_election.cc:290] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:04.603863 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09559716fd22441c954a4dbae0e41bee" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:04.604771 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09559716fd22441c954a4dbae0e41bee" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:04.605479 24016 raft_consensus.cc:2468] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:04.605633 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:04.606590 24088 raft_consensus.cc:2393] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:13:04.606945 24206 leader_election.cc:304] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:04.607738 24636 raft_consensus.cc:2804] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.608107 24636 raft_consensus.cc:493] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.608422 24636 raft_consensus.cc:3060] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.612605 24515 raft_consensus.cc:493] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:04.614480 24206 leader_election.cc:343] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.609463 24131 leader_election.cc:304] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:04.616452 24625 raft_consensus.cc:3060] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.615996 24515 raft_consensus.cc:515] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.620503 24636 raft_consensus.cc:515] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.622706 24515 leader_election.cc:290] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.623401 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09559716fd22441c954a4dbae0e41bee" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:04.624290 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1ebf08df17449aa47d4ffc0d7b03d3" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:04.624969 24012 raft_consensus.cc:2468] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
W20260709 12:13:04.624912 24206 leader_election.cc:343] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.627784 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09559716fd22441c954a4dbae0e41bee" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:04.628305 24158 raft_consensus.cc:3060] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.629068 24625 raft_consensus.cc:2749] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.609051 24284 raft_consensus.cc:359] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.630395 24284 raft_consensus.cc:385] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.630678 24284 raft_consensus.cc:740] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.631400 24284 consensus_queue.cc:260] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.633040 24284 ts_tablet_manager.cc:1434] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:13:04.628427 24016 raft_consensus.cc:3060] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.637072 24282 tablet_bootstrap.cc:492] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:04.628515 24636 leader_election.cc:290] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:04.639575 24282 ts_tablet_manager.cc:1403] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.002s
I20260709 12:13:04.639981 24409 consensus_queue.cc:1048] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.643108 24284 tablet_bootstrap.cc:492] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:04.646847 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1ebf08df17449aa47d4ffc0d7b03d3" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:04.646641 24016 raft_consensus.cc:2468] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:04.657147 24206 leader_election.cc:304] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:04.658372 24543 raft_consensus.cc:2804] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.658881 24543 raft_consensus.cc:697] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:04.659730 24543 consensus_queue.cc:237] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.661850 24284 tablet_bootstrap.cc:654] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.664162 24285 tablet_bootstrap.cc:492] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:04.664729 24285 ts_tablet_manager.cc:1403] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.006s
I20260709 12:13:04.667702 24285 raft_consensus.cc:359] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.668401 24285 raft_consensus.cc:385] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.668658 24285 raft_consensus.cc:740] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
W20260709 12:13:04.669188 24058 leader_election.cc:343] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.670293 24058 leader_election.cc:304] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:04.675650 24282 raft_consensus.cc:359] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.676442 24282 raft_consensus.cc:385] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.676733 24282 raft_consensus.cc:740] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.677424 24282 consensus_queue.cc:260] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.669445 24285 consensus_queue.cc:260] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.681602 24518 consensus_queue.cc:1048] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.685595 24285 ts_tablet_manager.cc:1434] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:13:04.686317 24636 raft_consensus.cc:493] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.686882 24636 raft_consensus.cc:515] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.689036 24636 leader_election.cc:290] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:04.690456 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:04.691213 24088 raft_consensus.cc:2468] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:04.691704 24285 tablet_bootstrap.cc:492] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:04.692814 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:04.693487 24016 raft_consensus.cc:2468] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:04.689988 24282 ts_tablet_manager.cc:1434] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:13:04.695207 24205 leader_election.cc:304] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:04.696194 24282 tablet_bootstrap.cc:492] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:04.696626 24636 raft_consensus.cc:2804] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.697022 24636 raft_consensus.cc:493] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.697341 24636 raft_consensus.cc:3060] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.697734 24515 raft_consensus.cc:2804] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.698169 24515 raft_consensus.cc:493] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.698494 24515 raft_consensus.cc:3060] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.706751 24515 raft_consensus.cc:515] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.708670 24282 tablet_bootstrap.cc:654] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.708874 24515 leader_election.cc:290] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.712886 24617 raft_consensus.cc:493] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.713526 24617 raft_consensus.cc:515] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.714054 24285 tablet_bootstrap.cc:654] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.715843 24617 leader_election.cc:290] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.711292 24636 raft_consensus.cc:515] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.718180 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb82c3e798f4870b3983a6831c6d557" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:13:04.720053 24058 leader_election.cc:343] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.720315 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:04.721026 24016 raft_consensus.cc:3060] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.727339 24409 raft_consensus.cc:493] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.727869 24409 raft_consensus.cc:515] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.729869 24409 leader_election.cc:290] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:04.731712 24016 raft_consensus.cc:2468] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:04.731969 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:04.733363 24206 leader_election.cc:304] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:04.734297 24543 raft_consensus.cc:2804] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.734848 24543 raft_consensus.cc:697] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:04.735715 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:04.736300 24284 tablet_bootstrap.cc:492] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:04.736300 24282 tablet_bootstrap.cc:492] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:04.736893 24284 ts_tablet_manager.cc:1403] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.010s
I20260709 12:13:04.735710 24543 consensus_queue.cc:237] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.737361 24282 ts_tablet_manager.cc:1403] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.005s
I20260709 12:13:04.736413 24237 raft_consensus.cc:2468] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:04.739957 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1ebf08df17449aa47d4ffc0d7b03d3" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:04.740937 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1ebf08df17449aa47d4ffc0d7b03d3" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:04.741562 24012 raft_consensus.cc:3060] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.742462 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:04.743084 24091 raft_consensus.cc:3060] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.748202 24625 raft_consensus.cc:493] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.748782 24625 raft_consensus.cc:515] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.750517 24015 raft_consensus.cc:1240] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Rejecting Update request from peer a09fd0dde7fc4241aecc9690b427e9e2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:04.750974 24625 leader_election.cc:290] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:04.752391 24516 raft_consensus.cc:493] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.752732 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:04.752887 24516 raft_consensus.cc:515] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.755061 24661 consensus_queue.cc:1059] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:04.756011 24285 tablet_bootstrap.cc:492] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:04.756534 24285 ts_tablet_manager.cc:1403] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.003s
I20260709 12:13:04.756384 24545 raft_consensus.cc:3055] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:04.756949 24545 raft_consensus.cc:740] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:04.757795 24545 consensus_queue.cc:260] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.759281 24285 raft_consensus.cc:359] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.759989 24285 raft_consensus.cc:385] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.760241 24285 raft_consensus.cc:740] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.761276 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:04.761989 24088 raft_consensus.cc:2468] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:04.763487 24205 leader_election.cc:304] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:04.764108 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:04.764657 24516 leader_election.cc:290] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.765618 24131 leader_election.cc:304] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:04.767426 24458 raft_consensus.cc:2749] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.768352 23913 catalog_manager.cc:5697] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.769464 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:04.770200 24516 raft_consensus.cc:2804] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.770627 24516 raft_consensus.cc:493] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.770946 24516 raft_consensus.cc:3060] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.742290 24282 raft_consensus.cc:359] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.771397 24282 raft_consensus.cc:385] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.771672 24282 raft_consensus.cc:740] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.772492 24285 consensus_queue.cc:260] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:04.773684 24282 consensus_queue.cc:260] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.774741 24159 raft_consensus.cc:2468] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:04.779250 24091 raft_consensus.cc:2468] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:04.779636 24285 ts_tablet_manager.cc:1434] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:13:04.791780 23983 leader_election.cc:304] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:04.792681 24409 raft_consensus.cc:2804] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.781574 24282 ts_tablet_manager.cc:1434] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.001s
I20260709 12:13:04.766063 24636 leader_election.cc:290] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:04.780766 24545 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:04.793088 24409 raft_consensus.cc:493] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.807682 24409 raft_consensus.cc:3060] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:04.792824 23983 leader_election.cc:343] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.787431 24284 raft_consensus.cc:359] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.773949 24012 raft_consensus.cc:2468] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:04.808295 24284 raft_consensus.cc:385] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.810459 24284 raft_consensus.cc:740] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.786047 24158 raft_consensus.cc:3060] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.786520 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb82c3e798f4870b3983a6831c6d557" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:04.813594 24284 consensus_queue.cc:260] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.815785 24058 leader_election.cc:304] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
W20260709 12:13:04.813055 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 49651.6us
I20260709 12:13:04.818755 24285 tablet_bootstrap.cc:492] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2: Bootstrap starting.
I20260709 12:13:04.818004 24617 raft_consensus.cc:2804] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.830940 24282 tablet_bootstrap.cc:492] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:04.817258 24015 raft_consensus.cc:2468] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:13:04.832844 24516 raft_consensus.cc:515] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.835722 24523 raft_consensus.cc:493] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.836297 24523 raft_consensus.cc:515] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.838523 24523 leader_election.cc:290] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.843997 24409 raft_consensus.cc:515] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.848006 24409 leader_election.cc:290] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:04.827239 24617 raft_consensus.cc:697] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:04.855132 24516 leader_election.cc:290] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.856309 24284 ts_tablet_manager.cc:1434] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.014s
I20260709 12:13:04.848608 24159 raft_consensus.cc:3060] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:04.867231 23983 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.68:38373, user_credentials={real_user=slave}} blocked reactor thread for 46968.1us
I20260709 12:13:04.870012 24284 tablet_bootstrap.cc:492] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:04.871713 24058 leader_election.cc:304] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:04.872026 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:04.872700 24240 raft_consensus.cc:3060] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.878427 24617 consensus_queue.cc:237] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.880934 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:04.881652 24091 raft_consensus.cc:3060] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.882417 24703 raft_consensus.cc:493] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.882951 24703 raft_consensus.cc:515] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:04.886581 24703 leader_election.cc:290] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.889601 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:04.890509 24086 raft_consensus.cc:2468] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:04.894276 24158 raft_consensus.cc:2468] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:04.873849 24515 raft_consensus.cc:2804] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.896481 24515 raft_consensus.cc:493] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.896850 24515 raft_consensus.cc:3060] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.897293 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:04.901481 24619 raft_consensus.cc:493] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.895851 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:04.896732 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:04.902132 24619 raft_consensus.cc:515] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.903295 24205 leader_election.cc:304] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:04.904397 24661 raft_consensus.cc:2804] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.904536 24619 leader_election.cc:290] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.904814 24661 raft_consensus.cc:493] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.905177 24661 raft_consensus.cc:3060] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.907294 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:04.908089 24160 raft_consensus.cc:2468] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:13:04.909405 24058 leader_election.cc:304] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:04.897910 24165 raft_consensus.cc:3060] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.909752 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:04.910465 24547 raft_consensus.cc:2804] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.910848 24547 raft_consensus.cc:493] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.911167 24547 raft_consensus.cc:3060] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.901821 24285 tablet_bootstrap.cc:654] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.912981 24164 raft_consensus.cc:2468] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
I20260709 12:13:04.923058 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:04.926158 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:04.926986 24015 raft_consensus.cc:2468] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 0.
I20260709 12:13:04.930886 24165 raft_consensus.cc:2468] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
W20260709 12:13:04.942083 23983 leader_election.cc:343] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.949734 24240 raft_consensus.cc:2468] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:13:04.953589 23983 leader_election.cc:304] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:04.951877 23914 catalog_manager.cc:5697] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.963109 23983 leader_election.cc:304] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
W20260709 12:13:04.956413 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 49576.7us
I20260709 12:13:04.962366 24629 raft_consensus.cc:2804] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.972388 24629 raft_consensus.cc:493] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.969048 24518 raft_consensus.cc:2804] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.973558 24518 raft_consensus.cc:697] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:04.974562 24518 consensus_queue.cc:237] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:04.981122 24091 raft_consensus.cc:2468] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:04.946240 24547 raft_consensus.cc:515] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.983340 24088 raft_consensus.cc:2393] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79c4e12b81e44dae8a76443acdf7b9c9 in current term 1: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:13:04.984078 24547 leader_election.cc:290] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.985656 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:04.986289 24164 raft_consensus.cc:3060] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.987150 24515 raft_consensus.cc:515] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:04.989464 24515 leader_election.cc:290] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:04.990383 24284 tablet_bootstrap.cc:654] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.972757 24629 raft_consensus.cc:3060] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:04.993315 24206 leader_election.cc:343] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.994688 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb82c3e798f4870b3983a6831c6d557" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:05.004256 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb82c3e798f4870b3983a6831c6d557" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:05.005004 24016 raft_consensus.cc:3060] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.999002 24206 leader_election.cc:304] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
W20260709 12:13:05.006731 24058 leader_election.cc:343] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.008859 24516 raft_consensus.cc:2804] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.011720 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:05.007004 24661 raft_consensus.cc:515] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.021867 24516 raft_consensus.cc:697] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:05.039213 23913 catalog_manager.cc:5697] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.066394 24551 raft_consensus.cc:493] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.079268 24551 raft_consensus.cc:515] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.079744 24285 tablet_bootstrap.cc:492] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2: No bootstrap required, opened a new log
I20260709 12:13:05.082561 24285 ts_tablet_manager.cc:1403] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2: Time spent bootstrapping tablet: real 0.270s	user 0.006s	sys 0.021s
I20260709 12:13:05.083678 24661 leader_election.cc:290] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:05.085788 24285 raft_consensus.cc:359] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.086599 24285 raft_consensus.cc:385] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.086880 24285 raft_consensus.cc:740] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.067749 24516 consensus_queue.cc:237] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.093369 24285 consensus_queue.cc:260] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.096254 24285 ts_tablet_manager.cc:1434] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:13:05.096941 24551 leader_election.cc:290] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:05.099119 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:05.101208 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:05.102047 24240 raft_consensus.cc:2468] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 0.
W20260709 12:13:05.101856 23983 leader_election.cc:343] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.104194 23983 leader_election.cc:304] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:05.105019 24551 raft_consensus.cc:2804] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:05.106009 24551 raft_consensus.cc:493] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.106542 24551 raft_consensus.cc:3060] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.105032 24164 raft_consensus.cc:2468] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:05.111963 24016 raft_consensus.cc:2468] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:05.114631 24058 leader_election.cc:304] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:05.122534 24282 tablet_bootstrap.cc:654] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.118810 24619 raft_consensus.cc:2804] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.124473 24619 raft_consensus.cc:697] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:05.125367 24619 consensus_queue.cc:237] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:05.126453 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:05.127210 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:05.127872 24091 raft_consensus.cc:3060] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.129467 24707 raft_consensus.cc:493] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.130045 24707 raft_consensus.cc:515] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:05.133342 24629 raft_consensus.cc:515] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:05.134630 24015 raft_consensus.cc:2393] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 in current term 1: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:13:05.136583 24629 leader_election.cc:290] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:05.133463 23913 catalog_manager.cc:5697] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.140426 24058 leader_election.cc:304] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:05.140756 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
W20260709 12:13:05.118029 24206 consensus_peers.cc:597] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:05.144399 24551 raft_consensus.cc:515] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.152379 24617 raft_consensus.cc:2804] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.155372 24091 raft_consensus.cc:2468] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:05.171008 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0856b61c9894cf4b8c1c263d489820c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:05.177721 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:05.177181 24551 leader_election.cc:290] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:05.181249 24282 tablet_bootstrap.cc:492] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:05.181851 24282 ts_tablet_manager.cc:1403] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.360s	user 0.014s	sys 0.008s
W20260709 12:13:05.182736 23983 leader_election.cc:343] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.170823 24617 raft_consensus.cc:697] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:05.163702 24707 leader_election.cc:290] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:05.184697 24617 consensus_queue.cc:237] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:05.184963 24282 raft_consensus.cc:359] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.185734 24282 raft_consensus.cc:385] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.186038 24282 raft_consensus.cc:740] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.186748 24282 consensus_queue.cc:260] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.188452 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0856b61c9894cf4b8c1c263d489820c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:05.189018 24282 ts_tablet_manager.cc:1434] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:05.189162 24090 raft_consensus.cc:2468] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 0.
I20260709 12:13:05.190351 24282 tablet_bootstrap.cc:492] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:05.202442 23914 catalog_manager.cc:5697] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.208495 23912 catalog_manager.cc:5697] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.192924 24284 tablet_bootstrap.cc:492] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: No bootstrap required, opened a new log
I20260709 12:13:05.181766 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5d631983484182a825fde0a0978a80" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:05.210799 24157 raft_consensus.cc:2393] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79c4e12b81e44dae8a76443acdf7b9c9 in current term 1: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:13:05.189612 24205 leader_election.cc:304] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:05.217965 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:05.218672 24240 raft_consensus.cc:3060] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.222316 24636 raft_consensus.cc:2804] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:13:05.222756 24206 leader_election.cc:343] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.222952 24636 raft_consensus.cc:697] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:05.223907 24636 consensus_queue.cc:237] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.232278 23982 leader_election.cc:304] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:05.213738 24205 leader_election.cc:304] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:05.236860 24661 raft_consensus.cc:2804] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:05.237274 24661 raft_consensus.cc:493] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.237592 24661 raft_consensus.cc:3060] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.241547 24240 raft_consensus.cc:2468] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 1.
I20260709 12:13:05.242723 24284 ts_tablet_manager.cc:1403] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.376s	user 0.003s	sys 0.020s
I20260709 12:13:05.245814 24661 raft_consensus.cc:515] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:05.251097 24282 tablet_bootstrap.cc:654] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.251940 24551 raft_consensus.cc:2749] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:05.254840 23983 leader_election.cc:304] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:05.257150 24629 raft_consensus.cc:2804] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.257690 24629 raft_consensus.cc:697] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:05.258292 24617 raft_consensus.cc:493] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.258914 24617 raft_consensus.cc:515] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.258632 24629 consensus_queue.cc:237] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.262038 24661 leader_election.cc:290] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:05.261693 23912 catalog_manager.cc:5697] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.266471 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:05.267230 24159 raft_consensus.cc:2468] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:05.268996 24703 raft_consensus.cc:493] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.276465 24703 raft_consensus.cc:515] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.268254 24617 leader_election.cc:290] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:05.278970 24703 leader_election.cc:290] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:05.273010 23914 catalog_manager.cc:5697] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.279551 24516 consensus_queue.cc:1048] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.267174 24284 raft_consensus.cc:359] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:05.283361 24284 raft_consensus.cc:385] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.283777 24284 raft_consensus.cc:740] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.285898 24284 consensus_queue.cc:260] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:05.286798 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:05.287514 24086 raft_consensus.cc:2468] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:05.288863 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0856b61c9894cf4b8c1c263d489820c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
W20260709 12:13:05.289125 24206 leader_election.cc:343] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.289228 24284 ts_tablet_manager.cc:1434] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 12:13:05.289517 24090 raft_consensus.cc:3060] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.292228 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0856b61c9894cf4b8c1c263d489820c" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:05.292872 24015 raft_consensus.cc:3060] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.294474 24058 leader_election.cc:304] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:05.295933 24617 raft_consensus.cc:2804] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.296321 24617 raft_consensus.cc:493] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.296661 24617 raft_consensus.cc:3060] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.298444 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:05.299125 24240 raft_consensus.cc:2468] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:05.304780 24205 leader_election.cc:304] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:05.305879 24516 raft_consensus.cc:2804] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.306412 24516 raft_consensus.cc:493] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.306757 24516 raft_consensus.cc:3060] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.315899 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:05.316673 24159 raft_consensus.cc:2468] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:05.317062 24090 raft_consensus.cc:2468] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:05.320117 24709 consensus_queue.cc:1048] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.322139 24516 raft_consensus.cc:515] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.325300 24516 leader_election.cc:290] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:05.325897 24205 leader_election.cc:304] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:05.327096 24645 raft_consensus.cc:2804] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.327641 24645 raft_consensus.cc:697] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:05.328511 24645 consensus_queue.cc:237] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:05.326783 23912 catalog_manager.cc:5697] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.340191 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:05.353116 24015 raft_consensus.cc:2468] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:05.358315 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:05.358999 24157 raft_consensus.cc:3060] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.360383 24282 tablet_bootstrap.cc:492] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:05.360944 24282 ts_tablet_manager.cc:1403] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.002s
I20260709 12:13:05.365828 24718 consensus_queue.cc:1048] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.365276 24282 raft_consensus.cc:359] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.367813 24282 raft_consensus.cc:385] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.368083 24282 raft_consensus.cc:740] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.368151 24718 consensus_queue.cc:1048] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.368834 24282 consensus_queue.cc:260] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.351264 24617 raft_consensus.cc:515] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.371011 24091 raft_consensus.cc:2393] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 in current term 2: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:13:05.376000 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:05.380697 24617 leader_election.cc:290] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:05.382364 24157 raft_consensus.cc:2468] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 2.
I20260709 12:13:05.382836 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681e0b6a8f05478181aa1dc9948e0733" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:05.384449 24282 ts_tablet_manager.cc:1434] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 12:13:05.387668 24237 raft_consensus.cc:2393] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 in current term 2: Already voted for candidate a09fd0dde7fc4241aecc9690b427e9e2 in this term.
I20260709 12:13:05.388367 24282 tablet_bootstrap.cc:492] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:05.389308 24058 leader_election.cc:304] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:05.390668 24617 raft_consensus.cc:2749] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:05.431154 24282 tablet_bootstrap.cc:654] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.437968 23913 catalog_manager.cc:5697] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 1 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.439656 24282 tablet_bootstrap.cc:492] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:05.440249 24282 ts_tablet_manager.cc:1403] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.052s	user 0.004s	sys 0.012s
I20260709 12:13:05.443856 24206 leader_election.cc:304] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:05.444897 24282 raft_consensus.cc:359] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.446993 24282 raft_consensus.cc:385] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.447199 24157 raft_consensus.cc:3060] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.447333 24282 raft_consensus.cc:740] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.448155 24282 consensus_queue.cc:260] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.450766 24282 ts_tablet_manager.cc:1434] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:13:05.452441 24282 tablet_bootstrap.cc:492] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:05.458989 24282 tablet_bootstrap.cc:654] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.473626 24718 raft_consensus.cc:2804] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.476923 24282 tablet_bootstrap.cc:492] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:05.478070 24282 ts_tablet_manager.cc:1403] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.007s
I20260709 12:13:05.479192 24718 raft_consensus.cc:697] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:05.480314 24718 consensus_queue.cc:237] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:05.480880 24282 raft_consensus.cc:359] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:05.481609 24282 raft_consensus.cc:385] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.481887 24282 raft_consensus.cc:740] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.482579 24282 consensus_queue.cc:260] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:05.484793 24282 ts_tablet_manager.cc:1434] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
W20260709 12:13:05.487988 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 44218.4us
I20260709 12:13:05.488730 24282 tablet_bootstrap.cc:492] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368: Bootstrap starting.
I20260709 12:13:05.490357 24617 consensus_queue.cc:1048] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.503495 24282 tablet_bootstrap.cc:654] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.504014 24629 consensus_queue.cc:1048] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.515654 24282 tablet_bootstrap.cc:492] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368: No bootstrap required, opened a new log
I20260709 12:13:05.516265 24282 ts_tablet_manager.cc:1403] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:13:05.522997 24282 raft_consensus.cc:359] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.523711 24282 raft_consensus.cc:385] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.523981 24282 raft_consensus.cc:740] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.524596 24282 consensus_queue.cc:260] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.533284 24282 ts_tablet_manager.cc:1434] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:13:05.571012 24458 raft_consensus.cc:493] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.571529 24458 raft_consensus.cc:515] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:05.573693 24458 leader_election.cc:290] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:05.575333 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb82c3e798f4870b3983a6831c6d557" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:05.576248 24012 raft_consensus.cc:2393] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:13:05.579694 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb82c3e798f4870b3983a6831c6d557" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:05.581281 24131 leader_election.cc:304] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:05.582607 24458 raft_consensus.cc:3060] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.633184 24645 consensus_queue.cc:1048] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.634366 24458 raft_consensus.cc:2749] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:05.639302 24704 consensus_queue.cc:1048] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.641090 24166 raft_consensus.cc:3060] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.661146 24619 consensus_queue.cc:1048] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.651844 23912 catalog_manager.cc:5697] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 0 to 2, leader changed from <none> to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.666039 24543 consensus_queue.cc:1048] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:05.679338 23963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:05.689091 24711 consensus_queue.cc:1048] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.705636 24741 raft_consensus.cc:493] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.706287 24741 raft_consensus.cc:515] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:05.709293 24741 leader_election.cc:290] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:05.711930 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:05.712975 24238 raft_consensus.cc:2393] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 1: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:13:05.733161 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:05.745736 24132 leader_election.cc:304] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:05.746935 24625 raft_consensus.cc:3060] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.753551 24711 consensus_queue.cc:1048] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.763118 24704 consensus_queue.cc:1048] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.772002 24718 consensus_queue.cc:1048] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.772285 24543 consensus_queue.cc:1048] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.783651 24711 consensus_queue.cc:1048] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.787351 24159 raft_consensus.cc:3060] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.792600 24625 raft_consensus.cc:2749] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:05.801054 24645 consensus_queue.cc:1048] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.854566 24704 consensus_queue.cc:1048] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.895736 24645 consensus_queue.cc:1048] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.902571 24709 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a09fd0dde7fc4241aecc9690b427e9e2)
I20260709 12:13:05.903159 24709 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:05.905368 24709 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:05.911056 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:05.911914 24015 raft_consensus.cc:2393] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 in current term 2: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:13:05.912101 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:05.912794 24238 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 2.
I20260709 12:13:05.915512 24058 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:05.916260 24709 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.916576 24709 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a09fd0dde7fc4241aecc9690b427e9e2)
I20260709 12:13:05.916850 24709 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.926445 24709 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:05.928529 24709 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:05.930984 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:05.936347 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:05.937275 24015 raft_consensus.cc:2393] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 in current term 2: Already voted for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in this term.
I20260709 12:13:05.941241 24092 raft_consensus.cc:1275] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer a09fd0dde7fc4241aecc9690b427e9e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:05.942940 24645 consensus_queue.cc:1048] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.956534 24237 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 2.
I20260709 12:13:05.958613 24058 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:05.959757 24709 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.960276 24709 raft_consensus.cc:697] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:05.961118 24709 consensus_queue.cc:237] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:05.965526 24157 raft_consensus.cc:1275] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer a09fd0dde7fc4241aecc9690b427e9e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:05.967546 24543 consensus_queue.cc:1048] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.016711 23913 catalog_manager.cc:5697] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.186861 24518 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.187417 24518 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:06.189281 24518 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:06.189975 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:06.190369 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:06.190742 24237 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:06.191790 23983 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:06.192624 24518 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:06.193033 24518 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.193342 24518 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:06.199597 24518 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:06.201419 24518 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:06.203007 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:06.203770 24237 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:06.203974 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:06.214141 24237 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 3.
I20260709 12:13:06.215636 23983 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:06.221766 24518 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:06.222342 24518 raft_consensus.cc:697] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:06.223588 16125 tablet_server.cc:179] TabletServer@127.15.191.65:0 shutting down...
I20260709 12:13:06.223584 24518 consensus_queue.cc:237] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:13:06.225239 24206 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:06.235548 24132 consensus_peers.cc:597] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.235843 24206 consensus_peers.cc:597] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.236495 24206 consensus_peers.cc:597] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.240928 24206 consensus_peers.cc:597] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.244350 24206 consensus_peers.cc:597] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.246989 24058 consensus_peers.cc:597] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.252669 23915 catalog_manager.cc:5697] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 2 to 3, leader changed from 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:06.287770 24132 consensus_peers.cc:597] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.290337 24058 consensus_peers.cc:597] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.296270 24206 consensus_peers.cc:597] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.301885 24058 consensus_peers.cc:597] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.302805 24206 consensus_peers.cc:597] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.304802 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:13:06.305032 24132 consensus_peers.cc:597] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.305819 16125 tablet_replica.cc:333] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.306835 16125 raft_consensus.cc:2243] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.307361 16125 raft_consensus.cc:2272] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.310940 16125 tablet_replica.cc:333] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.311865 16125 raft_consensus.cc:2243] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.312466 16125 raft_consensus.cc:2272] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:06.316114 24058 consensus_peers.cc:597] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.318224 24206 consensus_peers.cc:597] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.319375 16125 tablet_replica.cc:333] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.320052 16125 raft_consensus.cc:2243] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.320559 16125 raft_consensus.cc:2272] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.323076 16125 tablet_replica.cc:333] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.323704 16125 raft_consensus.cc:2243] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.324105 16125 raft_consensus.cc:2272] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.326435 16125 tablet_replica.cc:333] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.327085 16125 raft_consensus.cc:2243] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.327536 16125 raft_consensus.cc:2272] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.330255 16125 tablet_replica.cc:333] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.331022 16125 raft_consensus.cc:2243] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:06.331451 24058 consensus_peers.cc:597] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.332027 16125 raft_consensus.cc:2272] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:06.333921 24206 consensus_peers.cc:597] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.334472 16125 tablet_replica.cc:333] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.335110 16125 raft_consensus.cc:2243] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.335542 16125 raft_consensus.cc:2272] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.337352 16125 tablet_replica.cc:333] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.338162 16125 raft_consensus.cc:2243] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.339012 16125 raft_consensus.cc:2272] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.341143 16125 tablet_replica.cc:333] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.341768 16125 raft_consensus.cc:2243] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.342547 16125 raft_consensus.cc:2272] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.344449 16125 tablet_replica.cc:333] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.345168 16125 raft_consensus.cc:2243] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.345679 16125 raft_consensus.cc:2272] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:06.347321 24058 consensus_peers.cc:597] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.348037 16125 tablet_replica.cc:333] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.348678 16125 raft_consensus.cc:2243] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.349185 16125 raft_consensus.cc:2272] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.351372 16125 tablet_replica.cc:333] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.352197 16125 raft_consensus.cc:2243] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.352707 16125 raft_consensus.cc:2272] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.355137 16125 tablet_replica.cc:333] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.355919 16125 raft_consensus.cc:2243] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.356433 16125 raft_consensus.cc:2272] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.358851 16125 tablet_replica.cc:333] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.359776 16125 raft_consensus.cc:2243] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.360961 16125 raft_consensus.cc:2272] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:06.362795 24058 consensus_peers.cc:597] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.363587 16125 tablet_replica.cc:333] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.364342 16125 raft_consensus.cc:2243] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.364780 16125 raft_consensus.cc:2272] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.366921 16125 tablet_replica.cc:333] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.367511 16125 raft_consensus.cc:2243] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.368331 16125 raft_consensus.cc:2272] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.370913 16125 tablet_replica.cc:333] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.371776 16125 raft_consensus.cc:2243] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.372292 16125 raft_consensus.cc:2272] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.374310 16125 tablet_replica.cc:333] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.374938 16125 raft_consensus.cc:2243] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.375742 16125 raft_consensus.cc:2272] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.378306 16125 tablet_replica.cc:333] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.378964 16125 raft_consensus.cc:2243] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.379870 16125 raft_consensus.cc:2272] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.382062 16125 tablet_replica.cc:333] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.382701 16125 raft_consensus.cc:2243] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.383412 16125 pending_rounds.cc:70] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Trying to abort 1 pending ops.
I20260709 12:13:06.383627 16125 pending_rounds.cc:77] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7305622266787790848 op_type: NO_OP noop_request { }
I20260709 12:13:06.383924 16125 raft_consensus.cc:2889] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:06.384217 16125 raft_consensus.cc:2272] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.386360 16125 tablet_replica.cc:333] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.386979 16125 raft_consensus.cc:2243] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.387427 16125 raft_consensus.cc:2272] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.389474 16125 tablet_replica.cc:333] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.390296 16125 raft_consensus.cc:2243] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.390749 16125 raft_consensus.cc:2272] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.392869 16125 tablet_replica.cc:333] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.393479 16125 raft_consensus.cc:2243] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.394491 16125 raft_consensus.cc:2272] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.397007 16125 tablet_replica.cc:333] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.397670 16125 raft_consensus.cc:2243] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.398082 16125 raft_consensus.cc:2272] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.400131 16125 tablet_replica.cc:333] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.400719 16125 raft_consensus.cc:2243] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.401594 16125 raft_consensus.cc:2272] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.404289 16125 tablet_replica.cc:333] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.405125 16125 raft_consensus.cc:2243] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:06.405284 24132 consensus_peers.cc:597] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.405666 16125 raft_consensus.cc:2272] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.408016 16125 tablet_replica.cc:333] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.408856 16125 raft_consensus.cc:2243] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.409147 24237 raft_consensus.cc:1240] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Rejecting Update request from peer 7beb24294eb94c1c8cf7659b8c507b46 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:06.409375 16125 raft_consensus.cc:2272] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.411129 24711 consensus_queue.cc:1059] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.412055 24709 raft_consensus.cc:3055] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:06.412381 24709 raft_consensus.cc:740] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:06.412474 16125 tablet_replica.cc:333] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.413055 24709 consensus_queue.cc:260] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:06.413385 16125 raft_consensus.cc:2243] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.414122 16125 raft_consensus.cc:2272] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.414178 24709 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:06.416307 24206 consensus_peers.cc:597] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.416836 16125 tablet_replica.cc:333] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.417520 16125 raft_consensus.cc:2243] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.418089 16125 raft_consensus.cc:2272] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.420980 16125 tablet_replica.cc:333] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.421746 16125 raft_consensus.cc:2243] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.422542 16125 raft_consensus.cc:2272] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.424646 16125 tablet_replica.cc:333] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.425236 16125 raft_consensus.cc:2243] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.425710 16125 raft_consensus.cc:2272] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.427791 16125 tablet_replica.cc:333] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.428306 16125 raft_consensus.cc:2243] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.429090 16125 raft_consensus.cc:2272] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.431205 16125 tablet_replica.cc:333] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.431895 16125 raft_consensus.cc:2243] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.432448 16125 raft_consensus.cc:2272] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.434955 16125 tablet_replica.cc:333] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.435573 16125 raft_consensus.cc:2243] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.436035 16125 raft_consensus.cc:2272] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.438160 16125 tablet_replica.cc:333] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.438786 16125 raft_consensus.cc:2243] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.439256 16125 raft_consensus.cc:2272] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.441612 16125 tablet_replica.cc:333] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.442201 16125 raft_consensus.cc:2243] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.442690 16125 raft_consensus.cc:2272] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.445003 16125 tablet_replica.cc:333] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.445561 16125 raft_consensus.cc:2243] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.446360 16125 raft_consensus.cc:2272] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.448300 16125 tablet_replica.cc:333] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.448839 16125 raft_consensus.cc:2243] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.449608 16125 raft_consensus.cc:2272] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.451542 16125 tablet_replica.cc:333] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.452088 16125 raft_consensus.cc:2243] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.452900 16125 raft_consensus.cc:2272] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.455394 16125 tablet_replica.cc:333] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.456178 16125 raft_consensus.cc:2243] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:06.456257 24206 consensus_peers.cc:597] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.457201 16125 raft_consensus.cc:2272] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.460038 16125 tablet_replica.cc:333] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.460817 16125 raft_consensus.cc:2243] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.461377 16125 raft_consensus.cc:2272] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.463402 16125 tablet_replica.cc:333] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.464061 16125 raft_consensus.cc:2243] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.464515 16125 raft_consensus.cc:2272] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.466549 16125 tablet_replica.cc:333] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.467198 16125 raft_consensus.cc:2243] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.467662 16125 raft_consensus.cc:2272] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.469921 16125 tablet_replica.cc:333] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.470717 16125 raft_consensus.cc:2243] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.471144 16125 raft_consensus.cc:2272] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.472913 16125 tablet_replica.cc:333] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: stopping tablet replica
I20260709 12:13:06.473378 16125 raft_consensus.cc:2243] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:06.474414 16125 raft_consensus.cc:2272] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.554570 16125 tablet_server.cc:196] TabletServer@127.15.191.65:0 shutdown complete.
W20260709 12:13:06.558734 24206 consensus_peers.cc:597] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.606601 24132 consensus_peers.cc:597] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.607609 24058 consensus_peers.cc:597] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.608166 24058 consensus_peers.cc:597] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.609974 24206 consensus_peers.cc:597] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.624019 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:06.631719 24206 consensus_peers.cc:597] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.633929 24763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:06.639875 24762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:06.647687 24765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:06.648092 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:06.654229 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:06.654561 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:06.654803 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599186654782 us; error 0 us; skew 500 ppm
I20260709 12:13:06.655581 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:13:06.658635 24206 consensus_peers.cc:597] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.659420 16125 webserver.cc:533] Webserver started at http://127.15.191.65:37079/ using document root <none> and password file <none>
I20260709 12:13:06.660101 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:06.660347 16125 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:13:06.664510 16125 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
W20260709 12:13:06.669054 24206 consensus_peers.cc:597] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.673154 24771 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:06.674185 16125 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:13:06.674564 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-1sdq"
I20260709 12:13:06.674971 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:06.705981 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:06.707711 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:06.709681 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:06.715157 24778 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:13:07.013139 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:13:07.013516 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.300s	user 0.010s	sys 0.000s
I20260709 12:13:07.013872 16125 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:13:07.030479 24778 tablet_bootstrap.cc:492] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.047170 24778 tablet_bootstrap.cc:492] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.048161 24778 tablet_bootstrap.cc:492] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.048772 24778 ts_tablet_manager.cc:1403] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:13:07.051112 24778 raft_consensus.cc:359] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.051689 24778 raft_consensus.cc:740] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.052299 24778 consensus_queue.cc:260] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.054311 24778 ts_tablet_manager.cc:1434] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:13:07.055034 24778 tablet_bootstrap.cc:492] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.069644 24778 tablet_bootstrap.cc:492] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.070734 24778 tablet_bootstrap.cc:492] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.071450 24778 ts_tablet_manager.cc:1403] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:13:07.073993 24778 raft_consensus.cc:359] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:07.074699 24778 raft_consensus.cc:740] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.075350 24778 consensus_queue.cc:260] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:07.077140 24778 ts_tablet_manager.cc:1434] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:13:07.077939 24778 tablet_bootstrap.cc:492] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.095140 24778 tablet_bootstrap.cc:492] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.096040 24778 tablet_bootstrap.cc:492] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.096578 24778 ts_tablet_manager.cc:1403] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:13:07.098395 24778 raft_consensus.cc:359] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.098894 24778 raft_consensus.cc:740] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.099471 24778 consensus_queue.cc:260] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.100962 24778 ts_tablet_manager.cc:1434] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:13:07.101596 24778 tablet_bootstrap.cc:492] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.119428 24778 tablet_bootstrap.cc:492] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:07.120437 24778 tablet_bootstrap.cc:492] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.121078 24778 ts_tablet_manager.cc:1403] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:13:07.123509 24778 raft_consensus.cc:359] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.124356 24778 raft_consensus.cc:740] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.125041 24778 consensus_queue.cc:260] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.126484 24778 ts_tablet_manager.cc:1434] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:13:07.127241 24778 tablet_bootstrap.cc:492] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.139146 24778 tablet_bootstrap.cc:492] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.139865 24778 tablet_bootstrap.cc:492] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.140364 24778 ts_tablet_manager.cc:1403] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:13:07.142403 24778 raft_consensus.cc:359] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.142920 24778 raft_consensus.cc:740] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.143455 24778 consensus_queue.cc:260] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.145031 24778 ts_tablet_manager.cc:1434] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:07.145728 24778 tablet_bootstrap.cc:492] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.159884 24778 tablet_bootstrap.cc:492] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.160729 24778 tablet_bootstrap.cc:492] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.161233 24778 ts_tablet_manager.cc:1403] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 12:13:07.163041 24778 raft_consensus.cc:359] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.163559 24778 raft_consensus.cc:740] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.164113 24778 consensus_queue.cc:260] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.165596 24778 ts_tablet_manager.cc:1434] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:07.166258 24778 tablet_bootstrap.cc:492] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.177199 24778 tablet_bootstrap.cc:492] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.177915 24778 tablet_bootstrap.cc:492] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.178452 24778 ts_tablet_manager.cc:1403] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 12:13:07.180303 24778 raft_consensus.cc:359] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.180819 24778 raft_consensus.cc:740] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.181373 24778 consensus_queue.cc:260] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.182893 24778 ts_tablet_manager.cc:1434] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:07.183554 24778 tablet_bootstrap.cc:492] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.196331 24778 tablet_bootstrap.cc:492] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.198165 24778 tablet_bootstrap.cc:492] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.198850 24778 ts_tablet_manager.cc:1403] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:13:07.201005 24778 raft_consensus.cc:359] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.201704 24778 raft_consensus.cc:740] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.202340 24778 consensus_queue.cc:260] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.203805 24778 ts_tablet_manager.cc:1434] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:13:07.204438 24778 tablet_bootstrap.cc:492] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.219259 24778 tablet_bootstrap.cc:492] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.220166 24778 tablet_bootstrap.cc:492] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.220839 24778 ts_tablet_manager.cc:1403] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:13:07.222935 24778 raft_consensus.cc:359] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.223539 24778 raft_consensus.cc:740] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.224140 24778 consensus_queue.cc:260] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.225620 24778 ts_tablet_manager.cc:1434] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:13:07.226271 24778 tablet_bootstrap.cc:492] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.237881 24778 tablet_bootstrap.cc:492] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.238711 24778 tablet_bootstrap.cc:492] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.239298 24778 ts_tablet_manager.cc:1403] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:13:07.241412 24778 raft_consensus.cc:359] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.241899 24778 raft_consensus.cc:740] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.242512 24778 consensus_queue.cc:260] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.243994 24778 ts_tablet_manager.cc:1434] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:07.244642 24778 tablet_bootstrap.cc:492] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.258873 24778 tablet_bootstrap.cc:492] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.259783 24778 tablet_bootstrap.cc:492] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.260414 24778 ts_tablet_manager.cc:1403] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:13:07.260970 16125 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:13:07.261335 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.247s	user 0.228s	sys 0.004s
I20260709 12:13:07.262809 24778 raft_consensus.cc:359] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.263617 24778 raft_consensus.cc:740] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.264371 24778 consensus_queue.cc:260] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.266479 24778 ts_tablet_manager.cc:1434] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:07.267311 24778 tablet_bootstrap.cc:492] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.322781 24778 tablet_bootstrap.cc:492] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.323616 24778 tablet_bootstrap.cc:492] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.324186 24778 ts_tablet_manager.cc:1403] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.012s
I20260709 12:13:07.326314 24778 raft_consensus.cc:359] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.326961 24778 raft_consensus.cc:740] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.327625 24778 consensus_queue.cc:260] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.329180 24778 ts_tablet_manager.cc:1434] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:07.329967 24778 tablet_bootstrap.cc:492] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.347237 24778 tablet_bootstrap.cc:492] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.347958 24778 tablet_bootstrap.cc:492] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.348608 24778 ts_tablet_manager.cc:1403] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:13:07.351192 24778 raft_consensus.cc:359] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.351863 24778 raft_consensus.cc:740] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.352629 24778 consensus_queue.cc:260] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.354292 24778 ts_tablet_manager.cc:1434] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:13:07.355033 24778 tablet_bootstrap.cc:492] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.361286 24636 raft_consensus.cc:493] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.362022 24636 raft_consensus.cc:515] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.364390 24636 leader_election.cc:290] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.365728 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
W20260709 12:13:07.372735 24206 leader_election.cc:336] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111)
I20260709 12:13:07.373337 24206 leader_election.cc:304] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:07.374161 24636 raft_consensus.cc:2749] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:07.374321 24778 tablet_bootstrap.cc:492] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.375483 24778 tablet_bootstrap.cc:492] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.376232 24778 ts_tablet_manager.cc:1403] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:13:07.378881 24778 raft_consensus.cc:359] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.379604 24778 raft_consensus.cc:740] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.380333 24778 consensus_queue.cc:260] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.382745 24778 ts_tablet_manager.cc:1434] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:07.383706 24778 tablet_bootstrap.cc:492] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.388932 24780 raft_consensus.cc:493] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.389600 24780 raft_consensus.cc:515] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.391584 24780 leader_election.cc:290] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.395685 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:13:07.396780 24132 leader_election.cc:336] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111)
I20260709 12:13:07.398445 24131 leader_election.cc:304] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:07.399992 24780 raft_consensus.cc:2749] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:07.407217 24778 tablet_bootstrap.cc:492] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.408397 24778 tablet_bootstrap.cc:492] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.409150 24778 ts_tablet_manager.cc:1403] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.003s
I20260709 12:13:07.412322 24778 raft_consensus.cc:359] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.413092 24778 raft_consensus.cc:740] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.413758 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:39103
I20260709 12:13:07.413883 24853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:39103 every 8 connection(s)
I20260709 12:13:07.413861 24778 consensus_queue.cc:260] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.416280 24778 ts_tablet_manager.cc:1434] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:07.417191 24778 tablet_bootstrap.cc:492] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.441706 24778 tablet_bootstrap.cc:492] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.442808 24778 tablet_bootstrap.cc:492] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.443641 24778 ts_tablet_manager.cc:1403] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.004s
I20260709 12:13:07.446529 24778 raft_consensus.cc:359] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.447281 24778 raft_consensus.cc:740] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.447981 24778 consensus_queue.cc:260] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.450228 24778 ts_tablet_manager.cc:1434] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:07.451170 24778 tablet_bootstrap.cc:492] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.466760 24780 raft_consensus.cc:493] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.467360 24780 raft_consensus.cc:515] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.469568 24780 leader_election.cc:290] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.473665 24780 raft_consensus.cc:493] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.474314 24778 tablet_bootstrap.cc:492] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.474205 24780 raft_consensus.cc:515] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.475445 24778 tablet_bootstrap.cc:492] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.476225 24778 ts_tablet_manager.cc:1403] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 12:13:07.476729 24780 leader_election.cc:290] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.478986 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:07.479558 24778 raft_consensus.cc:359] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.480367 24778 raft_consensus.cc:740] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.481041 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:07.481336 24778 consensus_queue.cc:260] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.484009 24778 ts_tablet_manager.cc:1434] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:07.484995 24778 tablet_bootstrap.cc:492] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.507169 24778 tablet_bootstrap.cc:492] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.508087 24778 tablet_bootstrap.cc:492] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.508736 24778 ts_tablet_manager.cc:1403] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.006s
I20260709 12:13:07.511287 24778 raft_consensus.cc:359] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.511988 24778 raft_consensus.cc:740] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.512732 24778 consensus_queue.cc:260] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.514750 24854 heartbeater.cc:344] Connected to a master server at 127.15.191.126:35665
I20260709 12:13:07.514882 24778 ts_tablet_manager.cc:1434] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:13:07.515319 24854 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:07.515789 24778 tablet_bootstrap.cc:492] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.516314 24854 heartbeater.cc:507] Master 127.15.191.126:35665 requested a full tablet report, sending...
I20260709 12:13:07.520766 24636 raft_consensus.cc:493] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.521354 24636 raft_consensus.cc:515] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.522768 24780 raft_consensus.cc:493] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.523329 24780 raft_consensus.cc:515] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.525369 24636 leader_election.cc:290] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.527082 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.527841 24159 raft_consensus.cc:2468] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:07.529155 24206 leader_election.cc:304] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:07.534703 24645 raft_consensus.cc:2804] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.535142 24645 raft_consensus.cc:493] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.535511 24645 raft_consensus.cc:3060] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.537600 24779 raft_consensus.cc:493] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.538206 24779 raft_consensus.cc:515] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.540725 24516 raft_consensus.cc:493] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.541250 24516 raft_consensus.cc:515] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.541989 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:07.542387 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:07.542667 24237 raft_consensus.cc:2468] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:07.543064 24238 raft_consensus.cc:2468] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:07.544018 24825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.525431 24780 leader_election.cc:290] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.544798 24780 raft_consensus.cc:493] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.545298 24780 raft_consensus.cc:515] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.547421 24780 leader_election.cc:290] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.544708 24825 raft_consensus.cc:2468] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:07.548837 24781 raft_consensus.cc:493] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.549377 24781 raft_consensus.cc:515] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.550153 24132 leader_election.cc:304] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:07.550531 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.551275 24823 raft_consensus.cc:2468] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:07.552210 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:07.552974 24132 leader_election.cc:304] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:07.553601 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.554241 24824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.554414 24823 raft_consensus.cc:2468] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:07.545341 24827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.556138 24780 raft_consensus.cc:2804] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.556565 24780 raft_consensus.cc:493] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.556931 24780 raft_consensus.cc:3060] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.556840 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.557232 24825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.543172 24516 leader_election.cc:290] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.558810 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.540282 24779 leader_election.cc:290] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.554354 24458 raft_consensus.cc:2804] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.560492 24458 raft_consensus.cc:493] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.560849 24458 raft_consensus.cc:3060] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.562740 24645 raft_consensus.cc:515] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.564613 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.565287 24823 raft_consensus.cc:2468] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:07.566380 24058 leader_election.cc:304] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:07.570505 24711 raft_consensus.cc:2804] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.570910 24711 raft_consensus.cc:493] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.571269 24711 raft_consensus.cc:3060] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.578311 24778 tablet_bootstrap.cc:492] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.578728 24825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.579324 24778 tablet_bootstrap.cc:492] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.551542 24781 leader_election.cc:290] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.580094 24778 ts_tablet_manager.cc:1403] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.012s
I20260709 12:13:07.583050 24778 raft_consensus.cc:359] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.583760 24778 raft_consensus.cc:740] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.583279 24458 raft_consensus.cc:515] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.584637 24778 consensus_queue.cc:260] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.554229 24132 leader_election.cc:304] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:07.586051 24779 raft_consensus.cc:493] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.586699 24779 raft_consensus.cc:515] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.587318 24778 ts_tablet_manager.cc:1434] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:07.588191 24778 tablet_bootstrap.cc:492] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.585207 24157 raft_consensus.cc:2393] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 in current term 2: Already voted for candidate 64549835910a439993d28800bb571368 in this term.
I20260709 12:13:07.593056 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:07.595676 23915 ts_manager.cc:194] Re-registered known tserver with Master: 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
W20260709 12:13:07.600483 24206 leader_election.cc:343] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.600708 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:07.601033 24206 leader_election.cc:304] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:07.601476 24157 raft_consensus.cc:3060] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.591141 24645 leader_election.cc:290] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.602619 24543 raft_consensus.cc:3060] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.606765 24781 raft_consensus.cc:493] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.610662 24825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd67df6137e94222b5862ed8999d37cc" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:07.611454 24779 leader_election.cc:290] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.611310 24780 raft_consensus.cc:515] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.607450 24781 raft_consensus.cc:515] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.612826 24709 raft_consensus.cc:493] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.614912 24709 raft_consensus.cc:515] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.615363 24827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:07.616703 24058 leader_election.cc:343] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.585314 24711 raft_consensus.cc:515] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.611361 24825 raft_consensus.cc:3060] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.620393 24711 leader_election.cc:290] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.621398 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:07.622015 24823 raft_consensus.cc:3060] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.622087 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.623320 24780 leader_election.cc:290] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.623498 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:07.617962 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.627447 24058 leader_election.cc:304] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:07.628712 24711 raft_consensus.cc:2749] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:07.629973 24781 leader_election.cc:290] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.630514 24827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:07.631991 24058 leader_election.cc:343] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.619586 24709 leader_election.cc:290] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.632427 24058 leader_election.cc:304] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:07.634117 24709 raft_consensus.cc:2749] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:07.635895 24781 raft_consensus.cc:493] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.636432 24781 raft_consensus.cc:515] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.639333 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:07.640890 24823 raft_consensus.cc:2468] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 2.
I20260709 12:13:07.642282 24058 leader_election.cc:304] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:07.643390 24709 raft_consensus.cc:2804] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:07.643869 24709 raft_consensus.cc:697] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:07.644685 24709 consensus_queue.cc:237] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
W20260709 12:13:07.645726 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 45278us
I20260709 12:13:07.647109 24543 raft_consensus.cc:2749] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:07.651366 24458 leader_election.cc:290] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.653483 24781 leader_election.cc:290] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.657963 24157 raft_consensus.cc:2468] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 2.
I20260709 12:13:07.658646 24779 raft_consensus.cc:2764] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:13:07.662516 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 108349us
I20260709 12:13:07.663651 24781 raft_consensus.cc:493] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.664270 24781 raft_consensus.cc:515] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
W20260709 12:13:07.664877 24132 leader_election.cc:343] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.665946 24132 leader_election.cc:304] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:07.666507 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:07.668812 24058 leader_election.cc:343] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.670863 24779 raft_consensus.cc:2804] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.671743 24058 leader_election.cc:304] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:07.670365 24827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
W20260709 12:13:07.672678 24132 leader_election.cc:343] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.669504 24206 leader_election.cc:304] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:07.671801 24779 raft_consensus.cc:493] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.673403 24779 raft_consensus.cc:3060] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.671316 23915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38286
I20260709 12:13:07.672817 24711 raft_consensus.cc:2749] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:07.675556 24543 raft_consensus.cc:2804] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:07.675941 24132 leader_election.cc:304] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:07.667860 24781 leader_election.cc:290] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.718955 24543 raft_consensus.cc:697] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:07.724869 24865 raft_consensus.cc:493] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.725538 24865 raft_consensus.cc:515] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.727640 24865 leader_election.cc:290] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.728427 24779 raft_consensus.cc:515] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.730445 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.731271 24157 raft_consensus.cc:2468] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:07.720185 24543 consensus_queue.cc:237] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.742774 24779 leader_election.cc:290] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.744920 24779 raft_consensus.cc:493] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.745198 24780 raft_consensus.cc:2749] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:07.746713 24780 raft_consensus.cc:493] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.746239 24779 raft_consensus.cc:515] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.747349 24780 raft_consensus.cc:515] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.743637 24458 raft_consensus.cc:493] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.754829 24458 raft_consensus.cc:515] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.757055 24458 leader_election.cc:290] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.766860 24825 raft_consensus.cc:2468] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 2.
I20260709 12:13:07.769744 24780 leader_election.cc:290] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.771209 24779 leader_election.cc:290] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.781919 24711 raft_consensus.cc:493] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.782606 24711 raft_consensus.cc:515] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.783480 23915 catalog_manager.cc:5697] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.784652 24711 leader_election.cc:290] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
W20260709 12:13:07.786710 24058 leader_election.cc:343] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.789512 24781 raft_consensus.cc:493] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.790341 24854 heartbeater.cc:499] Master 127.15.191.126:35665 was elected leader, sending a full tablet report...
I20260709 12:13:07.790200 24781 raft_consensus.cc:515] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.792711 24781 leader_election.cc:290] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.795866 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.796875 24823 raft_consensus.cc:2468] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:07.803041 24058 leader_election.cc:304] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:07.804265 24781 raft_consensus.cc:2804] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.804142 24827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.804984 24827 raft_consensus.cc:2468] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:07.805776 24781 raft_consensus.cc:493] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.805953 24778 tablet_bootstrap.cc:492] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.806372 24781 raft_consensus.cc:3060] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.806627 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.807008 24778 tablet_bootstrap.cc:492] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.807758 24778 ts_tablet_manager.cc:1403] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.220s	user 0.090s	sys 0.104s
I20260709 12:13:07.808594 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.809765 24711 raft_consensus.cc:493] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.810339 24711 raft_consensus.cc:515] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.810443 24778 raft_consensus.cc:359] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.811196 24778 raft_consensus.cc:740] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.812008 24709 raft_consensus.cc:493] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.811859 24778 consensus_queue.cc:260] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.812438 24711 leader_election.cc:290] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.812675 24709 raft_consensus.cc:515] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.814246 24778 ts_tablet_manager.cc:1434] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:07.814257 24516 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.815047 24709 leader_election.cc:290] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.814880 24516 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:13:07.816613 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 143974us
W20260709 12:13:07.817305 24132 leader_election.cc:343] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.816778 24516 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.815235 24778 tablet_bootstrap.cc:492] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.821368 24827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:07.820917 23912 catalog_manager.cc:5697] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.822006 24827 raft_consensus.cc:3060] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.822968 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.823704 24157 raft_consensus.cc:2393] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 in current term 2: Already voted for candidate 64549835910a439993d28800bb571368 in this term.
I20260709 12:13:07.826014 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.811868 24871 raft_consensus.cc:493] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.829829 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:07.829015 24871 raft_consensus.cc:515] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.830989 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:07.832228 24088 raft_consensus.cc:2468] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:07.826762 24823 raft_consensus.cc:2468] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:07.837198 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:07.845381 24824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.838593 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.843039 24778 tablet_bootstrap.cc:492] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.846530 24157 raft_consensus.cc:2468] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:07.847417 24778 tablet_bootstrap.cc:492] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.839547 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:07.848080 24159 raft_consensus.cc:2468] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:07.848215 24778 ts_tablet_manager.cc:1403] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.004s
I20260709 12:13:07.844229 24131 leader_election.cc:304] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:07.835275 24871 leader_election.cc:290] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.849862 24779 raft_consensus.cc:2804] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.850293 24779 raft_consensus.cc:493] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.850654 24779 raft_consensus.cc:3060] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.850890 24778 raft_consensus.cc:359] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.851552 24778 raft_consensus.cc:740] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.852244 24778 consensus_queue.cc:260] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.854346 24778 ts_tablet_manager.cc:1434] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:07.856191 24778 tablet_bootstrap.cc:492] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.844034 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.860318 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:07.861263 24088 raft_consensus.cc:2410] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:07.862630 24827 raft_consensus.cc:2468] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:07.864858 24781 raft_consensus.cc:515] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.868621 24781 leader_election.cc:290] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.866237 24636 raft_consensus.cc:493] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.869244 24636 raft_consensus.cc:515] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.871272 24636 leader_election.cc:290] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.866573 24058 leader_election.cc:304] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:07.871867 24874 raft_consensus.cc:493] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.863039 24779 raft_consensus.cc:515] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.872443 24874 raft_consensus.cc:515] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:07.874284 24779 leader_election.cc:290] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.874831 24709 raft_consensus.cc:2804] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.875267 24874 leader_election.cc:290] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.876070 24709 raft_consensus.cc:493] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.877466 24709 raft_consensus.cc:3060] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.877544 24778 tablet_bootstrap.cc:492] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.875849 24058 leader_election.cc:304] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:07.878703 24778 tablet_bootstrap.cc:492] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.879446 24778 ts_tablet_manager.cc:1403] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:13:07.879236 24058 leader_election.cc:304] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:07.880400 24711 raft_consensus.cc:2804] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.880770 24711 raft_consensus.cc:493] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.881117 24711 raft_consensus.cc:3060] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.819552 24825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.882215 24778 raft_consensus.cc:359] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.882920 24778 raft_consensus.cc:740] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.883760 24778 consensus_queue.cc:260] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.885401 24709 raft_consensus.cc:515] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.886204 24778 ts_tablet_manager.cc:1434] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:07.888695 24778 tablet_bootstrap.cc:492] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.889427 24709 leader_election.cc:290] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.889784 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:07.890172 24709 raft_consensus.cc:2804] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.890508 24823 raft_consensus.cc:3060] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.890655 24709 raft_consensus.cc:493] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.891136 24709 raft_consensus.cc:3060] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.893414 24058 leader_election.cc:304] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:07.886618 24827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.894151 24876 raft_consensus.cc:2804] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:07.894505 24058 leader_election.cc:343] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.894716 24827 raft_consensus.cc:2410] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:07.894624 24876 raft_consensus.cc:493] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.895763 24876 raft_consensus.cc:3060] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.895285 24711 raft_consensus.cc:515] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.898533 24825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
W20260709 12:13:07.898926 24058 leader_election.cc:343] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.858285 24869 raft_consensus.cc:493] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.902753 24869 raft_consensus.cc:515] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.905105 24869 leader_election.cc:290] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.907208 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dc51b1981640db8864178385eb2de3" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:07.907948 24238 raft_consensus.cc:3060] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.909611 24827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:07.911070 24781 raft_consensus.cc:493] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.911361 24778 tablet_bootstrap.cc:492] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.911365 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:07.911653 24781 raft_consensus.cc:515] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.912127 24088 raft_consensus.cc:2468] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:07.912587 24778 tablet_bootstrap.cc:492] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:07.913309 24778 ts_tablet_manager.cc:1403] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 12:13:07.915074 24781 leader_election.cc:290] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.915853 24778 raft_consensus.cc:359] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.916603 24778 raft_consensus.cc:740] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.917436 24778 consensus_queue.cc:260] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.918478 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:07.919131 24159 raft_consensus.cc:3060] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.919806 24778 ts_tablet_manager.cc:1434] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:07.920698 24778 tablet_bootstrap.cc:492] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:07.923942 24826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.924903 24824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.920501 24205 leader_election.cc:304] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:07.931063 24874 raft_consensus.cc:2804] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:07.932828 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255ee2f56d7d4b8fa52384cf5cb1def8" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:07.935521 24239 raft_consensus.cc:3060] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.931813 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c9cc57f4f24208a3b0775820818bad" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:07.941182 24238 raft_consensus.cc:2468] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:07.943990 24825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:07.945271 24159 raft_consensus.cc:2468] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 2.
I20260709 12:13:07.945974 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b860e1a11c0242ad8dae706485a5419b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:07.946614 24157 raft_consensus.cc:3060] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.951283 24709 raft_consensus.cc:515] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.952276 24239 raft_consensus.cc:2468] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:07.953477 24709 leader_election.cc:290] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.955545 24237 raft_consensus.cc:2468] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:07.931471 24874 raft_consensus.cc:493] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.958422 24874 raft_consensus.cc:3060] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.964557 24206 leader_election.cc:304] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:07.965399 24636 raft_consensus.cc:2764] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:07.967010 24824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436b14790f4a4768ae4f66430c025d3b" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.967893 24824 raft_consensus.cc:2393] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 2: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:13:07.968027 24781 raft_consensus.cc:493] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.968326 24826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.968783 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:07.969038 24826 raft_consensus.cc:2468] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:07.956079 24157 raft_consensus.cc:2468] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 2.
I20260709 12:13:07.972373 24871 raft_consensus.cc:493] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.972973 24871 raft_consensus.cc:515] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.973585 24826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:07.975831 24871 leader_election.cc:290] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.976572 24709 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.958144 24876 raft_consensus.cc:515] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.977293 24709 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.977880 24092 raft_consensus.cc:2393] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 2: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:13:07.979420 24709 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:07.980376 24876 leader_election.cc:290] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.904192 24711 leader_election.cc:290] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:07.973016 24822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:07.982678 24822 raft_consensus.cc:2468] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:07.975455 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c60f2ad0a90425db97febd2ea86c08a" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:07.983857 24088 raft_consensus.cc:3060] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.977152 24823 raft_consensus.cc:2468] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:07.989526 24869 raft_consensus.cc:493] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:07.990236 24869 raft_consensus.cc:515] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.991191 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:07.991859 24237 raft_consensus.cc:2468] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:07.992403 24869 leader_election.cc:290] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:07.994196 24132 leader_election.cc:304] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:07.995433 24206 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:07.995692 24088 raft_consensus.cc:2468] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:07.997108 24869 raft_consensus.cc:2804] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:07.997653 24869 raft_consensus.cc:697] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:07.997862 24874 raft_consensus.cc:515] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:07.968603 24781 raft_consensus.cc:515] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:07.998553 24869 consensus_queue.cc:237] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:08.000233 24781 leader_election.cc:290] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:08.003260 24874 leader_election.cc:290] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:08.003870 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.004515 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7559f65287ff4852a45d740197ae4aba" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:08.004927 24132 leader_election.cc:304] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:08.005102 24157 raft_consensus.cc:3060] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.005777 24869 raft_consensus.cc:2804] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.007232 24636 raft_consensus.cc:2749] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:08.010144 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:08.005928 24132 leader_election.cc:304] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:08.010594 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:08.010986 24822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:08.011484 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:08.011758 24822 raft_consensus.cc:2468] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:08.012346 24132 leader_election.cc:304] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:08.012104 24779 raft_consensus.cc:2804] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.011647 24088 raft_consensus.cc:3060] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:08.017048 24132 leader_election.cc:343] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.012163 24164 raft_consensus.cc:2468] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:08.024219 24636 raft_consensus.cc:493] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:08.023484 24132 leader_election.cc:304] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:08.022696 23912 catalog_manager.cc:5697] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.023304 24157 raft_consensus.cc:2468] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 2.
W20260709 12:13:08.042943 24206 leader_election.cc:343] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.044021 24206 leader_election.cc:304] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:08.021566 24779 raft_consensus.cc:697] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:08.045782 24779 consensus_queue.cc:237] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:08.046645 24516 raft_consensus.cc:2804] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:08.047079 24516 raft_consensus.cc:493] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:08.047426 24516 raft_consensus.cc:3060] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:08.048157 24132 leader_election.cc:343] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:08.049227 24132 leader_election.cc:343] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:08.049906 24132 leader_election.cc:343] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.050246 24132 leader_election.cc:304] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:08.050343 24636 raft_consensus.cc:515] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.051312 24132 leader_election.cc:304] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
W20260709 12:13:08.052865 24132 leader_election.cc:343] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.053383 24132 leader_election.cc:304] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:08.054652 24458 raft_consensus.cc:2804] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:08.055047 24458 raft_consensus.cc:493] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:08.055372 24458 raft_consensus.cc:3060] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.006599 24869 raft_consensus.cc:697] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:08.053862 24780 raft_consensus.cc:2749] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:08.054263 24822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24d61e68c14dc19d3ad5de5931d613" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.057545 24866 raft_consensus.cc:3060] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.057861 24870 raft_consensus.cc:2749] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:08.070550 24824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:08.071290 24824 raft_consensus.cc:2468] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:08.073464 24636 leader_election.cc:290] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:08.074301 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:08.074947 24165 raft_consensus.cc:3060] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.033972 24871 raft_consensus.cc:2804] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:08.076417 24132 leader_election.cc:304] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:08.083426 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368" is_pre_election: true
I20260709 12:13:08.084206 24157 raft_consensus.cc:2468] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
W20260709 12:13:08.082206 24206 leader_election.cc:343] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.086618 24165 raft_consensus.cc:2468] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 2.
I20260709 12:13:08.089207 24458 raft_consensus.cc:515] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
W20260709 12:13:08.086292 24058 leader_election.cc:343] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:08.091339 24058 leader_election.cc:343] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:08.092006 24058 leader_election.cc:343] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.095646 24458 leader_election.cc:290] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:08.097803 24778 tablet_bootstrap.cc:492] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:13:08.103992 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 82199.4us
I20260709 12:13:08.108886 24778 tablet_bootstrap.cc:492] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:08.109838 24778 ts_tablet_manager.cc:1403] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.189s	user 0.038s	sys 0.026s
I20260709 12:13:08.112039 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:08.113271 24092 raft_consensus.cc:2468] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 1.
I20260709 12:13:08.091188 24780 raft_consensus.cc:2764] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:08.087390 24822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:08.118201 24516 raft_consensus.cc:515] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:08.121501 24871 raft_consensus.cc:493] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:08.116010 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:08.123101 24088 raft_consensus.cc:2468] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 2.
I20260709 12:13:08.108439 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:08.135711 24160 raft_consensus.cc:2393] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 in current term 2: Already voted for candidate 64549835910a439993d28800bb571368 in this term.
I20260709 12:13:08.136447 24826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:08.140370 24866 raft_consensus.cc:2749] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:08.124514 24822 raft_consensus.cc:2468] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:08.142616 24132 leader_election.cc:304] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:08.131366 24871 raft_consensus.cc:3060] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.128137 24516 leader_election.cc:290] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:08.090875 24131 leader_election.cc:304] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:08.129782 24827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.134708 24239 raft_consensus.cc:2468] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 1.
I20260709 12:13:08.143313 24869 consensus_queue.cc:237] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
W20260709 12:13:08.148782 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 63193.8us
I20260709 12:13:08.148561 24827 raft_consensus.cc:3060] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.150925 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:08.152472 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.153133 24823 raft_consensus.cc:3060] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.154085 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.154572 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.155113 24825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:08.156064 24825 raft_consensus.cc:2410] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:08.155164 24820 raft_consensus.cc:3060] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.161352 24778 raft_consensus.cc:359] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.161800 24823 raft_consensus.cc:2468] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 2.
I20260709 12:13:08.162686 24778 raft_consensus.cc:740] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.163237 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:08.130625 24205 leader_election.cc:304] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:08.163535 24778 consensus_queue.cc:260] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.164034 24240 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 3.
I20260709 12:13:08.164191 24636 raft_consensus.cc:2804] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:08.164690 24636 raft_consensus.cc:493] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:08.164937 24205 leader_election.cc:304] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:08.165067 24636 raft_consensus.cc:3060] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:08.149147 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 55551.2us
I20260709 12:13:08.167618 24058 leader_election.cc:304] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:08.170231 24543 raft_consensus.cc:2804] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.170768 24543 raft_consensus.cc:697] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:08.169739 24778 ts_tablet_manager.cc:1434] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.059s	user 0.002s	sys 0.003s
I20260709 12:13:08.167294 24780 raft_consensus.cc:2804] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.173434 24780 raft_consensus.cc:697] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:08.173804 24824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:08.174304 24780 consensus_queue.cc:237] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.174537 24543 consensus_queue.cc:237] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.178524 24827 raft_consensus.cc:2468] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:08.181152 24132 leader_election.cc:304] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:08.162256 24866 raft_consensus.cc:2804] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:08.181880 24866 raft_consensus.cc:493] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:08.182057 24779 raft_consensus.cc:2804] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.182375 24866 raft_consensus.cc:3060] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.186827 24636 raft_consensus.cc:515] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.188539 24158 raft_consensus.cc:1275] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer a09fd0dde7fc4241aecc9690b427e9e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.189185 24883 raft_consensus.cc:2804] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.189729 24883 raft_consensus.cc:697] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:08.190574 24883 consensus_queue.cc:237] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.191761 24058 leader_election.cc:304] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:08.193244 24711 raft_consensus.cc:2804] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.193877 24516 consensus_queue.cc:1048] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.196228 24779 raft_consensus.cc:697] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:08.195973 24058 leader_election.cc:304] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:08.200799 24058 leader_election.cc:304] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:08.201735 24885 raft_consensus.cc:2804] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.202332 24885 raft_consensus.cc:697] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:08.203161 24885 consensus_queue.cc:237] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.207546 24058 leader_election.cc:304] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:08.208385 24778 tablet_bootstrap.cc:492] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:08.208659 24636 leader_election.cc:290] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
W20260709 12:13:08.211505 24206 leader_election.cc:343] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.211660 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:08.210309 24781 raft_consensus.cc:2804] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:08.213390 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:08.213521 24781 raft_consensus.cc:493] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:08.206511 24820 raft_consensus.cc:2468] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 2.
I20260709 12:13:08.198340 24779 consensus_queue.cc:237] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.210486 24709 raft_consensus.cc:2804] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.209426 24871 raft_consensus.cc:515] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:08.199951 24711 raft_consensus.cc:697] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:08.223143 24781 raft_consensus.cc:3060] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.222741 24088 raft_consensus.cc:3060] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.282536 24160 raft_consensus.cc:2393] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 in current term 2: Already voted for candidate 64549835910a439993d28800bb571368 in this term.
I20260709 12:13:08.296865 24866 raft_consensus.cc:515] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.314829 24866 leader_election.cc:290] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:08.315412 24820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.316249 24820 raft_consensus.cc:3060] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.318507 24709 raft_consensus.cc:697] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:08.326180 24711 consensus_queue.cc:237] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.327291 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdd42c9876a43b087358f4d8b08b81b" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.327656 24206 leader_election.cc:304] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368
I20260709 12:13:08.328662 24636 raft_consensus.cc:2804] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.329137 24636 raft_consensus.cc:697] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:08.329895 24636 consensus_queue.cc:237] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:08.334847 24871 leader_election.cc:290] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:08.336678 24823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.337649 24823 raft_consensus.cc:2393] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 2: Already voted for candidate a09fd0dde7fc4241aecc9690b427e9e2 in this term.
W20260709 12:13:08.340394 24206 leader_election.cc:343] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.319676 24709 consensus_queue.cc:237] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
W20260709 12:13:08.357952 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 149329us
I20260709 12:13:08.358022 24088 raft_consensus.cc:2468] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09fd0dde7fc4241aecc9690b427e9e2 in term 2.
I20260709 12:13:08.361059 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:08.361724 24091 raft_consensus.cc:2468] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 1.
I20260709 12:13:08.362207 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:08.362684 24205 leader_election.cc:304] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:08.364941 24888 raft_consensus.cc:2804] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.365422 24888 raft_consensus.cc:697] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Becoming Leader. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:08.366549 24818 raft_consensus.cc:1275] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer a09fd0dde7fc4241aecc9690b427e9e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.366287 24888 consensus_queue.cc:237] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.365888 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2220bd387f5e420da98f649ad6b2c37e" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:08.399693 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9744f06e3f482d89a3a72e5a9c09bf" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:08.400425 24091 raft_consensus.cc:3060] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.400417 23915 catalog_manager.cc:5697] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.403090 23915 catalog_manager.cc:5697] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.415686 24160 raft_consensus.cc:1275] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.399061 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1cc59fceea40e599cdbcb075f486d6" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:08.423923 24781 raft_consensus.cc:515] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.423914 24088 raft_consensus.cc:2393] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 64549835910a439993d28800bb571368 in current term 2: Already voted for candidate 7beb24294eb94c1c8cf7659b8c507b46 in this term.
I20260709 12:13:08.428241 24820 raft_consensus.cc:2468] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:08.429754 24132 leader_election.cc:304] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:08.434719 24091 raft_consensus.cc:2468] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:08.435997 24058 leader_election.cc:304] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:08.430904 23912 catalog_manager.cc:5697] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.436980 24058 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:08.440006 24897 raft_consensus.cc:2764] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:08.440896 24897 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:08.441263 24897 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.441599 24897 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:08.438139 24779 raft_consensus.cc:2804] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.442648 24779 raft_consensus.cc:697] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:08.443516 24779 consensus_queue.cc:237] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.445963 24781 leader_election.cc:290] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Requested vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
W20260709 12:13:08.447374 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 82734.1us
W20260709 12:13:08.448181 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:39103, user_credentials={real_user=slave}} blocked reactor thread for 77725.1us
I20260709 12:13:08.449640 24887 consensus_queue.cc:1048] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.457314 24827 raft_consensus.cc:1275] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.463133 23914 catalog_manager.cc:5697] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.464799 24132 leader_election.cc:304] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64549835910a439993d28800bb571368; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:08.466002 24871 raft_consensus.cc:2749] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:08.469978 24058 leader_election.cc:304] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:08.487231 24897 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.490607 24912 raft_consensus.cc:2749] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:08.492208 24778 tablet_bootstrap.cc:492] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:13:08.493830 24058 leader_election.cc:343] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:08.498328 24058 leader_election.cc:343] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.489765 24897 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 4 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:08.503499 24778 tablet_bootstrap.cc:492] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:08.504472 24778 ts_tablet_manager.cc:1403] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.296s	user 0.030s	sys 0.025s
I20260709 12:13:08.509549 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:08.510257 24164 raft_consensus.cc:3060] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.512029 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:08.512643 24240 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:08.515730 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.517831 24821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:08.518543 24821 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:08.521679 24240 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 4.
I20260709 12:13:08.521894 23914 catalog_manager.cc:5697] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.524063 24239 raft_consensus.cc:1275] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.534991 23914 catalog_manager.cc:5697] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68). New cstate: current_term: 2 leader_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.537878 24779 consensus_queue.cc:1048] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.539465 23915 catalog_manager.cc:5697] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.541152 23915 catalog_manager.cc:5697] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.542739 23915 catalog_manager.cc:5697] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.546680 24164 raft_consensus.cc:2468] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 2.
I20260709 12:13:08.524865 24778 raft_consensus.cc:359] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.549870 24778 raft_consensus.cc:740] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.550588 24778 consensus_queue.cc:260] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.552673 24778 ts_tablet_manager.cc:1434] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.000s
I20260709 12:13:08.508402 24897 consensus_queue.cc:1048] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:13:08.555464 24912 consensus_queue.cc:1048] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.562131 24778 tablet_bootstrap.cc:492] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:08.565825 24827 raft_consensus.cc:1275] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.571024 24779 consensus_queue.cc:1048] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.571233 24058 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:08.575721 24897 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:08.576256 24897 raft_consensus.cc:697] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 4 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
W20260709 12:13:08.578368 24058 leader_election.cc:343] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.579416 24091 raft_consensus.cc:1275] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:08.585009 24910 log.cc:927] Time spent T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:13:08.599563 24058 leader_election.cc:304] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:08.605585 24781 raft_consensus.cc:2804] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:08.606240 24781 raft_consensus.cc:697] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:08.607156 24781 consensus_queue.cc:237] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.633692 24869 consensus_queue.cc:1048] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.579375 24897 consensus_queue.cc:237] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
W20260709 12:13:08.646205 24132 consensus_peers.cc:597] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.650740 24239 raft_consensus.cc:1275] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.654568 24821 raft_consensus.cc:2410] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7beb24294eb94c1c8cf7659b8c507b46 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:08.656589 24237 raft_consensus.cc:1275] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:08.669381 24132 consensus_peers.cc:597] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:08.674019 24058 consensus_peers.cc:597] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:08.685060 24161 raft_consensus.cc:1275] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.686817 23912 catalog_manager.cc:5697] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.691311 23912 catalog_manager.cc:5697] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.693295 23912 catalog_manager.cc:5697] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.696301 24779 consensus_queue.cc:1048] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.701886 24883 consensus_queue.cc:1048] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:08.693725 24869 consensus_queue.cc:1048] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 12:13:08.738718 24206 consensus_peers.cc:597] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:08.745504 24206 consensus_peers.cc:597] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:08.746647 24058 consensus_peers.cc:597] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.747532 24823 raft_consensus.cc:1275] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.749845 24779 consensus_queue.cc:1048] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.750551 24091 raft_consensus.cc:1275] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer a09fd0dde7fc4241aecc9690b427e9e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.752075 24819 raft_consensus.cc:1275] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.752177 24887 consensus_queue.cc:1048] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.754496 24819 raft_consensus.cc:3060] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.751966 24090 raft_consensus.cc:1275] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.778123 24869 consensus_queue.cc:1048] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:13:08.785099 24206 consensus_peers.cc:597] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:08.786990 24778 tablet_bootstrap.cc:492] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.788137 24869 consensus_queue.cc:1048] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.791291 24161 raft_consensus.cc:1275] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.791496 24778 tablet_bootstrap.cc:492] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:08.792338 24778 ts_tablet_manager.cc:1403] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.230s	user 0.030s	sys 0.002s
I20260709 12:13:08.793571 24819 raft_consensus.cc:1275] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.795884 24876 consensus_queue.cc:1048] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:08.795514 24778 raft_consensus.cc:359] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.806931 24778 raft_consensus.cc:740] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.807847 24778 consensus_queue.cc:260] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:08.817940 24778 ts_tablet_manager.cc:1434] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:13:08.818987 24778 tablet_bootstrap.cc:492] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:08.819473 23913 catalog_manager.cc:5697] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 3 to 4, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.812492 24820 raft_consensus.cc:1275] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer a09fd0dde7fc4241aecc9690b427e9e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.821260 23913 catalog_manager.cc:5697] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 1 to 2, leader changed from 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65) to 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.832476 24865 consensus_queue.cc:1048] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:08.837972 24781 consensus_queue.cc:1048] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:08.843628 24821 raft_consensus.cc:1275] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.848424 24159 raft_consensus.cc:1275] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.851805 24866 consensus_queue.cc:1048] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 12:13:08.886706 24058 consensus_peers.cc:597] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.872009 24932 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.888876 24932 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:08.899956 24876 consensus_queue.cc:1048] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:08.905617 24821 raft_consensus.cc:1275] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.907737 24709 consensus_queue.cc:1048] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.915701 24159 raft_consensus.cc:1275] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer a09fd0dde7fc4241aecc9690b427e9e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.924511 24516 consensus_queue.cc:1048] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.968004 24091 raft_consensus.cc:1275] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer a09fd0dde7fc4241aecc9690b427e9e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:08.983978 24926 log.cc:927] Time spent T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:13:08.997563 24932 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:08.997900 24088 raft_consensus.cc:1275] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:09.000327 24132 consensus_peers.cc:597] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:09.008109 24164 raft_consensus.cc:1275] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:09.036818 24206 consensus_peers.cc:597] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:09.043391 24871 consensus_queue.cc:1048] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:13:09.084944 24778 tablet_bootstrap.cc:492] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.086051 24778 tablet_bootstrap.cc:492] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.087790 24778 ts_tablet_manager.cc:1403] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.269s	user 0.013s	sys 0.007s
I20260709 12:13:09.086724 24912 consensus_queue.cc:1048] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:13:09.103413 24888 consensus_queue.cc:1048] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 12:13:09.129442 24933 log.cc:927] Time spent T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:13:09.133536 24827 raft_consensus.cc:3060] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.144173 24778 raft_consensus.cc:359] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:09.149801 24778 raft_consensus.cc:740] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
W20260709 12:13:09.149899 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 59749.1us
I20260709 12:13:09.150701 24778 consensus_queue.cc:260] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:09.153478 24778 ts_tablet_manager.cc:1434] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:13:09.154670 24778 tablet_bootstrap.cc:492] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
W20260709 12:13:09.217864 24206 consensus_peers.cc:597] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:09.218502 24206 consensus_peers.cc:597] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.219367 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 115164us
I20260709 12:13:09.223209 24166 raft_consensus.cc:1275] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.239218 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
W20260709 12:13:09.244930 24132 consensus_peers.cc:597] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:09.252213 24912 consensus_queue.cc:1048] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:09.264120 24240 raft_consensus.cc:1275] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 4 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:09.271095 24826 raft_consensus.cc:3060] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:09.322799 24058 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 47488.7us
W20260709 12:13:09.343287 24058 consensus_peers.cc:597] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:09.335183 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:09.356038 24945 consensus_queue.cc:1048] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:13:09.375087 24825 raft_consensus.cc:1275] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 4 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:13:09.394421 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 102492us
I20260709 12:13:09.367221 24238 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 4.
W20260709 12:13:09.407773 24206 consensus_peers.cc:597] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.408638 24206 consensus_peers.cc:597] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.410377 24206 consensus_peers.cc:597] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.429260 24132 consensus_peers.cc:597] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:09.445477 24826 raft_consensus.cc:1275] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.451929 24950 consensus_queue.cc:1048] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:09.452354 24775 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:09.453361 24932 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:09.453848 24932 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.454346 24932 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:09.453039 24950 consensus_queue.cc:1243] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Peer 79c4e12b81e44dae8a76443acdf7b9c9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:09.471448 24778 tablet_bootstrap.cc:492] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.472931 24778 tablet_bootstrap.cc:492] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.474599 24778 ts_tablet_manager.cc:1403] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.320s	user 0.028s	sys 0.040s
I20260709 12:13:09.476233 24901 consensus_queue.cc:1048] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:09.479382 24932 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.482834 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:09.480051 24778 raft_consensus.cc:359] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.482146 24932 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 5 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:09.487383 24778 raft_consensus.cc:740] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.491262 24778 consensus_queue.cc:260] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.497676 24778 ts_tablet_manager.cc:1434] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:13:09.501924 24826 raft_consensus.cc:1240] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 5 FOLLOWER]: Rejecting Update request from peer 7beb24294eb94c1c8cf7659b8c507b46 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:13:09.506379 24778 tablet_bootstrap.cc:492] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.505550 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
W20260709 12:13:09.512281 24206 consensus_peers.cc:597] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:09.513253 24775 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 7beb24294eb94c1c8cf7659b8c507b46, a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:09.514533 24932 raft_consensus.cc:2749] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:09.525998 24952 consensus_queue.cc:1059] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:09.526837 24952 consensus_queue.cc:1243] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Peer 79c4e12b81e44dae8a76443acdf7b9c9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:09.527395 24901 raft_consensus.cc:3055] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:09.527755 24901 raft_consensus.cc:740] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:09.528577 24901 consensus_queue.cc:260] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.530323 24901 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:09.539687 24778 tablet_bootstrap.cc:492] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.540871 24778 tablet_bootstrap.cc:492] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.541536 24778 ts_tablet_manager.cc:1403] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.000s
I20260709 12:13:09.546474 24778 raft_consensus.cc:359] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.547278 24778 raft_consensus.cc:740] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.548276 24778 consensus_queue.cc:260] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.554220 24778 ts_tablet_manager.cc:1434] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:13:09.555083 24778 tablet_bootstrap.cc:492] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.591161 24778 tablet_bootstrap.cc:492] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.592147 24778 tablet_bootstrap.cc:492] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.592826 24778 ts_tablet_manager.cc:1403] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 12:13:09.594970 24778 raft_consensus.cc:359] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.595453 24778 raft_consensus.cc:740] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.595963 24778 consensus_queue.cc:260] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.597465 24778 ts_tablet_manager.cc:1434] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:09.598238 24778 tablet_bootstrap.cc:492] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.613171 24778 tablet_bootstrap.cc:492] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.614179 24778 tablet_bootstrap.cc:492] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.614866 24778 ts_tablet_manager.cc:1403] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:13:09.617235 24778 raft_consensus.cc:359] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.617880 24778 raft_consensus.cc:740] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.618562 24778 consensus_queue.cc:260] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.620380 24778 ts_tablet_manager.cc:1434] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:09.621338 24778 tablet_bootstrap.cc:492] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.633795 24778 tablet_bootstrap.cc:492] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.634838 24778 tablet_bootstrap.cc:492] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.635653 24778 ts_tablet_manager.cc:1403] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.014s	user 0.014s	sys 0.000s
I20260709 12:13:09.637769 24778 raft_consensus.cc:359] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:09.638309 24778 raft_consensus.cc:740] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.638787 24778 consensus_queue.cc:260] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:09.640391 24778 ts_tablet_manager.cc:1434] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:09.641439 24778 tablet_bootstrap.cc:492] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.655242 24778 tablet_bootstrap.cc:492] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.658416 24778 tablet_bootstrap.cc:492] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.659257 24778 ts_tablet_manager.cc:1403] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:13:09.661801 24778 raft_consensus.cc:359] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.662875 24778 raft_consensus.cc:740] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.663597 24778 consensus_queue.cc:260] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.665652 24778 ts_tablet_manager.cc:1434] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:13:09.666500 24778 tablet_bootstrap.cc:492] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.680981 24778 tablet_bootstrap.cc:492] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.681931 24778 tablet_bootstrap.cc:492] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.682662 24778 ts_tablet_manager.cc:1403] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 12:13:09.685123 24778 raft_consensus.cc:359] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.686162 24778 raft_consensus.cc:740] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.686870 24778 consensus_queue.cc:260] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.689148 24778 ts_tablet_manager.cc:1434] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:09.689966 24778 tablet_bootstrap.cc:492] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.703881 24778 tablet_bootstrap.cc:492] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.704555 24778 tablet_bootstrap.cc:492] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.705067 24778 ts_tablet_manager.cc:1403] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:13:09.706861 24778 raft_consensus.cc:359] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.707324 24778 raft_consensus.cc:740] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.707819 24778 consensus_queue.cc:260] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.709681 24778 ts_tablet_manager.cc:1434] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:09.710897 24778 tablet_bootstrap.cc:492] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.729523 24778 tablet_bootstrap.cc:492] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.730530 24778 tablet_bootstrap.cc:492] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.731236 24778 ts_tablet_manager.cc:1403] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:13:09.733647 24778 raft_consensus.cc:359] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.734364 24778 raft_consensus.cc:740] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.735034 24778 consensus_queue.cc:260] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.736574 24778 ts_tablet_manager.cc:1434] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:09.737835 24778 tablet_bootstrap.cc:492] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.753402 24778 tablet_bootstrap.cc:492] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.754379 24778 tablet_bootstrap.cc:492] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.755136 24778 ts_tablet_manager.cc:1403] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:13:09.757848 24778 raft_consensus.cc:359] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:09.758582 24778 raft_consensus.cc:740] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.759399 24778 consensus_queue.cc:260] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:09.761631 24778 ts_tablet_manager.cc:1434] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:09.762535 24778 tablet_bootstrap.cc:492] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.775858 24778 tablet_bootstrap.cc:492] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.776793 24778 tablet_bootstrap.cc:492] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.777449 24778 ts_tablet_manager.cc:1403] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:13:09.779719 24778 raft_consensus.cc:359] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.780381 24778 raft_consensus.cc:740] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.781068 24778 consensus_queue.cc:260] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.782819 24778 ts_tablet_manager.cc:1434] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:13:09.783577 24778 tablet_bootstrap.cc:492] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.796452 24778 tablet_bootstrap.cc:492] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.797448 24778 tablet_bootstrap.cc:492] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.798154 24778 ts_tablet_manager.cc:1403] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:13:09.800578 24778 raft_consensus.cc:359] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:09.801082 24778 raft_consensus.cc:740] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.801599 24778 consensus_queue.cc:260] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:09.803668 24778 ts_tablet_manager.cc:1434] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:09.804613 24778 tablet_bootstrap.cc:492] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.817679 24778 tablet_bootstrap.cc:492] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.818650 24778 tablet_bootstrap.cc:492] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.819346 24778 ts_tablet_manager.cc:1403] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:13:09.821678 24778 raft_consensus.cc:359] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.822300 24778 raft_consensus.cc:740] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.822873 24778 consensus_queue.cc:260] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.824280 24778 ts_tablet_manager.cc:1434] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:09.825358 24778 tablet_bootstrap.cc:492] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.838007 24778 tablet_bootstrap.cc:492] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.838793 24778 tablet_bootstrap.cc:492] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.839422 24778 ts_tablet_manager.cc:1403] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 12:13:09.841300 24778 raft_consensus.cc:359] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.841843 24778 raft_consensus.cc:740] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.842428 24778 consensus_queue.cc:260] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:09.844291 24778 ts_tablet_manager.cc:1434] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:13:09.845072 24778 tablet_bootstrap.cc:492] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.857470 24778 tablet_bootstrap.cc:492] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.858306 24778 tablet_bootstrap.cc:492] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.858950 24778 ts_tablet_manager.cc:1403] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:13:09.860888 24778 raft_consensus.cc:359] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.861483 24778 raft_consensus.cc:740] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.862027 24778 consensus_queue.cc:260] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.863646 24778 ts_tablet_manager.cc:1434] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:09.864675 24778 tablet_bootstrap.cc:492] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.883783 24825 raft_consensus.cc:3060] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.887159 24778 tablet_bootstrap.cc:492] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.888202 24778 tablet_bootstrap.cc:492] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.888888 24778 ts_tablet_manager.cc:1403] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 12:13:09.891541 24778 raft_consensus.cc:359] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.892266 24778 raft_consensus.cc:740] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.892962 24778 consensus_queue.cc:260] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.895170 24778 ts_tablet_manager.cc:1434] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:13:09.896018 24778 tablet_bootstrap.cc:492] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.910852 24827 raft_consensus.cc:3060] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.959748 24826 raft_consensus.cc:3060] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.965759 24778 tablet_bootstrap.cc:492] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:09.966799 24778 tablet_bootstrap.cc:492] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:09.967497 24778 ts_tablet_manager.cc:1403] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.028s
I20260709 12:13:09.970655 24778 raft_consensus.cc:359] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.971351 24778 raft_consensus.cc:740] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.972157 24778 consensus_queue.cc:260] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:09.974668 24778 ts_tablet_manager.cc:1434] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:09.975522 24778 tablet_bootstrap.cc:492] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap starting.
I20260709 12:13:09.999681 24778 tablet_bootstrap.cc:492] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:10.000851 24778 tablet_bootstrap.cc:492] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: Bootstrap complete.
I20260709 12:13:10.001626 24778 ts_tablet_manager.cc:1403] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.012s
I20260709 12:13:10.004515 24778 raft_consensus.cc:359] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:10.005048 24778 raft_consensus.cc:740] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.005759 24778 consensus_queue.cc:260] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:10.007323 24778 ts_tablet_manager.cc:1434] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:10.050868 24826 raft_consensus.cc:3060] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:10.184597 24825 raft_consensus.cc:3060] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:10.883919 24989 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.884397 24989 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:10.886268 24989 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:10.886879 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" is_pre_election: true
I20260709 12:13:10.887255 24826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:10.887907 24826 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 5.
I20260709 12:13:10.888877 24058 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:10.889645 24901 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:10.889961 24901 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.890297 24901 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:10.896727 24901 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:10.898775 24901 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 6 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
I20260709 12:13:10.899600 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:10.899698 24826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "7beb24294eb94c1c8cf7659b8c507b46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
I20260709 12:13:10.900336 24826 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:10.909371 24826 raft_consensus.cc:2468] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7beb24294eb94c1c8cf7659b8c507b46 in term 6.
I20260709 12:13:10.952558 24058 leader_election.cc:304] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: a09fd0dde7fc4241aecc9690b427e9e2
I20260709 12:13:10.957392 24950 raft_consensus.cc:2804] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:10.967223 24950 raft_consensus.cc:697] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 6 LEADER]: Becoming Leader. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:10.971664 24950 consensus_queue.cc:237] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:11.028230 23912 catalog_manager.cc:5697] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7beb24294eb94c1c8cf7659b8c507b46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:11.073182 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:35877, user_credentials={real_user=slave}} blocked reactor thread for 46791.4us
I20260709 12:13:11.094241 24543 raft_consensus.cc:493] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7beb24294eb94c1c8cf7659b8c507b46)
I20260709 12:13:11.095286 24543 raft_consensus.cc:515] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:11.099524 24543 leader_election.cc:290] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:11.101794 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46" is_pre_election: true
I20260709 12:13:11.117936 24821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a875213f1f8a4efd8894c71d54fa8a48" candidate_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" is_pre_election: true
I20260709 12:13:11.119074 24821 raft_consensus.cc:2368] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 for earlier term 5. Current term is 6.
I20260709 12:13:11.120576 24206 leader_election.cc:400] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103) with higher term. Message: Invalid argument: T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 for earlier term 5. Current term is 6.
I20260709 12:13:11.120971 24206 leader_election.cc:403] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:11.122310 24543 raft_consensus.cc:3060] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:11.132817 24543 raft_consensus.cc:2749] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103) with higher term. Message: Invalid argument: T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a09fd0dde7fc4241aecc9690b427e9e2 for earlier term 5. Current term is 6.
I20260709 12:13:11.376854 24238 raft_consensus.cc:1275] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 6 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:11.378257 24901 consensus_queue.cc:1048] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.408640 24821 raft_consensus.cc:1275] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 6 FOLLOWER]: Refusing update from remote peer 7beb24294eb94c1c8cf7659b8c507b46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:11.413946 24952 consensus_queue.cc:1048] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:11.414696 24952 consensus_queue.cc:1243] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [LEADER]: Peer 79c4e12b81e44dae8a76443acdf7b9c9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:11.427009 24826 pending_rounds.cc:85] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Aborting all ops after (but not including) 1
I20260709 12:13:11.427400 24826 pending_rounds.cc:107] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:13:11.427740 24826 raft_consensus.cc:2889] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:17.497093 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:17.556341 24238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09559716fd22441c954a4dbae0e41bee"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:17.556960 24238 raft_consensus.cc:606] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:17.568710 24089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172aa0d42e8646ce8e9b3ef01f4628d6"
dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:42848
I20260709 12:13:17.569203 24089 raft_consensus.cc:606] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:17.571753 24089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744"
dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:42848
I20260709 12:13:17.572222 24089 raft_consensus.cc:606] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:17.574656 24089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e"
dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:42848
I20260709 12:13:17.575240 24089 raft_consensus.cc:606] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:17.578572 24089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad"
dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:42848
I20260709 12:13:17.579506 24089 raft_consensus.cc:606] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:17.581171 25007 raft_consensus.cc:993] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.581653 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:17.584519 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:17.582872 25010 raft_consensus.cc:1081] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.585873 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:17.586719 25010 raft_consensus.cc:993] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.587456 25010 raft_consensus.cc:1081] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.596269 24826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "172aa0d42e8646ce8e9b3ef01f4628d6"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55174
I20260709 12:13:17.596938 24826 raft_consensus.cc:493] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.597288 24826 raft_consensus.cc:3060] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.596287 24821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55174
I20260709 12:13:17.598575 24821 raft_consensus.cc:493] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.598922 24821 raft_consensus.cc:3060] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:17.607483 24826 raft_consensus.cc:515] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.610991 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172aa0d42e8646ce8e9b3ef01f4628d6" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:17.611581 24089 raft_consensus.cc:3055] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.611855 24089 raft_consensus.cc:740] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:17.612617 24089 consensus_queue.cc:260] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.613740 24089 raft_consensus.cc:3060] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.618218 24821 raft_consensus.cc:515] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.628554 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:17.629225 24088 raft_consensus.cc:3055] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:17.629515 24088 raft_consensus.cc:740] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:17.630347 24088 consensus_queue.cc:260] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.631507 24088 raft_consensus.cc:3060] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:17.642328 24826 leader_election.cc:290] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:17.645351 24089 raft_consensus.cc:2468] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:17.646869 25015 raft_consensus.cc:993] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.648630 25015 raft_consensus.cc:1081] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.651897 24825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55174
I20260709 12:13:17.650913 24774 leader_election.cc:304] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:17.648854 24821 leader_election.cc:290] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:17.671808 24825 raft_consensus.cc:493] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.672242 24825 raft_consensus.cc:3060] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.671502 24088 raft_consensus.cc:2468] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 3.
I20260709 12:13:17.682765 24825 raft_consensus.cc:515] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.684914 24825 leader_election.cc:290] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:17.689043 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0b9a2a93994fa2b4a1b3f3448a7744" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:17.689301 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172aa0d42e8646ce8e9b3ef01f4628d6" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:17.689654 24164 raft_consensus.cc:3060] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:17.690018 24158 raft_consensus.cc:3060] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.691941 25018 raft_consensus.cc:2804] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.694491 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:17.694675 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d640b1b4aa4e8597d224281ede6bad" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:17.695201 24086 raft_consensus.cc:3055] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.695325 24159 raft_consensus.cc:3060] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.695609 24086 raft_consensus.cc:740] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:17.696614 24086 consensus_queue.cc:260] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.698055 24086 raft_consensus.cc:3060] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.698788 24774 leader_election.cc:304] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:17.700443 24158 raft_consensus.cc:2468] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:17.704643 25019 raft_consensus.cc:2804] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:17.705250 25019 raft_consensus.cc:697] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:17.706200 25019 consensus_queue.cc:237] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.711105 25018 raft_consensus.cc:697] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:17.714686 25007 raft_consensus.cc:993] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.715279 25007 raft_consensus.cc:1081] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.716516 25018 consensus_queue.cc:237] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.717190 24821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55174
I20260709 12:13:17.718786 24821 raft_consensus.cc:493] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.719134 24821 raft_consensus.cc:3060] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:17.728935 24821 raft_consensus.cc:515] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.732896 24086 raft_consensus.cc:2468] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:17.735155 24821 leader_election.cc:290] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), 64549835910a439993d28800bb571368 (127.15.191.67:35877)
I20260709 12:13:17.736418 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:17.737105 24166 raft_consensus.cc:3060] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:17.746168 24159 raft_consensus.cc:2468] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
W20260709 12:13:17.749344 24774 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.66:38037, user_credentials={real_user=slave}} blocked reactor thread for 50635.9us
I20260709 12:13:17.750486 24775 leader_election.cc:304] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:17.751163 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c550cc124fddb066006c81a6b29e" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:17.752004 24086 raft_consensus.cc:3055] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:17.752434 24086 raft_consensus.cc:740] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7beb24294eb94c1c8cf7659b8c507b46, State: Running, Role: LEADER
I20260709 12:13:17.752691 24166 raft_consensus.cc:2468] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 3.
I20260709 12:13:17.757983 24775 leader_election.cc:304] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:17.760006 25022 raft_consensus.cc:2804] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.761475 24086 consensus_queue.cc:260] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.763055 24086 raft_consensus.cc:3060] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:17.751339 24164 raft_consensus.cc:2468] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 3.
I20260709 12:13:17.765425 25020 raft_consensus.cc:2804] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:17.778254 25020 raft_consensus.cc:697] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:17.779564 25020 consensus_queue.cc:237] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.780238 25022 raft_consensus.cc:697] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:17.781376 25022 consensus_queue.cc:237] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } }
I20260709 12:13:17.784528 24086 raft_consensus.cc:2468] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 3.
I20260709 12:13:17.783867 23915 catalog_manager.cc:5697] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.822222 23915 catalog_manager.cc:5697] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.823964 23915 catalog_manager.cc:5697] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 2 to 3, leader changed from 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.825640 23915 catalog_manager.cc:5697] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 2 to 3, leader changed from 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.850482 25008 raft_consensus.cc:993] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.851033 24987 raft_consensus.cc:1081] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:17.852571 24827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09559716fd22441c954a4dbae0e41bee"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55186
I20260709 12:13:17.853044 24827 raft_consensus.cc:493] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.853322 24827 raft_consensus.cc:3060] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.859407 24827 raft_consensus.cc:515] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:17.861213 24827 leader_election.cc:290] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:17.861948 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09559716fd22441c954a4dbae0e41bee" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:17.862386 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09559716fd22441c954a4dbae0e41bee" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:17.862695 24164 raft_consensus.cc:3060] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.863054 24238 raft_consensus.cc:3055] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.863404 24238 raft_consensus.cc:740] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:17.864235 24238 consensus_queue.cc:260] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:17.865532 24238 raft_consensus.cc:3060] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.868603 24164 raft_consensus.cc:2468] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:17.869925 24775 leader_election.cc:304] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:17.870741 25020 raft_consensus.cc:2804] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.871248 25020 raft_consensus.cc:697] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:17.872166 24238 raft_consensus.cc:2468] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:17.872077 25020 consensus_queue.cc:237] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:17.883424 23915 catalog_manager.cc:5697] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.135681 24086 raft_consensus.cc:1275] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.137454 25020 consensus_queue.cc:1048] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.138782 24086 raft_consensus.cc:1275] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:18.140093 25020 consensus_queue.cc:1048] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.151302 24166 raft_consensus.cc:1275] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.153337 25020 consensus_queue.cc:1048] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.167614 24164 raft_consensus.cc:1275] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:18.169083 25023 consensus_queue.cc:1048] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.236107 24086 raft_consensus.cc:1275] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.237370 25023 consensus_queue.cc:1048] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.246383 24164 raft_consensus.cc:1275] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.248260 25020 consensus_queue.cc:1048] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.249578 24089 raft_consensus.cc:1275] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:18.253285 25020 consensus_queue.cc:1048] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.274215 24164 raft_consensus.cc:1275] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:18.278004 25020 consensus_queue.cc:1048] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.354256 24166 raft_consensus.cc:1275] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.355543 25020 consensus_queue.cc:1048] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.370440 24240 raft_consensus.cc:1275] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.373775 25019 consensus_queue.cc:1048] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.666579 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.706354 24240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:18.707002 24240 raft_consensus.cc:606] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:18.709470 24240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:18.709975 24240 raft_consensus.cc:606] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:18.712298 24240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:18.712800 24240 raft_consensus.cc:606] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:18.715075 24240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:18.715498 24240 raft_consensus.cc:606] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:18.717787 24240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:18.718245 24240 raft_consensus.cc:606] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 64549835910a439993d28800bb571368
I20260709 12:13:18.719256 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:18.720680 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:18.721462 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.826009 24987 raft_consensus.cc:993] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:18.826563 24543 raft_consensus.cc:1081] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:18.832877 24825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55186
I20260709 12:13:18.833463 24825 raft_consensus.cc:493] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.833832 24825 raft_consensus.cc:3060] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.842947 24825 raft_consensus.cc:515] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:18.845597 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:18.844857 24825 leader_election.cc:290] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:18.846015 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cfd576beb2433d8ab615466d50bcc2" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:18.846325 24166 raft_consensus.cc:3060] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.846657 24240 raft_consensus.cc:3055] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.846944 24240 raft_consensus.cc:740] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:18.847728 24240 consensus_queue.cc:260] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:18.848943 24240 raft_consensus.cc:3060] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.853633 24166 raft_consensus.cc:2468] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:18.854897 24775 leader_election.cc:304] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:18.855789 25019 raft_consensus.cc:2804] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.856319 25019 raft_consensus.cc:697] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:18.857223 25019 consensus_queue.cc:237] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:18.857846 24240 raft_consensus.cc:2468] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:18.864326 24987 raft_consensus.cc:993] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:18.864836 24543 raft_consensus.cc:1081] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:18.867424 24166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7"
dest_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:42208
I20260709 12:13:18.868001 24166 raft_consensus.cc:493] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.868355 24166 raft_consensus.cc:3060] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.871073 23912 catalog_manager.cc:5697] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.878388 24166 raft_consensus.cc:515] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:18.882037 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:18.882699 24240 raft_consensus.cc:3055] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.882504 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5b9f7ee4754dc8bcef9a96c67021d7" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:18.883093 24240 raft_consensus.cc:740] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:18.883423 24086 raft_consensus.cc:3060] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.883944 24240 consensus_queue.cc:260] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:18.885164 24240 raft_consensus.cc:3060] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.886777 24166 leader_election.cc:290] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:18.894526 24543 raft_consensus.cc:993] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:18.895202 24543 raft_consensus.cc:1081] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:18.904027 24240 raft_consensus.cc:2468] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:18.905633 24132 leader_election.cc:304] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:18.906607 25004 raft_consensus.cc:2804] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.907107 25004 raft_consensus.cc:697] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:18.907950 25004 consensus_queue.cc:237] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:18.911100 24827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55186
I20260709 12:13:18.911818 24827 raft_consensus.cc:493] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.912213 24827 raft_consensus.cc:3060] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.927676 24827 raft_consensus.cc:515] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:18.929014 24086 raft_consensus.cc:2468] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:18.935952 24827 leader_election.cc:290] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:18.937927 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:18.938647 24238 raft_consensus.cc:3055] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.938939 24238 raft_consensus.cc:740] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:18.939747 24238 consensus_queue.cc:260] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:18.942380 24238 raft_consensus.cc:3060] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.943038 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7918e606532f446790aa9cebeb9a352c" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:18.939671 23915 catalog_manager.cc:5697] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.943657 24089 raft_consensus.cc:3060] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.950567 24238 raft_consensus.cc:2468] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:18.951912 24775 leader_election.cc:304] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:18.952922 25018 raft_consensus.cc:2804] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.953461 25018 raft_consensus.cc:697] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:18.954483 25018 consensus_queue.cc:237] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:18.966442 24089 raft_consensus.cc:2468] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:18.975682 23915 catalog_manager.cc:5697] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.167435 25008 raft_consensus.cc:993] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:19.167943 24543 raft_consensus.cc:1081] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:19.171639 24987 raft_consensus.cc:993] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:19.172127 25008 raft_consensus.cc:1081] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:19.172013 24827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55186
I20260709 12:13:19.172878 24827 raft_consensus.cc:493] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.173285 24827 raft_consensus.cc:3060] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.174468 24825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55186
I20260709 12:13:19.175091 24825 raft_consensus.cc:493] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.175429 24825 raft_consensus.cc:3060] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.179612 24827 raft_consensus.cc:515] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:19.180863 24825 raft_consensus.cc:515] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:19.181440 24827 leader_election.cc:290] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:19.182658 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:19.183411 24238 raft_consensus.cc:3055] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.183876 24238 raft_consensus.cc:740] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:19.184110 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:19.184576 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e594133f84a47ecacfe0bf75b3bc5fc" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:19.184710 24089 raft_consensus.cc:3060] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.183543 24825 leader_election.cc:290] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:19.185205 24240 raft_consensus.cc:3055] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.185535 24240 raft_consensus.cc:740] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:19.184970 24238 consensus_queue.cc:260] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:19.186383 24240 consensus_queue.cc:260] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:19.187204 24238 raft_consensus.cc:3060] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.187820 24240 raft_consensus.cc:3060] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.189072 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca6ef4edba6432d990cf875232d420b" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:19.189648 24166 raft_consensus.cc:3060] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.193527 24089 raft_consensus.cc:2468] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:19.194828 24238 raft_consensus.cc:2468] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:19.195382 24774 leader_election.cc:304] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:19.196322 25018 raft_consensus.cc:2804] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.196811 25018 raft_consensus.cc:697] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:19.196991 24775 leader_election.cc:304] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:19.197978 25020 raft_consensus.cc:2804] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.197723 25018 consensus_queue.cc:237] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:19.198525 25020 raft_consensus.cc:697] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:19.199083 24166 raft_consensus.cc:2468] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:19.199486 25020 consensus_queue.cc:237] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:19.208191 24240 raft_consensus.cc:2468] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:19.220290 23915 catalog_manager.cc:5697] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.235291 23915 catalog_manager.cc:5697] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.249409 24238 raft_consensus.cc:1275] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.250653 25020 consensus_queue.cc:1048] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.265405 24166 raft_consensus.cc:1275] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.325307 24089 raft_consensus.cc:1275] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.327030 25004 consensus_queue.cc:1048] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.336506 25018 consensus_queue.cc:1048] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.343186 24086 raft_consensus.cc:1275] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.348699 25018 consensus_queue.cc:1048] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:19.383195 24238 raft_consensus.cc:1275] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.384382 24240 raft_consensus.cc:1275] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.386838 25019 consensus_queue.cc:1048] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.386838 25004 consensus_queue.cc:1048] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:19.594854 24238 raft_consensus.cc:1275] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.596037 25018 consensus_queue.cc:1048] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.616135 24164 raft_consensus.cc:1275] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.619735 25074 consensus_queue.cc:1048] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:19.695529 24238 raft_consensus.cc:1275] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.696924 25019 consensus_queue.cc:1048] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.710171 24088 raft_consensus.cc:1275] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.711459 25020 consensus_queue.cc:1048] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.761807 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.802201 24240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:19.802809 24240 raft_consensus.cc:606] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:19.805028 24240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:19.805478 24240 raft_consensus.cc:606] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:19.808298 24240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:19.808940 24240 raft_consensus.cc:606] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 64549835910a439993d28800bb571368
I20260709 12:13:19.811615 24240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:19.812075 24240 raft_consensus.cc:606] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 64549835910a439993d28800bb571368
I20260709 12:13:19.814456 24238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f203904cd1b94afca969b8b361e196b8"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:19.814916 24238 raft_consensus.cc:606] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 64549835910a439993d28800bb571368
I20260709 12:13:19.816493 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:19.817777 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:19.818550 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.834583 24987 raft_consensus.cc:993] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:19.835165 25008 raft_consensus.cc:1081] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:19.836655 24166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c"
dest_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:42208
I20260709 12:13:19.837220 24166 raft_consensus.cc:493] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.837585 24166 raft_consensus.cc:3060] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.845456 24166 raft_consensus.cc:515] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:19.847903 24166 leader_election.cc:290] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:19.848220 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:19.848438 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce9b63ea2f94082afd9e5a2fb11cc9c" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:19.848937 24088 raft_consensus.cc:3060] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.848999 24238 raft_consensus.cc:3055] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.849392 24238 raft_consensus.cc:740] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:19.852077 24238 consensus_queue.cc:260] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:19.855252 24238 raft_consensus.cc:3060] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.857187 24088 raft_consensus.cc:2468] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:19.858845 24131 leader_election.cc:304] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:19.859684 25070 raft_consensus.cc:2804] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.860201 25070 raft_consensus.cc:697] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:19.861095 25070 consensus_queue.cc:237] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:19.871023 24238 raft_consensus.cc:2468] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:19.874328 23912 catalog_manager.cc:5697] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.096760 25008 raft_consensus.cc:993] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:20.097165 24987 raft_consensus.cc:1081] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:20.098799 24825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55186
I20260709 12:13:20.099293 24825 raft_consensus.cc:493] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.099561 24825 raft_consensus.cc:3060] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.105705 24825 raft_consensus.cc:515] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:20.107379 24825 leader_election.cc:290] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:20.108157 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:20.108377 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e8cb56d54f4d83939a14ea7ffdd5c4" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:20.108892 24238 raft_consensus.cc:3055] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.108929 24088 raft_consensus.cc:3060] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.109333 24238 raft_consensus.cc:740] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:20.109994 24238 consensus_queue.cc:260] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:20.111145 24238 raft_consensus.cc:3060] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.116460 24088 raft_consensus.cc:2468] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:20.117445 24238 raft_consensus.cc:2468] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:20.117770 24774 leader_election.cc:304] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:20.118711 25018 raft_consensus.cc:2804] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.119199 25018 raft_consensus.cc:697] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:20.120075 25018 consensus_queue.cc:237] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:20.130744 23912 catalog_manager.cc:5697] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.132472 25008 raft_consensus.cc:993] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:20.134080 24987 raft_consensus.cc:1081] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:20.139690 24164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e"
dest_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:42208
I20260709 12:13:20.140175 24164 raft_consensus.cc:493] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.140558 24164 raft_consensus.cc:3060] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.151427 24164 raft_consensus.cc:515] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.154488 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:20.155109 24088 raft_consensus.cc:3060] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.155534 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8150bdbea834ed8bab225a9388ab34e" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:20.156163 24238 raft_consensus.cc:3055] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.156450 24238 raft_consensus.cc:740] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:20.157224 24238 consensus_queue.cc:260] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.158169 24238 raft_consensus.cc:3060] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.159318 24164 leader_election.cc:290] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:20.162521 24088 raft_consensus.cc:2468] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:20.165342 24131 leader_election.cc:304] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:20.166345 25071 raft_consensus.cc:2804] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.165426 24238 raft_consensus.cc:2468] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:20.172019 25071 raft_consensus.cc:697] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:20.172993 25071 consensus_queue.cc:237] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.186216 23912 catalog_manager.cc:5697] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.252662 25008 raft_consensus.cc:993] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:20.253171 25008 raft_consensus.cc:1081] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:20.255208 24827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55186
I20260709 12:13:20.255786 24827 raft_consensus.cc:493] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.256174 24827 raft_consensus.cc:3060] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.262200 24827 raft_consensus.cc:515] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.263919 24827 leader_election.cc:290] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:20.264554 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:20.264868 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407b0af97117450fb56d6991d8fa8649" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:20.265229 24164 raft_consensus.cc:3060] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.265410 24238 raft_consensus.cc:3055] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.265728 24238 raft_consensus.cc:740] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:20.266552 24238 consensus_queue.cc:260] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.267796 24238 raft_consensus.cc:3060] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.272433 24164 raft_consensus.cc:2468] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:20.273752 24775 leader_election.cc:304] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:20.274345 24238 raft_consensus.cc:2468] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:20.274487 25020 raft_consensus.cc:2804] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.274996 25020 raft_consensus.cc:697] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:20.275836 25020 consensus_queue.cc:237] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.285400 23912 catalog_manager.cc:5697] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.367530 25008 raft_consensus.cc:993] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:20.367964 24987 raft_consensus.cc:1081] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:20.369262 24164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f203904cd1b94afca969b8b361e196b8"
dest_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:42208
I20260709 12:13:20.369765 24164 raft_consensus.cc:493] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.370134 24164 raft_consensus.cc:3060] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.370823 24238 raft_consensus.cc:1275] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.372110 25084 consensus_queue.cc:1048] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.376303 24164 raft_consensus.cc:515] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.379467 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f203904cd1b94afca969b8b361e196b8" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:20.380705 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f203904cd1b94afca969b8b361e196b8" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:20.381134 24238 raft_consensus.cc:3055] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.381502 24238 raft_consensus.cc:740] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:20.381301 24088 raft_consensus.cc:3060] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.382593 24238 consensus_queue.cc:260] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.383908 24238 raft_consensus.cc:3060] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.378314 24164 leader_election.cc:290] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:20.386019 24089 raft_consensus.cc:1275] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.388176 25070 consensus_queue.cc:1048] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.394439 24238 raft_consensus.cc:2468] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:20.395704 24132 leader_election.cc:304] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:20.397814 25090 raft_consensus.cc:2804] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.398409 25090 raft_consensus.cc:697] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:20.399328 25090 consensus_queue.cc:237] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.406560 24088 raft_consensus.cc:2468] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:20.432941 23913 catalog_manager.cc:5697] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.575357 24086 raft_consensus.cc:1275] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.577328 25020 consensus_queue.cc:1048] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.585187 24240 raft_consensus.cc:1275] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.586820 25020 consensus_queue.cc:1048] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.659754 24240 raft_consensus.cc:1275] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.661119 25018 consensus_queue.cc:1048] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.664003 24164 raft_consensus.cc:1275] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.665323 25020 consensus_queue.cc:1048] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.719192 24088 raft_consensus.cc:1275] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.720469 25084 consensus_queue.cc:1048] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.728366 24240 raft_consensus.cc:1275] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.732260 25071 consensus_queue.cc:1048] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.864820 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.875922 24088 raft_consensus.cc:1275] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.877679 25084 consensus_queue.cc:1048] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.888528 24237 raft_consensus.cc:1275] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.890244 25084 consensus_queue.cc:1048] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.915393 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:20.916070 24237 raft_consensus.cc:606] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:20.918586 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:20.919112 24237 raft_consensus.cc:606] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 64549835910a439993d28800bb571368
I20260709 12:13:20.921825 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d"
dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:54038
I20260709 12:13:20.922493 24237 raft_consensus.cc:606] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:20.923748 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:20.925150 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:20.925844 25008 raft_consensus.cc:993] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:20.925895 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.926553 25083 raft_consensus.cc:1081] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 64549835910a439993d28800bb571368 to start an election
I20260709 12:13:20.928121 24166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37"
dest_uuid: "64549835910a439993d28800bb571368"
 from {username='slave'} at 127.0.0.1:42208
I20260709 12:13:20.928679 24166 raft_consensus.cc:493] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.928951 24166 raft_consensus.cc:3060] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.934417 24166 raft_consensus.cc:515] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.937026 24166 leader_election.cc:290] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Requested vote from peers 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:20.937095 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:20.937484 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e57bd7f92b1482cb38beba49eccfb37" candidate_uuid: "64549835910a439993d28800bb571368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:20.938205 24237 raft_consensus.cc:3055] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.938937 24237 raft_consensus.cc:740] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:20.938520 24088 raft_consensus.cc:3060] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.939872 24237 consensus_queue.cc:260] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.942615 24237 raft_consensus.cc:3060] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.951153 24237 raft_consensus.cc:2468] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:20.953187 24132 leader_election.cc:304] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:20.954295 25084 raft_consensus.cc:2804] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.954813 25084 raft_consensus.cc:697] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Becoming Leader. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:20.955696 25084 consensus_queue.cc:237] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } }
I20260709 12:13:20.966748 24088 raft_consensus.cc:2468] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64549835910a439993d28800bb571368 in term 2.
I20260709 12:13:20.984360 23912 catalog_manager.cc:5697] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 64549835910a439993d28800bb571368 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "64549835910a439993d28800bb571368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.199404 25114 raft_consensus.cc:993] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:21.200448 25114 raft_consensus.cc:1081] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:21.203540 24827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55186
I20260709 12:13:21.204494 24827 raft_consensus.cc:493] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.204999 24827 raft_consensus.cc:3060] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.228128 24827 raft_consensus.cc:515] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:21.234867 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7beb24294eb94c1c8cf7659b8c507b46"
I20260709 12:13:21.235904 24088 raft_consensus.cc:3060] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.238958 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d21190dc1a46b8bfecc2773603fe9d" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:21.239765 24237 raft_consensus.cc:3055] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.240121 24827 leader_election.cc:290] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:21.240142 24237 raft_consensus.cc:740] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:21.245673 24237 consensus_queue.cc:260] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:21.247807 24237 raft_consensus.cc:3060] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.253867 24088 raft_consensus.cc:2468] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:21.259460 24237 raft_consensus.cc:2468] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:21.259660 24774 leader_election.cc:304] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46; no voters: 
I20260709 12:13:21.260769 25116 raft_consensus.cc:2804] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.261307 25116 raft_consensus.cc:697] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:21.262622 25116 consensus_queue.cc:237] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:21.293443 23912 catalog_manager.cc:5697] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.421231 25114 raft_consensus.cc:993] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:21.421917 25008 raft_consensus.cc:1081] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:21.423559 24825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55186
I20260709 12:13:21.424005 24825 raft_consensus.cc:493] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.424243 24825 raft_consensus.cc:3060] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:21.430650 24825 raft_consensus.cc:515] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:21.432451 24825 leader_election.cc:290] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:21.433831 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:21.434582 24238 raft_consensus.cc:3055] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:21.434940 24238 raft_consensus.cc:740] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a09fd0dde7fc4241aecc9690b427e9e2, State: Running, Role: LEADER
I20260709 12:13:21.435268 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d527b984d44ebd82ac7b1d7d81efbf" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:21.435949 24164 raft_consensus.cc:3060] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:21.435884 24238 consensus_queue.cc:260] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:21.437425 24238 raft_consensus.cc:3060] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:21.443856 24164 raft_consensus.cc:2468] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 3.
I20260709 12:13:21.445026 24238 raft_consensus.cc:2468] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 3.
I20260709 12:13:21.445262 24775 leader_election.cc:304] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9; no voters: 
I20260709 12:13:21.446177 25116 raft_consensus.cc:2804] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:21.446604 25116 raft_consensus.cc:697] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:21.447419 25116 consensus_queue.cc:237] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:21.457701 23912 catalog_manager.cc:5697] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 2 to 3, leader changed from a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.487463 24238 raft_consensus.cc:1275] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.488785 25071 consensus_queue.cc:1048] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.503309 24088 raft_consensus.cc:1275] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 64549835910a439993d28800bb571368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.506702 25090 consensus_queue.cc:1048] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.804549 24088 raft_consensus.cc:1275] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.805883 25020 consensus_queue.cc:1048] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.827616 24238 raft_consensus.cc:1275] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.832604 25116 consensus_queue.cc:1048] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.883241 24164 raft_consensus.cc:1275] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:21.884779 25116 consensus_queue.cc:1048] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.896474 24240 raft_consensus.cc:1275] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:21.897836 25116 consensus_queue.cc:1048] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.974042 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:22.021368 24166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042"
dest_uuid: "64549835910a439993d28800bb571368"
mode: GRACEFUL
new_leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:38398
I20260709 12:13:22.021883 24166 raft_consensus.cc:606] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 1 LEADER]: Received request to transfer leadership to TS 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:22.023052 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:22.024241 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:22.025141 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:22.035748 25071 raft_consensus.cc:993] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368: : Instructing follower 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:22.036746 25090 raft_consensus.cc:1081] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 1 LEADER]: Signalling peer 79c4e12b81e44dae8a76443acdf7b9c9 to start an election
I20260709 12:13:22.040306 24825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042"
dest_uuid: "79c4e12b81e44dae8a76443acdf7b9c9"
 from {username='slave'} at 127.0.0.1:55196
I20260709 12:13:22.040882 24825 raft_consensus.cc:493] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.041239 24825 raft_consensus.cc:3060] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.048580 24825 raft_consensus.cc:515] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:22.050305 24825 leader_election.cc:290] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Requested vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), a09fd0dde7fc4241aecc9690b427e9e2 (127.15.191.68:38373)
I20260709 12:13:22.051120 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64549835910a439993d28800bb571368"
I20260709 12:13:22.051492 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34a6dd30e6245b78f15838141fac042" candidate_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a09fd0dde7fc4241aecc9690b427e9e2"
I20260709 12:13:22.051796 24166 raft_consensus.cc:3055] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.052122 24166 raft_consensus.cc:740] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 64549835910a439993d28800bb571368, State: Running, Role: LEADER
I20260709 12:13:22.052145 24240 raft_consensus.cc:3060] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.052814 24166 consensus_queue.cc:260] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:22.053979 24166 raft_consensus.cc:3060] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.060761 24240 raft_consensus.cc:2468] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:22.061280 24166 raft_consensus.cc:2468] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c4e12b81e44dae8a76443acdf7b9c9 in term 2.
I20260709 12:13:22.062304 24775 leader_election.cc:304] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c4e12b81e44dae8a76443acdf7b9c9, a09fd0dde7fc4241aecc9690b427e9e2; no voters: 
I20260709 12:13:22.063329 25127 raft_consensus.cc:2804] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.063782 25127 raft_consensus.cc:697] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79c4e12b81e44dae8a76443acdf7b9c9, State: Running, Role: LEADER
I20260709 12:13:22.064608 25127 consensus_queue.cc:237] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:22.073720 23912 catalog_manager.cc:5697] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 reported cstate change: term changed from 1 to 2, leader changed from 64549835910a439993d28800bb571368 (127.15.191.67) to 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.587509 24240 raft_consensus.cc:1275] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.588855 25130 consensus_queue.cc:1048] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.601231 24164 raft_consensus.cc:1275] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Refusing update from remote peer 79c4e12b81e44dae8a76443acdf7b9c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.604521 25127 consensus_queue.cc:1048] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.067407 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.110201 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:23.111407 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:23.111910 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.151103 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.195513 16125 tablet_server.cc:179] TabletServer@127.15.191.65:39103 shutting down...
W20260709 12:13:23.231951 24206 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 70 similar messages]
I20260709 12:13:23.236593 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:23.237926 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.238909 16125 raft_consensus.cc:2243] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.240767 16125 raft_consensus.cc:2272] T 93d640b1b4aa4e8597d224281ede6bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.241436 24132 consensus_peers.cc:597] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.244036 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.245208 16125 raft_consensus.cc:2243] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.246418 16125 raft_consensus.cc:2272] T 09559716fd22441c954a4dbae0e41bee P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.250324 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.251433 16125 raft_consensus.cc:2243] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.252043 16125 raft_consensus.cc:2272] T e0856b61c9894cf4b8c1c263d489820c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.255117 24206 consensus_peers.cc:597] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.256592 24206 consensus_peers.cc:597] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.258136 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.259373 16125 raft_consensus.cc:2243] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.261121 16125 raft_consensus.cc:2272] T 7918e606532f446790aa9cebeb9a352c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.264815 16125 tablet_replica.cc:333] stopping tablet replica
W20260709 12:13:23.265735 24206 consensus_peers.cc:597] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.265753 16125 raft_consensus.cc:2243] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.267890 16125 raft_consensus.cc:2272] T bd24d61e68c14dc19d3ad5de5931d613 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.272400 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.273514 16125 raft_consensus.cc:2243] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.274163 16125 raft_consensus.cc:2272] T 86266bc0f0914a64b02089b09f4d3b72 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.272512 24132 consensus_peers.cc:597] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.275280 24206 consensus_peers.cc:597] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.279690 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.281023 16125 raft_consensus.cc:2243] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:23.281102 24058 consensus_peers.cc:597] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.281618 16125 raft_consensus.cc:2272] T 7559f65287ff4852a45d740197ae4aba P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.284101 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.284840 16125 raft_consensus.cc:2243] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.285249 16125 raft_consensus.cc:2272] T 697dc1c079f448c0af165ab489b3160c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.287540 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.288166 16125 raft_consensus.cc:2243] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.289008 16125 raft_consensus.cc:2272] T 06cfd576beb2433d8ab615466d50bcc2 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.291302 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.291941 16125 raft_consensus.cc:2243] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.292411 16125 raft_consensus.cc:2272] T 8cdd42c9876a43b087358f4d8b08b81b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.294898 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.295512 16125 raft_consensus.cc:2243] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.296347 16125 raft_consensus.cc:2272] T b5d21190dc1a46b8bfecc2773603fe9d P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.299003 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.299808 16125 raft_consensus.cc:2243] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.300356 16125 raft_consensus.cc:2272] T 4e9c43c99da4449caafff73d83486d50 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.303493 16125 tablet_replica.cc:333] stopping tablet replica
W20260709 12:13:23.303737 24206 consensus_peers.cc:597] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.304379 16125 raft_consensus.cc:2243] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.305343 16125 raft_consensus.cc:2272] T 3e594133f84a47ecacfe0bf75b3bc5fc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.307602 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.308238 16125 raft_consensus.cc:2243] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.308691 16125 raft_consensus.cc:2272] T 4c60f2ad0a90425db97febd2ea86c08a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.310983 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.311630 16125 raft_consensus.cc:2243] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.312083 16125 raft_consensus.cc:2272] T 8bb82c3e798f4870b3983a6831c6d557 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.314386 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.315009 16125 raft_consensus.cc:2243] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.315433 16125 raft_consensus.cc:2272] T b860e1a11c0242ad8dae706485a5419b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.317715 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.318492 16125 raft_consensus.cc:2243] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.318943 16125 raft_consensus.cc:2272] T 17c227f268a94d11b528c1a35d162d3c P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.321595 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.322350 16125 raft_consensus.cc:2243] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.322811 16125 raft_consensus.cc:2272] T bc5d631983484182a825fde0a0978a80 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.325150 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.325736 16125 raft_consensus.cc:2243] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.326267 16125 raft_consensus.cc:2272] T 85c9cc57f4f24208a3b0775820818bad P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.328927 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.329661 16125 raft_consensus.cc:2243] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.330200 16125 raft_consensus.cc:2272] T 1f9744f06e3f482d89a3a72e5a9c09bf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.332464 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.333139 16125 raft_consensus.cc:2243] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.333670 16125 raft_consensus.cc:2272] T 60dc51b1981640db8864178385eb2de3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.336863 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.337765 16125 raft_consensus.cc:2243] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.338363 16125 raft_consensus.cc:2272] T dd67df6137e94222b5862ed8999d37cc P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.342152 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.342998 16125 raft_consensus.cc:2243] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:13:23.343863 24206 consensus_peers.cc:597] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.344175 16125 raft_consensus.cc:2272] T 72b8c550cc124fddb066006c81a6b29e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.346913 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.347735 16125 raft_consensus.cc:2243] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.348280 16125 raft_consensus.cc:2272] T 436b14790f4a4768ae4f66430c025d3b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.351409 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.352133 16125 raft_consensus.cc:2243] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.352605 16125 raft_consensus.cc:2272] T a875213f1f8a4efd8894c71d54fa8a48 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.355222 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.355877 16125 raft_consensus.cc:2243] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.356315 16125 raft_consensus.cc:2272] T 236a44f6e6b740ebbf1fb3b1f367f36a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.358893 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.359570 16125 raft_consensus.cc:2243] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.359997 16125 raft_consensus.cc:2272] T dc0615d91a3b4e4b9b9d501f055a3116 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.362325 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.363083 16125 raft_consensus.cc:2243] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.363618 16125 raft_consensus.cc:2272] T abb87e12877743478bd71c5023fe4335 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.366816 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.367653 16125 raft_consensus.cc:2243] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:13:23.368194 24058 consensus_peers.cc:597] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.368623 16125 raft_consensus.cc:2272] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.371099 24132 consensus_peers.cc:597] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.371902 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.372574 16125 raft_consensus.cc:2243] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.373360 16125 raft_consensus.cc:2272] T 07d527b984d44ebd82ac7b1d7d81efbf P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.375813 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.376402 16125 raft_consensus.cc:2243] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.377274 16125 raft_consensus.cc:2272] T 9ca6ef4edba6432d990cf875232d420b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.379566 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.380170 16125 raft_consensus.cc:2243] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.380605 16125 raft_consensus.cc:2272] T 07bf8aa11eb9402cbf4870c19cce296a P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.382833 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.383387 16125 raft_consensus.cc:2243] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.384160 16125 raft_consensus.cc:2272] T c34a6dd30e6245b78f15838141fac042 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.386688 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.387287 16125 raft_consensus.cc:2243] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.387729 16125 raft_consensus.cc:2272] T a74ffb149b7a4384b643ebcc07463911 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.389741 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.390318 16125 raft_consensus.cc:2243] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.391114 16125 raft_consensus.cc:2272] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.393776 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.394520 16125 raft_consensus.cc:2243] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.395159 16125 raft_consensus.cc:2272] T cebff22f432748299ffa8b2a93663d6b P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.395288 24058 consensus_peers.cc:597] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.398435 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.399183 16125 raft_consensus.cc:2243] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.399657 16125 raft_consensus.cc:2272] T 222f5f64725d4c94803b2d55242cc5dd P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.400249 24132 consensus_peers.cc:597] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.402207 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.402858 16125 raft_consensus.cc:2243] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.403219 16125 raft_consensus.cc:2272] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.405383 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.405903 16125 raft_consensus.cc:2243] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.406311 16125 raft_consensus.cc:2272] T 0501208ef99042209ace59e3d1f4bb67 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.408407 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.408968 16125 raft_consensus.cc:2243] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.409412 16125 raft_consensus.cc:2272] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.411840 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.412494 16125 raft_consensus.cc:2243] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.412982 16125 raft_consensus.cc:2272] T 2a1cc59fceea40e599cdbcb075f486d6 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.414841 24206 consensus_peers.cc:597] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.415917 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.416574 16125 raft_consensus.cc:2243] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:23.416585 24206 consensus_peers.cc:597] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.417179 16125 raft_consensus.cc:2272] T df9e86df293f4b48931332e8e90ea10e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.419752 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.420276 16125 raft_consensus.cc:2243] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.421111 16125 raft_consensus.cc:2272] T 407b0af97117450fb56d6991d8fa8649 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.423354 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:23.423840 16125 raft_consensus.cc:2243] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.424741 16125 raft_consensus.cc:2272] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 79c4e12b81e44dae8a76443acdf7b9c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.427520 16125 tablet_replica.cc:333] stopping tablet replica
W20260709 12:13:23.428109 24132 consensus_peers.cc:597] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.428139 16125 raft_consensus.cc:2243] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.429003 16125 raft_consensus.cc:2272] T 2220bd387f5e420da98f649ad6b2c37e P 79c4e12b81e44dae8a76443acdf7b9c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.435804 24058 consensus_peers.cc:597] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.451207 24132 consensus_peers.cc:597] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.497001 24132 consensus_peers.cc:597] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.504868 16125 tablet_server.cc:196] TabletServer@127.15.191.65:39103 shutdown complete.
W20260709 12:13:23.514921 24206 consensus_peers.cc:597] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.526276 24058 consensus_peers.cc:597] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.529831 24058 consensus_peers.cc:597] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.546609 24058 consensus_peers.cc:597] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.587210 24132 consensus_peers.cc:597] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.590221 24058 consensus_peers.cc:597] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.595142 24132 consensus_peers.cc:597] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.595351 24058 consensus_peers.cc:597] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.599051 16125 tablet_server.cc:179] TabletServer@127.15.191.66:0 shutting down...
W20260709 12:13:23.630650 24058 consensus_peers.cc:597] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.641142 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:13:23.641350 24132 consensus_peers.cc:597] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.642241 16125 tablet_replica.cc:333] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.643308 16125 raft_consensus.cc:2243] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.644341 16125 raft_consensus.cc:2272] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.647358 16125 tablet_replica.cc:333] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.648072 16125 raft_consensus.cc:2243] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.648578 16125 raft_consensus.cc:2272] T e0856b61c9894cf4b8c1c263d489820c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.650934 16125 tablet_replica.cc:333] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.651558 16125 raft_consensus.cc:2243] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.652379 16125 raft_consensus.cc:2272] T 8bb82c3e798f4870b3983a6831c6d557 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.654393 16125 tablet_replica.cc:333] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.654979 16125 raft_consensus.cc:2243] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.655963 16125 raft_consensus.cc:2272] T bc5d631983484182a825fde0a0978a80 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.658375 16125 tablet_replica.cc:333] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.659024 16125 raft_consensus.cc:2243] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.659595 16125 raft_consensus.cc:2272] T 7918e606532f446790aa9cebeb9a352c P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.662891 16125 tablet_replica.cc:333] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.663862 16125 raft_consensus.cc:2243] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.664427 16125 raft_consensus.cc:2272] T 681e0b6a8f05478181aa1dc9948e0733 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.665604 24205 consensus_peers.cc:597] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.667487 16125 tablet_replica.cc:333] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
W20260709 12:13:23.667426 24131 consensus_peers.cc:597] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.668475 16125 raft_consensus.cc:2243] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.669124 16125 raft_consensus.cc:2272] T 7976327d03e6414599da68409facb2f6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.671582 16125 tablet_replica.cc:333] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.672207 16125 raft_consensus.cc:2243] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.672688 16125 raft_consensus.cc:2272] T 72b8c550cc124fddb066006c81a6b29e P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.674996 16125 tablet_replica.cc:333] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.675604 16125 raft_consensus.cc:2243] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.676096 16125 raft_consensus.cc:2272] T bce9b63ea2f94082afd9e5a2fb11cc9c P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.678287 16125 tablet_replica.cc:333] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.678915 16125 raft_consensus.cc:2243] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.679345 16125 raft_consensus.cc:2272] T cebff22f432748299ffa8b2a93663d6b P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.681469 16125 tablet_replica.cc:333] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.682080 16125 raft_consensus.cc:2243] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.682976 16125 raft_consensus.cc:2272] T 436b14790f4a4768ae4f66430c025d3b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.685513 16125 tablet_replica.cc:333] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.686311 16125 raft_consensus.cc:2243] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.686897 16125 raft_consensus.cc:2272] T b5d21190dc1a46b8bfecc2773603fe9d P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.689895 16125 tablet_replica.cc:333] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.690816 16125 raft_consensus.cc:2243] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:23.691129 24205 consensus_peers.cc:597] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.692015 16125 raft_consensus.cc:2272] T 5e842427bd574b6092b1d303499a2269 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.695361 16125 tablet_replica.cc:333] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.696291 16125 raft_consensus.cc:2243] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.696928 16125 raft_consensus.cc:2272] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.700179 16125 tablet_replica.cc:333] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.701085 16125 raft_consensus.cc:2243] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:23.701224 24205 consensus_peers.cc:597] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.701737 16125 raft_consensus.cc:2272] T a8150bdbea834ed8bab225a9388ab34e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.703966 24131 consensus_peers.cc:597] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.705029 16125 tablet_replica.cc:333] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.706698 16125 raft_consensus.cc:2243] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.707337 16125 raft_consensus.cc:2272] T 0501208ef99042209ace59e3d1f4bb67 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.710767 16125 tablet_replica.cc:333] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
W20260709 12:13:23.711385 24206 consensus_peers.cc:597] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Couldn't send request to peer 79c4e12b81e44dae8a76443acdf7b9c9. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.711560 16125 raft_consensus.cc:2243] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.715068 16125 raft_consensus.cc:2272] T 17c227f268a94d11b528c1a35d162d3c P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.718024 16125 tablet_replica.cc:333] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.718942 16125 raft_consensus.cc:2243] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.720054 16125 raft_consensus.cc:2272] T b860e1a11c0242ad8dae706485a5419b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.723251 16125 tablet_replica.cc:333] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.724143 16125 raft_consensus.cc:2243] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.724718 16125 raft_consensus.cc:2272] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.727685 16125 tablet_replica.cc:333] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.728484 16125 raft_consensus.cc:2243] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.729045 16125 raft_consensus.cc:2272] T bd24d61e68c14dc19d3ad5de5931d613 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.730050 24131 consensus_peers.cc:597] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.731546 16125 tablet_replica.cc:333] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.732256 16125 raft_consensus.cc:2243] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.732703 16125 raft_consensus.cc:2272] T 5c3ede10da664710af54f48f42e1ab43 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.734838 16125 tablet_replica.cc:333] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.735455 16125 raft_consensus.cc:2243] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.736276 16125 raft_consensus.cc:2272] T 7559f65287ff4852a45d740197ae4aba P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.738350 16125 tablet_replica.cc:333] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.738956 16125 raft_consensus.cc:2243] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.739782 16125 raft_consensus.cc:2272] T 86266bc0f0914a64b02089b09f4d3b72 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.742002 16125 tablet_replica.cc:333] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.742642 16125 raft_consensus.cc:2243] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.743446 16125 raft_consensus.cc:2272] T a875213f1f8a4efd8894c71d54fa8a48 P 7beb24294eb94c1c8cf7659b8c507b46 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.745380 16125 tablet_replica.cc:333] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.745947 16125 raft_consensus.cc:2243] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.746827 16125 raft_consensus.cc:2272] T 236a44f6e6b740ebbf1fb3b1f367f36a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.748808 16125 tablet_replica.cc:333] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.749385 16125 raft_consensus.cc:2243] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.750211 16125 raft_consensus.cc:2272] T 890a157efb254124a8fa371cfcda5616 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.752166 16125 tablet_replica.cc:333] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.752725 16125 raft_consensus.cc:2243] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.753149 16125 raft_consensus.cc:2272] T 07bf8aa11eb9402cbf4870c19cce296a P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.755061 16125 tablet_replica.cc:333] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.755623 16125 raft_consensus.cc:2243] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.756407 16125 raft_consensus.cc:2272] T 2220bd387f5e420da98f649ad6b2c37e P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.758991 16125 tablet_replica.cc:333] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.759693 16125 raft_consensus.cc:2243] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.760216 16125 raft_consensus.cc:2272] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 7beb24294eb94c1c8cf7659b8c507b46 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.762349 16125 tablet_replica.cc:333] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.762864 16125 raft_consensus.cc:2243] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.763281 16125 raft_consensus.cc:2272] T 1f9744f06e3f482d89a3a72e5a9c09bf P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.767009 16125 tablet_replica.cc:333] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.767797 16125 raft_consensus.cc:2243] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.768360 16125 raft_consensus.cc:2272] T 2a1cc59fceea40e599cdbcb075f486d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.770732 16125 tablet_replica.cc:333] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.771293 16125 raft_consensus.cc:2243] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.771740 16125 raft_consensus.cc:2272] T 4c60f2ad0a90425db97febd2ea86c08a P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.774194 16125 tablet_replica.cc:333] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.774892 16125 raft_consensus.cc:2243] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.775414 16125 raft_consensus.cc:2272] T 3e594133f84a47ecacfe0bf75b3bc5fc P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.778200 16125 tablet_replica.cc:333] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.778918 16125 raft_consensus.cc:2243] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.779835 16125 raft_consensus.cc:2272] T df9e86df293f4b48931332e8e90ea10e P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.780802 24205 consensus_peers.cc:597] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.782266 16125 tablet_replica.cc:333] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.782912 16125 raft_consensus.cc:2243] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.783812 16125 raft_consensus.cc:2272] T 9b9e9352fdad40bca805117f2fdbaaa3 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.786356 16125 tablet_replica.cc:333] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
W20260709 12:13:23.786414 24205 consensus_peers.cc:597] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.787094 16125 raft_consensus.cc:2243] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.787572 16125 raft_consensus.cc:2272] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.789628 16125 tablet_replica.cc:333] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.790232 16125 raft_consensus.cc:2243] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.790746 16125 raft_consensus.cc:2272] T 8cdd42c9876a43b087358f4d8b08b81b P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.792897 16125 tablet_replica.cc:333] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.793499 16125 raft_consensus.cc:2243] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.793917 16125 raft_consensus.cc:2272] T f203904cd1b94afca969b8b361e196b8 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.796010 16125 tablet_replica.cc:333] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.796667 16125 raft_consensus.cc:2243] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.797084 16125 raft_consensus.cc:2272] T 7e57bd7f92b1482cb38beba49eccfb37 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.799515 16125 tablet_replica.cc:333] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.800318 16125 raft_consensus.cc:2243] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.800776 16125 raft_consensus.cc:2272] T eaf1985e29d943909e299c616813e9a6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.803551 16125 tablet_replica.cc:333] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.804258 16125 raft_consensus.cc:2243] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.805305 16125 raft_consensus.cc:2272] T b4028cf0a93848479c9e713d7e2bc5d6 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.808075 16125 tablet_replica.cc:333] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.808593 16125 raft_consensus.cc:2243] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.808983 16125 raft_consensus.cc:2272] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.811009 16125 tablet_replica.cc:333] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.811474 16125 raft_consensus.cc:2243] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.811885 16125 raft_consensus.cc:2272] T a74ffb149b7a4384b643ebcc07463911 P 7beb24294eb94c1c8cf7659b8c507b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.813933 16125 tablet_replica.cc:333] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46: stopping tablet replica
I20260709 12:13:23.814409 16125 raft_consensus.cc:2243] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.814810 16125 raft_consensus.cc:2272] T 93d640b1b4aa4e8597d224281ede6bad P 7beb24294eb94c1c8cf7659b8c507b46 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.858811 24205 consensus_peers.cc:597] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.890928 16125 tablet_server.cc:196] TabletServer@127.15.191.66:0 shutdown complete.
W20260709 12:13:23.903771 24131 consensus_peers.cc:597] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.931898 24205 consensus_peers.cc:597] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.935134 24205 consensus_peers.cc:597] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.947852 24131 consensus_peers.cc:597] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.979112 16125 tablet_server.cc:179] TabletServer@127.15.191.67:0 shutting down...
W20260709 12:13:23.992332 24205 consensus_peers.cc:597] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:24.023689 24131 consensus_peers.cc:597] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.027920 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:13:24.029366 24131 consensus_peers.cc:597] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.029624 16125 tablet_replica.cc:333] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.030745 16125 raft_consensus.cc:2243] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.031231 16125 raft_consensus.cc:2272] T 8bb82c3e798f4870b3983a6831c6d557 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:24.032750 24205 consensus_peers.cc:597] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.033469 16125 tablet_replica.cc:333] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.034163 16125 raft_consensus.cc:2243] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.034643 16125 raft_consensus.cc:2272] T 09559716fd22441c954a4dbae0e41bee P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.036763 16125 tablet_replica.cc:333] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.037392 16125 raft_consensus.cc:2243] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.037839 16125 raft_consensus.cc:2272] T 2f1ebf08df17449aa47d4ffc0d7b03d3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.039979 16125 tablet_replica.cc:333] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.040648 16125 raft_consensus.cc:2243] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.041046 16125 raft_consensus.cc:2272] T bc5d631983484182a825fde0a0978a80 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.043084 16125 tablet_replica.cc:333] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.043641 16125 raft_consensus.cc:2243] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.044600 16125 raft_consensus.cc:2272] T 60dc51b1981640db8864178385eb2de3 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.046985 16125 tablet_replica.cc:333] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.047688 16125 raft_consensus.cc:2243] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.048146 16125 raft_consensus.cc:2272] T 681e0b6a8f05478181aa1dc9948e0733 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.050330 16125 tablet_replica.cc:333] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.050913 16125 raft_consensus.cc:2243] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.051330 16125 raft_consensus.cc:2272] T 7976327d03e6414599da68409facb2f6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.053231 16125 tablet_replica.cc:333] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.053834 16125 raft_consensus.cc:2243] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.054283 16125 raft_consensus.cc:2272] T dd67df6137e94222b5862ed8999d37cc P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.056172 16125 tablet_replica.cc:333] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.056715 16125 raft_consensus.cc:2243] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.057485 16125 raft_consensus.cc:2272] T 4c60f2ad0a90425db97febd2ea86c08a P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.059389 16125 tablet_replica.cc:333] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.059926 16125 raft_consensus.cc:2243] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.060313 16125 raft_consensus.cc:2272] T 4e9c43c99da4449caafff73d83486d50 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.062430 16125 tablet_replica.cc:333] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.063979 16125 raft_consensus.cc:2243] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.065804 16125 raft_consensus.cc:2272] T 72b8c550cc124fddb066006c81a6b29e P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:24.065923 24206 consensus_peers.cc:597] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.069792 16125 tablet_replica.cc:333] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.070582 16125 raft_consensus.cc:2243] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:13:24.071151 24131 consensus_peers.cc:597] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.071481 16125 raft_consensus.cc:2272] T bce9b63ea2f94082afd9e5a2fb11cc9c P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.073639 16125 tablet_replica.cc:333] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.074280 16125 raft_consensus.cc:2243] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.074718 16125 raft_consensus.cc:2272] T 93d640b1b4aa4e8597d224281ede6bad P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.076746 16125 tablet_replica.cc:333] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.077327 16125 raft_consensus.cc:2243] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.077778 16125 raft_consensus.cc:2272] T 5e842427bd574b6092b1d303499a2269 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.079844 16125 tablet_replica.cc:333] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.080432 16125 raft_consensus.cc:2243] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.080862 16125 raft_consensus.cc:2272] T 2220bd387f5e420da98f649ad6b2c37e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.082851 16125 tablet_replica.cc:333] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.083420 16125 raft_consensus.cc:2243] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.083832 16125 raft_consensus.cc:2272] T 1f0b9a2a93994fa2b4a1b3f3448a7744 P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.086488 16125 tablet_replica.cc:333] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.087368 16125 raft_consensus.cc:2243] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.088263 16125 raft_consensus.cc:2272] T 85c9cc57f4f24208a3b0775820818bad P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.090790 16125 tablet_replica.cc:333] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.091512 16125 raft_consensus.cc:2243] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.092695 16125 raft_consensus.cc:2272] T 1f9744f06e3f482d89a3a72e5a9c09bf P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.095661 16125 tablet_replica.cc:333] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368: stopping tablet replica
W20260709 12:13:24.096474 24205 consensus_peers.cc:597] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.096562 16125 raft_consensus.cc:2243] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.097555 16125 raft_consensus.cc:2272] T b860e1a11c0242ad8dae706485a5419b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.099932 16125 tablet_replica.cc:333] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.100723 16125 raft_consensus.cc:2243] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.101766 16125 raft_consensus.cc:2272] T 07bf8aa11eb9402cbf4870c19cce296a P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.104476 16125 tablet_replica.cc:333] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.105197 16125 raft_consensus.cc:2243] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.105788 16125 raft_consensus.cc:2272] T 890a157efb254124a8fa371cfcda5616 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:24.106168 24206 consensus_peers.cc:597] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.108554 16125 tablet_replica.cc:333] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.109418 16125 raft_consensus.cc:2243] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.109903 16125 raft_consensus.cc:2272] T c34a6dd30e6245b78f15838141fac042 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.112076 16125 tablet_replica.cc:333] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.112679 16125 raft_consensus.cc:2243] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.113451 16125 raft_consensus.cc:2272] T 222f5f64725d4c94803b2d55242cc5dd P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.115584 16125 tablet_replica.cc:333] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.116161 16125 raft_consensus.cc:2243] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.116901 16125 raft_consensus.cc:2272] T 7e57bd7f92b1482cb38beba49eccfb37 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.118813 16125 tablet_replica.cc:333] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.119366 16125 raft_consensus.cc:2243] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.119772 16125 raft_consensus.cc:2272] T eaf1985e29d943909e299c616813e9a6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.121685 16125 tablet_replica.cc:333] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.122270 16125 raft_consensus.cc:2243] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.122676 16125 raft_consensus.cc:2272] T 07d527b984d44ebd82ac7b1d7d81efbf P 64549835910a439993d28800bb571368 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.124523 16125 tablet_replica.cc:333] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.125139 16125 raft_consensus.cc:2243] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.125501 16125 raft_consensus.cc:2272] T dc0615d91a3b4e4b9b9d501f055a3116 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.127514 16125 tablet_replica.cc:333] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.128182 16125 raft_consensus.cc:2243] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.128961 16125 raft_consensus.cc:2272] T abb87e12877743478bd71c5023fe4335 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:24.130590 24206 consensus_peers.cc:597] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.131156 16125 tablet_replica.cc:333] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.131781 16125 raft_consensus.cc:2243] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.132261 16125 raft_consensus.cc:2272] T 172aa0d42e8646ce8e9b3ef01f4628d6 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.134341 16125 tablet_replica.cc:333] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.134898 16125 raft_consensus.cc:2243] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.135313 16125 raft_consensus.cc:2272] T 9b9e9352fdad40bca805117f2fdbaaa3 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.137934 16125 tablet_replica.cc:333] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.138800 16125 raft_consensus.cc:2243] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.139907 16125 raft_consensus.cc:2272] T f203904cd1b94afca969b8b361e196b8 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.142630 16125 tablet_replica.cc:333] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.143354 16125 raft_consensus.cc:2243] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.143893 16125 raft_consensus.cc:2272] T 5c3ede10da664710af54f48f42e1ab43 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:24.144586 24205 consensus_peers.cc:597] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Couldn't send request to peer 7beb24294eb94c1c8cf7659b8c507b46. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.146376 16125 tablet_replica.cc:333] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.147013 16125 raft_consensus.cc:2243] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.147847 16125 raft_consensus.cc:2272] T 697dc1c079f448c0af165ab489b3160c P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.150030 16125 tablet_replica.cc:333] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.150633 16125 raft_consensus.cc:2243] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.151081 16125 raft_consensus.cc:2272] T 7559f65287ff4852a45d740197ae4aba P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.153108 16125 tablet_replica.cc:333] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.153631 16125 raft_consensus.cc:2243] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.154042 16125 raft_consensus.cc:2272] T 9ca6ef4edba6432d990cf875232d420b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.156018 16125 tablet_replica.cc:333] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.156561 16125 raft_consensus.cc:2243] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.156966 16125 raft_consensus.cc:2272] T 3e13faa2c04f46039c7c9b1d8021cbd0 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.158836 16125 tablet_replica.cc:333] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.159376 16125 raft_consensus.cc:2243] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.159787 16125 raft_consensus.cc:2272] T 06cfd576beb2433d8ab615466d50bcc2 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.161808 16125 tablet_replica.cc:333] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.162372 16125 raft_consensus.cc:2243] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.163148 16125 raft_consensus.cc:2272] T 2a1cc59fceea40e599cdbcb075f486d6 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.164978 16125 tablet_replica.cc:333] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.165483 16125 raft_consensus.cc:2243] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.166275 16125 raft_consensus.cc:2272] T a8150bdbea834ed8bab225a9388ab34e P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.168273 16125 tablet_replica.cc:333] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.168787 16125 raft_consensus.cc:2243] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.169551 16125 raft_consensus.cc:2272] T 255ee2f56d7d4b8fa52384cf5cb1def8 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.171555 16125 tablet_replica.cc:333] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.172061 16125 raft_consensus.cc:2243] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.172488 16125 raft_consensus.cc:2272] T 436b14790f4a4768ae4f66430c025d3b P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.174490 16125 tablet_replica.cc:333] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.174991 16125 raft_consensus.cc:2243] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.175400 16125 raft_consensus.cc:2272] T b4028cf0a93848479c9e713d7e2bc5d6 P 64549835910a439993d28800bb571368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.177397 16125 tablet_replica.cc:333] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.177881 16125 raft_consensus.cc:2243] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.178695 16125 raft_consensus.cc:2272] T bf5b9f7ee4754dc8bcef9a96c67021d7 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.180560 16125 tablet_replica.cc:333] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368: stopping tablet replica
I20260709 12:13:24.181005 16125 raft_consensus.cc:2243] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.181438 16125 raft_consensus.cc:2272] T 407b0af97117450fb56d6991d8fa8649 P 64549835910a439993d28800bb571368 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:24.241753 24206 consensus_peers.cc:597] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.67:35877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.251070 16125 tablet_server.cc:196] TabletServer@127.15.191.67:0 shutdown complete.
W20260709 12:13:24.258580 24206 consensus_peers.cc:597] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.67:35877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:24.277670 24206 consensus_peers.cc:597] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.67:35877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.298038 25161 raft_consensus.cc:493] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:24.298782 25161 raft_consensus.cc:515] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:24.302117 25161 leader_election.cc:290] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
W20260709 12:13:24.306934 24205 leader_election.cc:336] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111)
W20260709 12:13:24.307891 24206 leader_election.cc:336] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111)
I20260709 12:13:24.308351 24206 leader_election.cc:304] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:24.309083 25114 raft_consensus.cc:2749] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:24.309492 24206 consensus_peers.cc:597] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.67:35877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.327111 25114 raft_consensus.cc:493] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:24.327632 25114 raft_consensus.cc:515] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:24.329823 25114 leader_election.cc:290] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:24.333724 16125 tablet_server.cc:179] TabletServer@127.15.191.68:0 shutting down...
W20260709 12:13:24.335542 24205 leader_election.cc:336] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111)
W20260709 12:13:24.336961 24206 leader_election.cc:336] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111)
I20260709 12:13:24.337514 24206 leader_election.cc:304] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:24.338157 25114 raft_consensus.cc:2749] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:24.338645 24206 consensus_peers.cc:597] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 -> Peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Couldn't send request to peer 64549835910a439993d28800bb571368. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.67:35877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.349103 25114 raft_consensus.cc:493] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:24.349800 25114 raft_consensus.cc:515] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64549835910a439993d28800bb571368" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 35877 } } peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } }
I20260709 12:13:24.352849 25114 leader_election.cc:290] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 64549835910a439993d28800bb571368 (127.15.191.67:35877), 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103)
W20260709 12:13:24.357615 24206 leader_election.cc:336] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 64549835910a439993d28800bb571368 (127.15.191.67:35877): Network error: Client connection negotiation failed: client connection to 127.15.191.67:35877: connect: Connection refused (error 111)
W20260709 12:13:24.358397 24206 leader_election.cc:336] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111)
I20260709 12:13:24.359320 24206 leader_election.cc:304] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 64549835910a439993d28800bb571368, 79c4e12b81e44dae8a76443acdf7b9c9
I20260709 12:13:24.360174 25114 raft_consensus.cc:2749] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:24.374818 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:24.375749 16125 tablet_replica.cc:333] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.376468 16125 raft_consensus.cc:2243] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.377015 16125 raft_consensus.cc:2272] T 85c9cc57f4f24208a3b0775820818bad P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.380002 16125 tablet_replica.cc:333] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.380759 16125 raft_consensus.cc:2243] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.381637 16125 raft_consensus.cc:2272] T e0856b61c9894cf4b8c1c263d489820c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.383646 16125 tablet_replica.cc:333] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.384243 16125 raft_consensus.cc:2243] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.384711 16125 raft_consensus.cc:2272] T 09559716fd22441c954a4dbae0e41bee P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.386844 16125 tablet_replica.cc:333] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.387411 16125 raft_consensus.cc:2243] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.387833 16125 raft_consensus.cc:2272] T 60dc51b1981640db8864178385eb2de3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.389813 16125 tablet_replica.cc:333] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.390424 16125 raft_consensus.cc:2243] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.390897 16125 raft_consensus.cc:2272] T 7918e606532f446790aa9cebeb9a352c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.392966 16125 tablet_replica.cc:333] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.393515 16125 raft_consensus.cc:2243] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.394311 16125 raft_consensus.cc:2272] T 681e0b6a8f05478181aa1dc9948e0733 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.396262 16125 tablet_replica.cc:333] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.396795 16125 raft_consensus.cc:2243] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.397574 16125 raft_consensus.cc:2272] T 7976327d03e6414599da68409facb2f6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.398768 25114 raft_consensus.cc:493] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79c4e12b81e44dae8a76443acdf7b9c9)
I20260709 12:13:24.399310 25114 raft_consensus.cc:515] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a09fd0dde7fc4241aecc9690b427e9e2" member_type: VOTER last_known_addr { host: "127.15.191.68" port: 38373 } } peers { permanent_uuid: "79c4e12b81e44dae8a76443acdf7b9c9" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39103 } } peers { permanent_uuid: "7beb24294eb94c1c8cf7659b8c507b46" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 38037 } }
I20260709 12:13:24.400010 16125 tablet_replica.cc:333] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.400939 16125 raft_consensus.cc:2243] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.402005 16125 raft_consensus.cc:2272] T dd67df6137e94222b5862ed8999d37cc P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.404974 16125 tablet_replica.cc:333] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.405864 16125 raft_consensus.cc:2243] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.406951 16125 raft_consensus.cc:2272] T 17c227f268a94d11b528c1a35d162d3c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:24.407779 24206 leader_election.cc:336] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39103: connect: Connection refused (error 111)
W20260709 12:13:24.408465 24205 leader_election.cc:336] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037): Network error: Client connection negotiation failed: client connection to 127.15.191.66:38037: connect: Connection refused (error 111)
I20260709 12:13:24.408872 24205 leader_election.cc:304] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a09fd0dde7fc4241aecc9690b427e9e2; no voters: 79c4e12b81e44dae8a76443acdf7b9c9, 7beb24294eb94c1c8cf7659b8c507b46
I20260709 12:13:24.409729 25156 raft_consensus.cc:2749] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:24.410000 16125 tablet_replica.cc:333] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.406824 25114 leader_election.cc:290] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79c4e12b81e44dae8a76443acdf7b9c9 (127.15.191.65:39103), 7beb24294eb94c1c8cf7659b8c507b46 (127.15.191.66:38037)
I20260709 12:13:24.410959 16125 raft_consensus.cc:2243] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.411468 16125 raft_consensus.cc:2272] T bce9b63ea2f94082afd9e5a2fb11cc9c P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.413542 16125 tablet_replica.cc:333] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.414151 16125 raft_consensus.cc:2243] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.414938 16125 raft_consensus.cc:2272] T cebff22f432748299ffa8b2a93663d6b P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.416911 16125 tablet_replica.cc:333] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.417485 16125 raft_consensus.cc:2243] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.418291 16125 raft_consensus.cc:2272] T 4e9c43c99da4449caafff73d83486d50 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.420531 16125 tablet_replica.cc:333] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.421084 16125 raft_consensus.cc:2243] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.421492 16125 raft_consensus.cc:2272] T b5d21190dc1a46b8bfecc2773603fe9d P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.423393 16125 tablet_replica.cc:333] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.423961 16125 raft_consensus.cc:2243] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.424381 16125 raft_consensus.cc:2272] T 96e8cb56d54f4d83939a14ea7ffdd5c4 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.426494 16125 tablet_replica.cc:333] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.427042 16125 raft_consensus.cc:2243] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.427821 16125 raft_consensus.cc:2272] T a74ffb149b7a4384b643ebcc07463911 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.429891 16125 tablet_replica.cc:333] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.430502 16125 raft_consensus.cc:2243] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.430939 16125 raft_consensus.cc:2272] T a8150bdbea834ed8bab225a9388ab34e P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.432796 16125 tablet_replica.cc:333] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.433363 16125 raft_consensus.cc:2243] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.433792 16125 raft_consensus.cc:2272] T 255ee2f56d7d4b8fa52384cf5cb1def8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.435807 16125 tablet_replica.cc:333] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.436354 16125 raft_consensus.cc:2243] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.437150 16125 raft_consensus.cc:2272] T 0501208ef99042209ace59e3d1f4bb67 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.439203 16125 tablet_replica.cc:333] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.439767 16125 raft_consensus.cc:2243] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.440165 16125 raft_consensus.cc:2272] T 222f5f64725d4c94803b2d55242cc5dd P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.442003 16125 tablet_replica.cc:333] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.442570 16125 raft_consensus.cc:2243] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.442951 16125 raft_consensus.cc:2272] T 890a157efb254124a8fa371cfcda5616 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.444715 16125 tablet_replica.cc:333] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.445254 16125 raft_consensus.cc:2243] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.445648 16125 raft_consensus.cc:2272] T c34a6dd30e6245b78f15838141fac042 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.447417 16125 tablet_replica.cc:333] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.447974 16125 raft_consensus.cc:2243] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.448800 16125 raft_consensus.cc:2272] T 3e13faa2c04f46039c7c9b1d8021cbd0 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.450770 16125 tablet_replica.cc:333] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.451295 16125 raft_consensus.cc:2243] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.451722 16125 raft_consensus.cc:2272] T 06cfd576beb2433d8ab615466d50bcc2 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.453552 16125 tablet_replica.cc:333] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.454154 16125 raft_consensus.cc:2243] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.454560 16125 raft_consensus.cc:2272] T b4028cf0a93848479c9e713d7e2bc5d6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.456571 16125 tablet_replica.cc:333] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.457090 16125 raft_consensus.cc:2243] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.457480 16125 raft_consensus.cc:2272] T 07d527b984d44ebd82ac7b1d7d81efbf P a09fd0dde7fc4241aecc9690b427e9e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.459297 16125 tablet_replica.cc:333] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.459856 16125 raft_consensus.cc:2243] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.460248 16125 raft_consensus.cc:2272] T 9b9e9352fdad40bca805117f2fdbaaa3 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.462196 16125 tablet_replica.cc:333] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.462739 16125 raft_consensus.cc:2243] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.463526 16125 raft_consensus.cc:2272] T dc0615d91a3b4e4b9b9d501f055a3116 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.465364 16125 tablet_replica.cc:333] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.465885 16125 raft_consensus.cc:2243] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.466306 16125 raft_consensus.cc:2272] T abb87e12877743478bd71c5023fe4335 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.468192 16125 tablet_replica.cc:333] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.468925 16125 raft_consensus.cc:2243] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.469378 16125 raft_consensus.cc:2272] T df9e86df293f4b48931332e8e90ea10e P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.471271 16125 tablet_replica.cc:333] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.471765 16125 raft_consensus.cc:2243] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.472123 16125 raft_consensus.cc:2272] T 3e594133f84a47ecacfe0bf75b3bc5fc P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.474258 16125 tablet_replica.cc:333] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.474866 16125 raft_consensus.cc:2243] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.475344 16125 raft_consensus.cc:2272] T bf5b9f7ee4754dc8bcef9a96c67021d7 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.477324 16125 tablet_replica.cc:333] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.477921 16125 raft_consensus.cc:2243] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.478381 16125 raft_consensus.cc:2272] T 407b0af97117450fb56d6991d8fa8649 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.480273 16125 tablet_replica.cc:333] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.480770 16125 raft_consensus.cc:2243] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.481164 16125 raft_consensus.cc:2272] T f203904cd1b94afca969b8b361e196b8 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.483019 16125 tablet_replica.cc:333] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.483682 16125 raft_consensus.cc:2243] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.484509 16125 raft_consensus.cc:2272] T 8cdd42c9876a43b087358f4d8b08b81b P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.486670 16125 tablet_replica.cc:333] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.487246 16125 raft_consensus.cc:2243] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.487668 16125 raft_consensus.cc:2272] T 9ca6ef4edba6432d990cf875232d420b P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.489704 16125 tablet_replica.cc:333] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.490320 16125 raft_consensus.cc:2243] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.490759 16125 raft_consensus.cc:2272] T 7e57bd7f92b1482cb38beba49eccfb37 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.492684 16125 tablet_replica.cc:333] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.493238 16125 raft_consensus.cc:2243] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.494009 16125 raft_consensus.cc:2272] T eaf1985e29d943909e299c616813e9a6 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.496042 16125 tablet_replica.cc:333] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.496665 16125 raft_consensus.cc:2243] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.497092 16125 raft_consensus.cc:2272] T 5e842427bd574b6092b1d303499a2269 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.499112 16125 tablet_replica.cc:333] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.499656 16125 raft_consensus.cc:2243] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.500438 16125 raft_consensus.cc:2272] T bd24d61e68c14dc19d3ad5de5931d613 P a09fd0dde7fc4241aecc9690b427e9e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.502364 16125 tablet_replica.cc:333] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.502861 16125 raft_consensus.cc:2243] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.503417 16125 raft_consensus.cc:2272] T a875213f1f8a4efd8894c71d54fa8a48 P a09fd0dde7fc4241aecc9690b427e9e2 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.505321 16125 tablet_replica.cc:333] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.505834 16125 raft_consensus.cc:2243] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.506286 16125 raft_consensus.cc:2272] T 236a44f6e6b740ebbf1fb3b1f367f36a P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.508155 16125 tablet_replica.cc:333] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.508666 16125 raft_consensus.cc:2243] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.509095 16125 raft_consensus.cc:2272] T 697dc1c079f448c0af165ab489b3160c P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.511102 16125 tablet_replica.cc:333] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.511600 16125 raft_consensus.cc:2243] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.512462 16125 raft_consensus.cc:2272] T 5c3ede10da664710af54f48f42e1ab43 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.514583 16125 tablet_replica.cc:333] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2: stopping tablet replica
I20260709 12:13:24.515072 16125 raft_consensus.cc:2243] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.515498 16125 raft_consensus.cc:2272] T 86266bc0f0914a64b02089b09f4d3b72 P a09fd0dde7fc4241aecc9690b427e9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.583449 16125 tablet_server.cc:196] TabletServer@127.15.191.68:0 shutdown complete.
I20260709 12:13:24.645617 16125 master.cc:562] Master@127.15.191.126:35665 shutting down...
I20260709 12:13:24.670601 16125 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.671168 16125 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.671491 16125 tablet_replica.cc:333] T 00000000000000000000000000000000 P d768674e8707438e9f056125e7c36c7e: stopping tablet replica
I20260709 12:13:24.692834 16125 master.cc:584] Master@127.15.191.126:35665 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (29468 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:13:24.772950 16125 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.191.126:44201
I20260709 12:13:24.774092 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:24.779654 25164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:24.779609 25163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:24.781177 25166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:24.782260 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:24.783316 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:24.783649 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:24.783820 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599204783801 us; error 0 us; skew 500 ppm
I20260709 12:13:24.784363 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:24.786900 16125 webserver.cc:533] Webserver started at http://127.15.191.126:34509/ using document root <none> and password file <none>
I20260709 12:13:24.787387 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:24.787552 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:24.787818 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:24.788997 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/master-0-root/instance:
uuid: "fdd6939e18e94867baa575ec88879bb1"
format_stamp: "Formatted at 2026-07-09 12:13:24 on dist-test-slave-1sdq"
I20260709 12:13:24.793495 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:13:24.797263 25171 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:24.798002 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:24.798342 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/master-0-root
uuid: "fdd6939e18e94867baa575ec88879bb1"
format_stamp: "Formatted at 2026-07-09 12:13:24 on dist-test-slave-1sdq"
I20260709 12:13:24.798631 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:24.819314 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:24.820552 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:24.859069 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.126:44201
I20260709 12:13:24.859165 25222 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.126:44201 every 8 connection(s)
I20260709 12:13:24.863039 25223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.874717 25223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1: Bootstrap starting.
I20260709 12:13:24.879691 25223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.884300 25223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1: No bootstrap required, opened a new log
I20260709 12:13:24.886648 25223 raft_consensus.cc:359] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd6939e18e94867baa575ec88879bb1" member_type: VOTER }
I20260709 12:13:24.887040 25223 raft_consensus.cc:385] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.887212 25223 raft_consensus.cc:740] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd6939e18e94867baa575ec88879bb1, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.887768 25223 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd6939e18e94867baa575ec88879bb1" member_type: VOTER }
I20260709 12:13:24.888211 25223 raft_consensus.cc:399] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:24.888409 25223 raft_consensus.cc:493] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:24.888624 25223 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.893604 25223 raft_consensus.cc:515] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd6939e18e94867baa575ec88879bb1" member_type: VOTER }
I20260709 12:13:24.894133 25223 leader_election.cc:304] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdd6939e18e94867baa575ec88879bb1; no voters: 
I20260709 12:13:24.895293 25223 leader_election.cc:290] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:24.895699 25226 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:24.897047 25226 raft_consensus.cc:697] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 1 LEADER]: Becoming Leader. State: Replica: fdd6939e18e94867baa575ec88879bb1, State: Running, Role: LEADER
I20260709 12:13:24.897749 25226 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd6939e18e94867baa575ec88879bb1" member_type: VOTER }
I20260709 12:13:24.898283 25223 sys_catalog.cc:565] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:24.903751 25227 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdd6939e18e94867baa575ec88879bb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd6939e18e94867baa575ec88879bb1" member_type: VOTER } }
I20260709 12:13:24.904500 25227 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:24.904520 25228 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdd6939e18e94867baa575ec88879bb1. Latest consensus state: current_term: 1 leader_uuid: "fdd6939e18e94867baa575ec88879bb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd6939e18e94867baa575ec88879bb1" member_type: VOTER } }
I20260709 12:13:24.906055 25228 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:24.906744 25233 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:24.914369 25233 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:24.915411 16125 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:24.924189 25233 catalog_manager.cc:1383] Generated new cluster ID: 8c01ee69374d4a83971e34e6d2b6fe3a
I20260709 12:13:24.924546 25233 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:24.950078 25233 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:24.951607 25233 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:24.963589 25233 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1: Generated new TSK 0
I20260709 12:13:24.964222 25233 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:24.982980 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:24.989429 25244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:24.990491 25245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:24.991530 25247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:24.992161 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:24.993777 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:24.993978 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:24.994186 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599204994166 us; error 0 us; skew 500 ppm
I20260709 12:13:24.994807 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:24.997265 16125 webserver.cc:533] Webserver started at http://127.15.191.65:44625/ using document root <none> and password file <none>
I20260709 12:13:24.997773 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:24.997949 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:24.998235 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:24.999354 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-0-root/instance:
uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
format_stamp: "Formatted at 2026-07-09 12:13:24 on dist-test-slave-1sdq"
I20260709 12:13:25.004185 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:25.008066 25252 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:25.008977 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:25.009308 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
format_stamp: "Formatted at 2026-07-09 12:13:24 on dist-test-slave-1sdq"
I20260709 12:13:25.009649 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:25.035205 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:25.036530 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:25.038151 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:25.040562 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:25.040776 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:25.041014 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:25.041182 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:25.083712 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:39353
I20260709 12:13:25.083807 25314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:39353 every 8 connection(s)
I20260709 12:13:25.088804 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:25.096292 25319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:25.098062 25320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:25.101105 16125 server_base.cc:1061] running on GCE node
W20260709 12:13:25.101480 25322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:25.102548 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:25.102847 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:25.103085 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599205103061 us; error 0 us; skew 500 ppm
I20260709 12:13:25.103832 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:25.104836 25315 heartbeater.cc:344] Connected to a master server at 127.15.191.126:44201
I20260709 12:13:25.105288 25315 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:25.106232 25315 heartbeater.cc:507] Master 127.15.191.126:44201 requested a full tablet report, sending...
I20260709 12:13:25.106882 16125 webserver.cc:533] Webserver started at http://127.15.191.66:37259/ using document root <none> and password file <none>
I20260709 12:13:25.107584 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:25.107822 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:25.108173 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:25.108743 25188 ts_manager.cc:194] Registered new tserver with Master: c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353)
I20260709 12:13:25.109784 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-1-root/instance:
uuid: "4196cd0a28c74ae598f09620a5f70c18"
format_stamp: "Formatted at 2026-07-09 12:13:25 on dist-test-slave-1sdq"
I20260709 12:13:25.110801 25188 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54268
I20260709 12:13:25.115309 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:25.119024 25327 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:25.119800 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:13:25.120113 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-1-root
uuid: "4196cd0a28c74ae598f09620a5f70c18"
format_stamp: "Formatted at 2026-07-09 12:13:25 on dist-test-slave-1sdq"
I20260709 12:13:25.120401 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:25.139101 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:25.140297 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:25.141798 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:25.144112 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:25.144316 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:25.144549 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:25.144702 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:25.184584 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.66:37463
I20260709 12:13:25.184660 25389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.66:37463 every 8 connection(s)
I20260709 12:13:25.189486 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:25.196462 25393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:25.201280 25394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:25.201993 25396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:25.202771 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:25.203020 25390 heartbeater.cc:344] Connected to a master server at 127.15.191.126:44201
I20260709 12:13:25.203539 25390 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:25.203894 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:25.204169 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:25.204344 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599205204327 us; error 0 us; skew 500 ppm
I20260709 12:13:25.204363 25390 heartbeater.cc:507] Master 127.15.191.126:44201 requested a full tablet report, sending...
I20260709 12:13:25.204939 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:25.206826 25188 ts_manager.cc:194] Registered new tserver with Master: 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:25.207918 16125 webserver.cc:533] Webserver started at http://127.15.191.67:45033/ using document root <none> and password file <none>
I20260709 12:13:25.208782 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:25.208841 25188 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54282
I20260709 12:13:25.209226 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:25.209748 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:25.211229 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-2-root/instance:
uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
format_stamp: "Formatted at 2026-07-09 12:13:25 on dist-test-slave-1sdq"
I20260709 12:13:25.216235 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:25.219822 25401 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:25.220602 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:13:25.220928 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-2-root
uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
format_stamp: "Formatted at 2026-07-09 12:13:25 on dist-test-slave-1sdq"
I20260709 12:13:25.221222 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:25.242579 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:25.243803 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:25.245306 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:25.247591 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:25.247844 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:25.248075 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:25.248234 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:25.293968 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.67:33845
I20260709 12:13:25.294070 25463 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.67:33845 every 8 connection(s)
I20260709 12:13:25.308037 25464 heartbeater.cc:344] Connected to a master server at 127.15.191.126:44201
I20260709 12:13:25.308562 25464 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:25.309383 25464 heartbeater.cc:507] Master 127.15.191.126:44201 requested a full tablet report, sending...
I20260709 12:13:25.311450 25188 ts_manager.cc:194] Registered new tserver with Master: 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:25.312276 16125 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014752858s
I20260709 12:13:25.313024 25188 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54292
I20260709 12:13:25.339118 25188 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54298:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:25.342020 25188 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:25.425348 25355 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1359947a004f75a90e56d5e590b59b (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:25.426282 25353 tablet_service.cc:1511] Processing CreateTablet for tablet f792cb08572f4c3d98ff00125ecfaf6b (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:25.427067 25355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1359947a004f75a90e56d5e590b59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.427763 25353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f792cb08572f4c3d98ff00125ecfaf6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.429080 25278 tablet_service.cc:1511] Processing CreateTablet for tablet f792cb08572f4c3d98ff00125ecfaf6b (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:25.430665 25278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f792cb08572f4c3d98ff00125ecfaf6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.430339 25280 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1359947a004f75a90e56d5e590b59b (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:25.431252 25354 tablet_service.cc:1511] Processing CreateTablet for tablet d6e085711a8a4d0da7e6c0b67561376e (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:25.431715 25280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1359947a004f75a90e56d5e590b59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.432699 25354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e085711a8a4d0da7e6c0b67561376e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.429177 25279 tablet_service.cc:1511] Processing CreateTablet for tablet d6e085711a8a4d0da7e6c0b67561376e (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:25.436741 25279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e085711a8a4d0da7e6c0b67561376e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.444017 25429 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1359947a004f75a90e56d5e590b59b (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:25.445542 25429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1359947a004f75a90e56d5e590b59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.448379 25428 tablet_service.cc:1511] Processing CreateTablet for tablet d6e085711a8a4d0da7e6c0b67561376e (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:25.451265 25428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e085711a8a4d0da7e6c0b67561376e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.453609 25427 tablet_service.cc:1511] Processing CreateTablet for tablet f792cb08572f4c3d98ff00125ecfaf6b (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:25.455210 25427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f792cb08572f4c3d98ff00125ecfaf6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.456419 25352 tablet_service.cc:1511] Processing CreateTablet for tablet e0a8daf3db234096af5cceb3291ce550 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:25.457875 25352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a8daf3db234096af5cceb3291ce550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.458256 25277 tablet_service.cc:1511] Processing CreateTablet for tablet e0a8daf3db234096af5cceb3291ce550 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:25.459754 25277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a8daf3db234096af5cceb3291ce550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.472829 25426 tablet_service.cc:1511] Processing CreateTablet for tablet e0a8daf3db234096af5cceb3291ce550 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:25.474310 25426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a8daf3db234096af5cceb3291ce550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.474409 25276 tablet_service.cc:1511] Processing CreateTablet for tablet fe5eccbc5fe143da8d3547ce5dae9ed0 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:25.475849 25276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5eccbc5fe143da8d3547ce5dae9ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.487080 25351 tablet_service.cc:1511] Processing CreateTablet for tablet fe5eccbc5fe143da8d3547ce5dae9ed0 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:25.488579 25351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5eccbc5fe143da8d3547ce5dae9ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.503566 25425 tablet_service.cc:1511] Processing CreateTablet for tablet fe5eccbc5fe143da8d3547ce5dae9ed0 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:25.505106 25425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5eccbc5fe143da8d3547ce5dae9ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.517128 25479 tablet_bootstrap.cc:492] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:25.525058 25280 tablet_service.cc:1511] Processing CreateTablet for tablet 5d60da2da7ab42829e9bd39536ce0887 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:25.526664 25479 tablet_bootstrap.cc:654] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.526320 25353 tablet_service.cc:1511] Processing CreateTablet for tablet 5d60da2da7ab42829e9bd39536ce0887 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:25.526561 25280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d60da2da7ab42829e9bd39536ce0887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.531212 25480 tablet_bootstrap.cc:492] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:25.531046 25428 tablet_service.cc:1511] Processing CreateTablet for tablet 5d60da2da7ab42829e9bd39536ce0887 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:25.532466 25428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d60da2da7ab42829e9bd39536ce0887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.538183 25276 tablet_service.cc:1511] Processing CreateTablet for tablet 1f194fb39d444b1fb95a6b2335d1f6fa (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:25.539764 25276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f194fb39d444b1fb95a6b2335d1f6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.542629 25481 tablet_bootstrap.cc:492] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:25.552721 25354 tablet_service.cc:1511] Processing CreateTablet for tablet 1f194fb39d444b1fb95a6b2335d1f6fa (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:25.556084 25425 tablet_service.cc:1511] Processing CreateTablet for tablet 1f194fb39d444b1fb95a6b2335d1f6fa (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:25.557580 25425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f194fb39d444b1fb95a6b2335d1f6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.557914 25480 tablet_bootstrap.cc:654] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.561852 25354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f194fb39d444b1fb95a6b2335d1f6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.568558 25481 tablet_bootstrap.cc:654] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.569089 25353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d60da2da7ab42829e9bd39536ce0887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.572793 25352 tablet_service.cc:1511] Processing CreateTablet for tablet 1d8d96a1631149c99dcfcc9876ca52b5 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:25.574273 25352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d8d96a1631149c99dcfcc9876ca52b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.575299 25427 tablet_service.cc:1511] Processing CreateTablet for tablet 1d8d96a1631149c99dcfcc9876ca52b5 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:25.576699 25427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d8d96a1631149c99dcfcc9876ca52b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.581645 25481 tablet_bootstrap.cc:492] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:25.582310 25481 ts_tablet_manager.cc:1403] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.006s
I20260709 12:13:25.582638 25355 tablet_service.cc:1511] Processing CreateTablet for tablet a9613be8870f49e7a887da6334d27010 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:25.584097 25355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9613be8870f49e7a887da6334d27010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.584125 25426 tablet_service.cc:1511] Processing CreateTablet for tablet a9613be8870f49e7a887da6334d27010 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:25.585727 25426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9613be8870f49e7a887da6334d27010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.585613 25481 raft_consensus.cc:359] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.586549 25481 raft_consensus.cc:385] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.586858 25481 raft_consensus.cc:740] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.571558 25276 tablet_service.cc:1511] Processing CreateTablet for tablet 1d8d96a1631149c99dcfcc9876ca52b5 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:25.590253 25429 tablet_service.cc:1511] Processing CreateTablet for tablet e760e131da944668801e411da2a513ef (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:25.590617 25280 tablet_service.cc:1511] Processing CreateTablet for tablet a9613be8870f49e7a887da6334d27010 (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:25.591645 25429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e760e131da944668801e411da2a513ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.592110 25479 tablet_bootstrap.cc:492] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:25.592641 25479 ts_tablet_manager.cc:1403] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.025s
I20260709 12:13:25.593568 25276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d8d96a1631149c99dcfcc9876ca52b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.598519 25280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9613be8870f49e7a887da6334d27010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.599911 25351 tablet_service.cc:1511] Processing CreateTablet for tablet e760e131da944668801e411da2a513ef (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:25.600884 25277 tablet_service.cc:1511] Processing CreateTablet for tablet e760e131da944668801e411da2a513ef (DEFAULT_TABLE table=test-workload [id=0f3252be220c4ea7b42ece851a313f4b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:25.601356 25351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e760e131da944668801e411da2a513ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.603217 25277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e760e131da944668801e411da2a513ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.605268 25481 consensus_queue.cc:260] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.621939 25479 raft_consensus.cc:359] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.623034 25479 raft_consensus.cc:385] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.623456 25479 raft_consensus.cc:740] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.626451 25480 tablet_bootstrap.cc:492] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:25.627095 25480 ts_tablet_manager.cc:1403] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.003s
I20260709 12:13:25.629739 25480 raft_consensus.cc:359] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.624442 25479 consensus_queue.cc:260] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.630851 25480 raft_consensus.cc:385] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.631354 25480 raft_consensus.cc:740] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.632349 25480 consensus_queue.cc:260] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.640506 25480 ts_tablet_manager.cc:1434] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 12:13:25.641369 25390 heartbeater.cc:499] Master 127.15.191.126:44201 was elected leader, sending a full tablet report...
I20260709 12:13:25.641709 25480 tablet_bootstrap.cc:492] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:25.646246 25479 ts_tablet_manager.cc:1434] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.008s
I20260709 12:13:25.647132 25315 heartbeater.cc:499] Master 127.15.191.126:44201 was elected leader, sending a full tablet report...
I20260709 12:13:25.647482 25479 tablet_bootstrap.cc:492] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:25.655747 25480 tablet_bootstrap.cc:654] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.665735 25479 tablet_bootstrap.cc:654] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.679293 25464 heartbeater.cc:499] Master 127.15.191.126:44201 was elected leader, sending a full tablet report...
I20260709 12:13:25.679637 25481 ts_tablet_manager.cc:1434] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.097s	user 0.013s	sys 0.008s
I20260709 12:13:25.680685 25481 tablet_bootstrap.cc:492] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:25.687381 25481 tablet_bootstrap.cc:654] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.693424 25480 tablet_bootstrap.cc:492] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:25.694090 25480 ts_tablet_manager.cc:1403] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.006s
I20260709 12:13:25.697324 25480 raft_consensus.cc:359] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.698939 25480 raft_consensus.cc:385] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.699328 25480 raft_consensus.cc:740] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.700266 25480 consensus_queue.cc:260] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.703081 25480 ts_tablet_manager.cc:1434] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:25.704219 25480 tablet_bootstrap.cc:492] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:25.707562 25479 tablet_bootstrap.cc:492] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:25.708348 25479 ts_tablet_manager.cc:1403] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.004s
I20260709 12:13:25.710763 25481 tablet_bootstrap.cc:492] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:25.711050 25480 tablet_bootstrap.cc:654] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.711656 25481 ts_tablet_manager.cc:1403] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.009s
I20260709 12:13:25.711689 25479 raft_consensus.cc:359] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.712630 25479 raft_consensus.cc:385] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.712934 25479 raft_consensus.cc:740] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.713721 25479 consensus_queue.cc:260] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.714979 25481 raft_consensus.cc:359] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.715798 25481 raft_consensus.cc:385] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.715958 25479 ts_tablet_manager.cc:1434] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:13:25.716120 25481 raft_consensus.cc:740] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.717139 25481 consensus_queue.cc:260] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.719376 25481 ts_tablet_manager.cc:1434] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:25.719579 25479 tablet_bootstrap.cc:492] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:25.720376 25481 tablet_bootstrap.cc:492] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:25.723677 25480 tablet_bootstrap.cc:492] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:25.724360 25480 ts_tablet_manager.cc:1403] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:13:25.727138 25479 tablet_bootstrap.cc:654] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.727910 25481 tablet_bootstrap.cc:654] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.727638 25480 raft_consensus.cc:359] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.728617 25480 raft_consensus.cc:385] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.728998 25480 raft_consensus.cc:740] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.729959 25480 consensus_queue.cc:260] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.734398 25480 ts_tablet_manager.cc:1434] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:13:25.735662 25480 tablet_bootstrap.cc:492] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:25.737313 25481 tablet_bootstrap.cc:492] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:25.738044 25481 ts_tablet_manager.cc:1403] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:13:25.742784 25480 tablet_bootstrap.cc:654] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.741706 25481 raft_consensus.cc:359] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.743881 25481 raft_consensus.cc:385] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.744207 25481 raft_consensus.cc:740] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.744964 25479 tablet_bootstrap.cc:492] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:25.745590 25479 ts_tablet_manager.cc:1403] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 12:13:25.745193 25481 consensus_queue.cc:260] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.747678 25481 ts_tablet_manager.cc:1434] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:25.748781 25481 tablet_bootstrap.cc:492] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:25.749317 25479 raft_consensus.cc:359] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.750209 25479 raft_consensus.cc:385] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.750721 25479 raft_consensus.cc:740] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.751710 25479 consensus_queue.cc:260] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.754073 25479 ts_tablet_manager.cc:1434] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:25.755198 25479 tablet_bootstrap.cc:492] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:25.756036 25481 tablet_bootstrap.cc:654] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.757539 25486 raft_consensus.cc:493] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.758127 25486 raft_consensus.cc:515] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.761986 25479 tablet_bootstrap.cc:654] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.764029 25486 leader_election.cc:290] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:25.766319 25480 tablet_bootstrap.cc:492] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:25.766438 25487 raft_consensus.cc:493] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.767236 25480 ts_tablet_manager.cc:1403] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.011s
I20260709 12:13:25.767198 25487 raft_consensus.cc:515] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.770761 25480 raft_consensus.cc:359] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.771572 25480 raft_consensus.cc:385] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.771883 25480 raft_consensus.cc:740] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.772794 25480 consensus_queue.cc:260] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.774052 25487 leader_election.cc:290] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:25.775352 25480 ts_tablet_manager.cc:1434] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:25.776485 25480 tablet_bootstrap.cc:492] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:25.782960 25480 tablet_bootstrap.cc:654] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.790621 25485 raft_consensus.cc:493] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.791230 25485 raft_consensus.cc:515] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.795293 25485 leader_election.cc:290] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:25.819146 25479 tablet_bootstrap.cc:492] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:25.820732 25479 ts_tablet_manager.cc:1403] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.010s
I20260709 12:13:25.826433 25480 tablet_bootstrap.cc:492] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:25.824455 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18" is_pre_election: true
I20260709 12:13:25.827046 25480 ts_tablet_manager.cc:1403] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.015s
I20260709 12:13:25.827101 25365 raft_consensus.cc:2468] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 0.
I20260709 12:13:25.830406 25480 raft_consensus.cc:359] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.833005 25480 raft_consensus.cc:385] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.832885 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" is_pre_election: true
I20260709 12:13:25.833261 25479 raft_consensus.cc:359] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.833544 25289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1359947a004f75a90e56d5e590b59b" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" is_pre_election: true
I20260709 12:13:25.833791 25290 raft_consensus.cc:2468] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 0.
I20260709 12:13:25.833583 25480 raft_consensus.cc:740] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.834088 25479 raft_consensus.cc:385] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.834335 25289 raft_consensus.cc:2468] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:25.834573 25479 raft_consensus.cc:740] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.835036 25480 consensus_queue.cc:260] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.835461 25479 consensus_queue.cc:260] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.836081 25328 leader_election.cc:304] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:25.836887 25486 raft_consensus.cc:2804] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.837251 25486 raft_consensus.cc:493] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.837393 25480 ts_tablet_manager.cc:1434] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:25.837587 25486 raft_consensus.cc:3060] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.837834 25479 ts_tablet_manager.cc:1434] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:13:25.838589 25480 tablet_bootstrap.cc:492] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:25.838987 25479 tablet_bootstrap.cc:492] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:25.845309 25480 tablet_bootstrap.cc:654] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.846702 25402 leader_election.cc:304] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 
I20260709 12:13:25.853382 25481 tablet_bootstrap.cc:492] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:25.853991 25481 ts_tablet_manager.cc:1403] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.005s
I20260709 12:13:25.846252 25479 tablet_bootstrap.cc:654] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.857007 25487 raft_consensus.cc:2804] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.857575 25487 raft_consensus.cc:493] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.857920 25487 raft_consensus.cc:3060] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.863853 25481 raft_consensus.cc:359] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.864897 25481 raft_consensus.cc:385] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.865249 25481 raft_consensus.cc:740] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.867882 25479 tablet_bootstrap.cc:492] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:25.868517 25479 ts_tablet_manager.cc:1403] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.008s
I20260709 12:13:25.870546 25481 consensus_queue.cc:260] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.872617 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18" is_pre_election: true
I20260709 12:13:25.873356 25365 raft_consensus.cc:2468] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 0.
I20260709 12:13:25.871654 25479 raft_consensus.cc:359] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.874320 25487 raft_consensus.cc:515] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.874818 25253 leader_election.cc:304] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:25.875499 25480 tablet_bootstrap.cc:492] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:25.875846 25485 raft_consensus.cc:2804] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.876071 25480 ts_tablet_manager.cc:1403] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.024s
I20260709 12:13:25.876371 25485 raft_consensus.cc:493] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.876755 25485 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.879343 25480 raft_consensus.cc:359] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.880149 25480 raft_consensus.cc:385] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.880442 25480 raft_consensus.cc:740] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.849742 25486 raft_consensus.cc:515] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.881333 25480 consensus_queue.cc:260] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.883699 25479 raft_consensus.cc:385] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.884091 25289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1359947a004f75a90e56d5e590b59b" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:25.884752 25289 raft_consensus.cc:3060] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.885002 25485 raft_consensus.cc:515] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.887609 25487 leader_election.cc:290] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 1 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:25.887907 25485 leader_election.cc:290] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:25.888118 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:25.888825 25365 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.889312 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:25.889922 25290 raft_consensus.cc:3060] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.890389 25364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:25.891079 25364 raft_consensus.cc:3060] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.897121 25289 raft_consensus.cc:2468] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:25.897890 25365 raft_consensus.cc:2468] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 1.
I20260709 12:13:25.884076 25479 raft_consensus.cc:740] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.899178 25253 leader_election.cc:304] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:25.899518 25479 consensus_queue.cc:260] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.898453 25290 raft_consensus.cc:2468] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 1.
I20260709 12:13:25.898530 25328 leader_election.cc:304] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:25.876542 25481 ts_tablet_manager.cc:1434] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 12:13:25.900329 25485 raft_consensus.cc:2804] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.902724 25480 ts_tablet_manager.cc:1434] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.004s
I20260709 12:13:25.903908 25480 tablet_bootstrap.cc:492] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:25.904492 25402 leader_election.cc:304] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
W20260709 12:13:25.909677 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:25.910750 25480 tablet_bootstrap.cc:654] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.911151 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1359947a004f75a90e56d5e590b59b" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:25.911878 25439 raft_consensus.cc:2468] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:25.899421 25364 raft_consensus.cc:2468] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 1.
I20260709 12:13:25.919013 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1359947a004f75a90e56d5e590b59b" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:25.919740 25439 raft_consensus.cc:3060] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.923349 25480 tablet_bootstrap.cc:492] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:25.924410 25480 ts_tablet_manager.cc:1403] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.002s
I20260709 12:13:25.925458 25509 raft_consensus.cc:2804] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.926158 25509 raft_consensus.cc:697] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:25.928588 25486 leader_election.cc:290] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:25.928748 25480 raft_consensus.cc:359] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.929548 25481 tablet_bootstrap.cc:492] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:25.929562 25480 raft_consensus.cc:385] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.930140 25480 raft_consensus.cc:740] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.930979 25480 consensus_queue.cc:260] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.933315 25480 ts_tablet_manager.cc:1434] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.001s
I20260709 12:13:25.923417 25485 raft_consensus.cc:697] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: Becoming Leader. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Running, Role: LEADER
I20260709 12:13:25.936091 25485 consensus_queue.cc:237] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.937417 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:25.937898 25437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:25.938283 25438 raft_consensus.cc:2468] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 0.
I20260709 12:13:25.934444 25480 tablet_bootstrap.cc:492] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:25.937353 25487 raft_consensus.cc:2804] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.943073 25487 raft_consensus.cc:697] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:25.944054 25487 consensus_queue.cc:237] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.946376 25480 tablet_bootstrap.cc:654] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:25.946576 25328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:39353, user_credentials={real_user=slave}} blocked reactor thread for 48155.2us
I20260709 12:13:25.949362 25439 raft_consensus.cc:2468] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:25.949580 25509 consensus_queue.cc:237] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.958693 25481 tablet_bootstrap.cc:654] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.967245 25185 catalog_manager.cc:5697] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.970788 25479 ts_tablet_manager.cc:1434] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.102s	user 0.036s	sys 0.034s
I20260709 12:13:25.972288 25479 tablet_bootstrap.cc:492] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:25.976565 25186 catalog_manager.cc:5697] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.981452 25479 tablet_bootstrap.cc:654] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.982045 25480 tablet_bootstrap.cc:492] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:25.982710 25480 ts_tablet_manager.cc:1403] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.005s
I20260709 12:13:25.986545 25480 raft_consensus.cc:359] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.987326 25480 raft_consensus.cc:385] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.987612 25480 raft_consensus.cc:740] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.988551 25480 consensus_queue.cc:260] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.990708 25480 ts_tablet_manager.cc:1434] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:25.991791 25480 tablet_bootstrap.cc:492] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:25.992103 25509 raft_consensus.cc:493] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.992689 25509 raft_consensus.cc:515] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.995033 25509 leader_election.cc:290] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:25.995919 25481 tablet_bootstrap.cc:492] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:25.996568 25481 ts_tablet_manager.cc:1403] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.015s
I20260709 12:13:25.997625 25480 tablet_bootstrap.cc:654] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.997898 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" is_pre_election: true
I20260709 12:13:26.000118 25481 raft_consensus.cc:359] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:25.998539 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
W20260709 12:13:26.000344 25328 leader_election.cc:343] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:26.003674 25329 leader_election.cc:343] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.004215 25329 leader_election.cc:304] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18; no voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:26.004879 25479 tablet_bootstrap.cc:492] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:26.005082 25509 raft_consensus.cc:2749] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:26.005618 25481 raft_consensus.cc:385] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.006009 25481 raft_consensus.cc:740] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.007241 25479 ts_tablet_manager.cc:1403] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.008s
I20260709 12:13:26.006914 25481 consensus_queue.cc:260] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.009472 25481 ts_tablet_manager.cc:1434] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:13:26.010704 25481 tablet_bootstrap.cc:492] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:26.012044 25479 raft_consensus.cc:359] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.012884 25479 raft_consensus.cc:385] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.013168 25479 raft_consensus.cc:740] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.013981 25479 consensus_queue.cc:260] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.016286 25479 ts_tablet_manager.cc:1434] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:26.017321 25479 tablet_bootstrap.cc:492] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:26.019474 25481 tablet_bootstrap.cc:654] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.024030 25479 tablet_bootstrap.cc:654] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.023207 25188 catalog_manager.cc:5697] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.032534 25481 tablet_bootstrap.cc:492] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:26.033202 25481 ts_tablet_manager.cc:1403] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 12:13:26.036666 25481 raft_consensus.cc:359] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.037454 25481 raft_consensus.cc:385] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.037755 25481 raft_consensus.cc:740] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.039875 25481 consensus_queue.cc:260] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.041577 25479 tablet_bootstrap.cc:492] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:26.042202 25479 ts_tablet_manager.cc:1403] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.009s
I20260709 12:13:26.043092 25481 ts_tablet_manager.cc:1434] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:13:26.044328 25481 tablet_bootstrap.cc:492] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:26.045079 25479 raft_consensus.cc:359] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.045878 25479 raft_consensus.cc:385] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.046190 25479 raft_consensus.cc:740] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.047062 25479 consensus_queue.cc:260] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.052428 25481 tablet_bootstrap.cc:654] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.049736 25479 ts_tablet_manager.cc:1434] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:13:26.053714 25479 tablet_bootstrap.cc:492] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:26.060027 25479 tablet_bootstrap.cc:654] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.060869 25509 raft_consensus.cc:493] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.061400 25509 raft_consensus.cc:515] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.063681 25509 leader_election.cc:290] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.064438 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5eccbc5fe143da8d3547ce5dae9ed0" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" is_pre_election: true
I20260709 12:13:26.064934 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5eccbc5fe143da8d3547ce5dae9ed0" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:26.065160 25290 raft_consensus.cc:2468] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:26.065718 25439 raft_consensus.cc:2468] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:26.066587 25328 leader_election.cc:304] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.068913 25481 tablet_bootstrap.cc:492] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:26.069555 25481 ts_tablet_manager.cc:1403] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 12:13:26.071036 25509 raft_consensus.cc:2804] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.071605 25509 raft_consensus.cc:493] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.072304 25509 raft_consensus.cc:3060] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.075738 25479 tablet_bootstrap.cc:492] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:26.076326 25479 ts_tablet_manager.cc:1403] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 12:13:26.079419 25479 raft_consensus.cc:359] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.080271 25479 raft_consensus.cc:385] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.079357 25481 raft_consensus.cc:359] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.080576 25479 raft_consensus.cc:740] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.080792 25481 raft_consensus.cc:385] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.081200 25481 raft_consensus.cc:740] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.081445 25479 consensus_queue.cc:260] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.086820 25479 ts_tablet_manager.cc:1434] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:13:26.087880 25479 tablet_bootstrap.cc:492] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:26.093918 25479 tablet_bootstrap.cc:654] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.096058 25481 consensus_queue.cc:260] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.099253 25481 ts_tablet_manager.cc:1434] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.006s
I20260709 12:13:26.100629 25481 tablet_bootstrap.cc:492] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:26.085140 25509 raft_consensus.cc:515] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.106170 25479 tablet_bootstrap.cc:492] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:26.106807 25479 ts_tablet_manager.cc:1403] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:13:26.108243 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5eccbc5fe143da8d3547ce5dae9ed0" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:26.108927 25290 raft_consensus.cc:3060] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.109119 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5eccbc5fe143da8d3547ce5dae9ed0" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:26.109719 25439 raft_consensus.cc:3060] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.109719 25479 raft_consensus.cc:359] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.110599 25479 raft_consensus.cc:385] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.110872 25479 raft_consensus.cc:740] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.111593 25479 consensus_queue.cc:260] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.113179 25480 tablet_bootstrap.cc:492] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:26.113641 25479 ts_tablet_manager.cc:1434] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:13:26.114852 25479 tablet_bootstrap.cc:492] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:26.116362 25481 tablet_bootstrap.cc:654] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.117163 25290 raft_consensus.cc:2468] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:26.117370 25439 raft_consensus.cc:2468] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:26.113713 25480 ts_tablet_manager.cc:1403] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.122s	user 0.047s	sys 0.059s
I20260709 12:13:26.118757 25328 leader_election.cc:304] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.118885 25509 leader_election.cc:290] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.119774 25511 raft_consensus.cc:2804] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.120292 25511 raft_consensus.cc:697] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:26.120572 25479 tablet_bootstrap.cc:654] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.120944 25480 raft_consensus.cc:359] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.121728 25480 raft_consensus.cc:385] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.121207 25511 consensus_queue.cc:237] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.121991 25480 raft_consensus.cc:740] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.123974 25480 consensus_queue.cc:260] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.124950 25479 tablet_bootstrap.cc:492] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: No bootstrap required, opened a new log
I20260709 12:13:26.125408 25479 ts_tablet_manager.cc:1403] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:26.127079 25480 ts_tablet_manager.cc:1434] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:13:26.128165 25480 tablet_bootstrap.cc:492] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18: Bootstrap starting.
I20260709 12:13:26.128118 25479 raft_consensus.cc:359] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.129699 25479 raft_consensus.cc:385] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.129969 25479 raft_consensus.cc:740] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.130754 25479 consensus_queue.cc:260] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.132805 25479 ts_tablet_manager.cc:1434] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:26.134357 25480 tablet_bootstrap.cc:654] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.138777 25481 tablet_bootstrap.cc:492] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:26.139561 25481 ts_tablet_manager.cc:1403] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.003s
I20260709 12:13:26.142629 25481 raft_consensus.cc:359] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.143354 25481 raft_consensus.cc:385] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.143636 25481 raft_consensus.cc:740] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.144344 25481 consensus_queue.cc:260] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.146687 25481 ts_tablet_manager.cc:1434] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:13:26.147743 25481 tablet_bootstrap.cc:492] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:26.152647 25480 tablet_bootstrap.cc:492] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18: No bootstrap required, opened a new log
I20260709 12:13:26.153275 25480 ts_tablet_manager.cc:1403] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 12:13:26.154635 25481 tablet_bootstrap.cc:654] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.156927 25480 raft_consensus.cc:359] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.156889 25186 catalog_manager.cc:5697] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.158021 25480 raft_consensus.cc:385] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.158504 25480 raft_consensus.cc:740] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.159847 25481 tablet_bootstrap.cc:492] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:26.159392 25480 consensus_queue.cc:260] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.160418 25481 ts_tablet_manager.cc:1403] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:13:26.160794 25510 raft_consensus.cc:493] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.161593 25480 ts_tablet_manager.cc:1434] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:13:26.161314 25510 raft_consensus.cc:515] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.163223 25481 raft_consensus.cc:359] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.164021 25481 raft_consensus.cc:385] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.164335 25481 raft_consensus.cc:740] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.165074 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8d96a1631149c99dcfcc9876ca52b5" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:26.165187 25481 consensus_queue.cc:260] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.166227 25439 raft_consensus.cc:2468] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 0.
I20260709 12:13:26.167074 25364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8d96a1631149c99dcfcc9876ca52b5" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18" is_pre_election: true
I20260709 12:13:26.163635 25510 leader_election.cc:290] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.167723 25481 ts_tablet_manager.cc:1434] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:13:26.167747 25364 raft_consensus.cc:2468] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 0.
I20260709 12:13:26.167745 25254 leader_election.cc:304] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.170306 25510 raft_consensus.cc:2804] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.170675 25510 raft_consensus.cc:493] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.171072 25510 raft_consensus.cc:3060] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.171490 25481 tablet_bootstrap.cc:492] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4: Bootstrap starting.
I20260709 12:13:26.179901 25481 tablet_bootstrap.cc:654] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.180239 25510 raft_consensus.cc:515] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.180980 25487 raft_consensus.cc:493] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.181453 25487 raft_consensus.cc:515] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.183460 25487 leader_election.cc:290] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:26.183706 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8d96a1631149c99dcfcc9876ca52b5" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:26.184448 25439 raft_consensus.cc:3060] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.184818 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f194fb39d444b1fb95a6b2335d1f6fa" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" is_pre_election: true
I20260709 12:13:26.185511 25290 raft_consensus.cc:2468] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 0.
I20260709 12:13:26.185675 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f194fb39d444b1fb95a6b2335d1f6fa" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18" is_pre_election: true
I20260709 12:13:26.186370 25365 raft_consensus.cc:2468] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 0.
I20260709 12:13:26.187054 25402 leader_election.cc:304] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.187664 25509 raft_consensus.cc:493] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.188171 25509 raft_consensus.cc:515] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.188558 25487 raft_consensus.cc:2804] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.188961 25487 raft_consensus.cc:493] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.189298 25487 raft_consensus.cc:3060] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.189482 25364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8d96a1631149c99dcfcc9876ca52b5" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:26.190419 25364 raft_consensus.cc:3060] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.192055 25437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9613be8870f49e7a887da6334d27010" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:26.192796 25437 raft_consensus.cc:2468] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:26.194155 25329 leader_election.cc:304] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 
I20260709 12:13:26.190442 25509 leader_election.cc:290] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.195050 25486 raft_consensus.cc:2804] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.195446 25486 raft_consensus.cc:493] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.195775 25486 raft_consensus.cc:3060] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.196346 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9613be8870f49e7a887da6334d27010" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" is_pre_election: true
I20260709 12:13:26.197175 25290 raft_consensus.cc:2468] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:26.185204 25511 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.199730 25511 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.202127 25511 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.202385 25509 raft_consensus.cc:493] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.203218 25509 raft_consensus.cc:515] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.203975 25437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:26.204783 25437 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:26.205931 25485 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.206539 25485 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.207715 25509 leader_election.cc:290] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.208134 25289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d60da2da7ab42829e9bd39536ce0887" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" is_pre_election: true
I20260709 12:13:26.183027 25510 leader_election.cc:290] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.221385 25289 raft_consensus.cc:2468] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:26.222635 25439 raft_consensus.cc:2468] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 1.
I20260709 12:13:26.223354 25328 leader_election.cc:304] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.208536 25437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d60da2da7ab42829e9bd39536ce0887" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:26.224337 25254 leader_election.cc:304] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.224707 25437 raft_consensus.cc:2468] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:26.225418 25510 raft_consensus.cc:2804] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.208930 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" is_pre_election: true
I20260709 12:13:26.206652 25329 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 
I20260709 12:13:26.226141 25290 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 0.
I20260709 12:13:26.203095 25487 raft_consensus.cc:515] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.218348 25364 raft_consensus.cc:2468] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 1.
I20260709 12:13:26.210405 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:26.227205 25510 raft_consensus.cc:697] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: Becoming Leader. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Running, Role: LEADER
I20260709 12:13:26.226205 25509 raft_consensus.cc:2804] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.227415 25438 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 0.
I20260709 12:13:26.227964 25511 raft_consensus.cc:2804] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.208819 25485 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.228374 25511 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.228816 25511 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.228289 25487 leader_election.cc:290] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 1 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:26.229651 25254 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.230252 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f194fb39d444b1fb95a6b2335d1f6fa" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:26.230628 25485 raft_consensus.cc:2804] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.231076 25485 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.231418 25485 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.231637 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f194fb39d444b1fb95a6b2335d1f6fa" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:26.232271 25365 raft_consensus.cc:3060] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.233626 25363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18" is_pre_election: true
I20260709 12:13:26.228626 25510 consensus_queue.cc:237] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.236847 25511 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.238202 25363 raft_consensus.cc:2393] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6ec8d8dc63146f6be895c4617dc8ab3 in current term 1: Already voted for candidate 4196cd0a28c74ae598f09620a5f70c18 in this term.
I20260709 12:13:26.238535 25509 raft_consensus.cc:493] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.239034 25509 raft_consensus.cc:3060] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.240166 25481 tablet_bootstrap.cc:492] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4: No bootstrap required, opened a new log
I20260709 12:13:26.239511 25290 raft_consensus.cc:3060] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.240757 25481 ts_tablet_manager.cc:1403] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent bootstrapping tablet: real 0.069s	user 0.033s	sys 0.016s
I20260709 12:13:26.240208 25485 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.244508 25481 raft_consensus.cc:359] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.245234 25481 raft_consensus.cc:385] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.245507 25481 raft_consensus.cc:740] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.245555 25363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:26.246580 25363 raft_consensus.cc:2393] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c6ec8d8dc63146f6be895c4617dc8ab3 in current term 1: Already voted for candidate 4196cd0a28c74ae598f09620a5f70c18 in this term.
I20260709 12:13:26.246373 25481 consensus_queue.cc:260] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.249451 25511 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.250245 25289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:26.251366 25289 raft_consensus.cc:2393] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4196cd0a28c74ae598f09620a5f70c18 in current term 1: Already voted for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in this term.
I20260709 12:13:26.251751 25485 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.252441 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:26.253105 25438 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.253259 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:26.254334 25481 ts_tablet_manager.cc:1434] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:13:26.220072 25486 raft_consensus.cc:515] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.256690 25328 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18; no voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:26.261039 25511 raft_consensus.cc:2749] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:26.263767 25290 raft_consensus.cc:2468] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 1.
I20260709 12:13:26.264173 25438 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 1.
I20260709 12:13:26.265141 25402 leader_election.cc:304] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.266067 25486 leader_election.cc:290] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.266525 25254 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 4196cd0a28c74ae598f09620a5f70c18
I20260709 12:13:26.267416 25485 raft_consensus.cc:2804] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.267809 25487 raft_consensus.cc:2804] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.268096 25485 raft_consensus.cc:697] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: Becoming Leader. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Running, Role: LEADER
I20260709 12:13:26.267995 25365 raft_consensus.cc:2468] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 1.
I20260709 12:13:26.270253 25487 raft_consensus.cc:697] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:26.270680 25509 raft_consensus.cc:515] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.271145 25487 consensus_queue.cc:237] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.269248 25485 consensus_queue.cc:237] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.273255 25509 leader_election.cc:290] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.276628 25289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d60da2da7ab42829e9bd39536ce0887" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:26.276844 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d60da2da7ab42829e9bd39536ce0887" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:26.277397 25289 raft_consensus.cc:3060] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.277539 25290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9613be8870f49e7a887da6334d27010" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:26.278745 25290 raft_consensus.cc:3060] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.277544 25439 raft_consensus.cc:3060] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.280325 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9613be8870f49e7a887da6334d27010" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:26.280987 25438 raft_consensus.cc:3060] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.284591 25188 catalog_manager.cc:5697] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.286582 25439 raft_consensus.cc:2468] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:26.291769 25329 leader_election.cc:304] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 
I20260709 12:13:26.292960 25509 raft_consensus.cc:2804] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.293530 25509 raft_consensus.cc:697] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:26.294133 25290 raft_consensus.cc:2468] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:26.295511 25509 consensus_queue.cc:237] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.297683 25438 raft_consensus.cc:2468] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:26.298902 25328 leader_election.cc:304] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.298779 25186 catalog_manager.cc:5697] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.300030 25486 raft_consensus.cc:2804] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.300573 25486 raft_consensus.cc:697] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:26.301386 25486 consensus_queue.cc:237] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.302353 25289 raft_consensus.cc:2468] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:26.316148 25188 catalog_manager.cc:5697] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.319661 25186 catalog_manager.cc:5697] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.329133 25438 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.331224 25185 catalog_manager.cc:5697] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.336635 25485 consensus_queue.cc:1048] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:26.349820 25510 consensus_queue.cc:1048] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.361637 25510 raft_consensus.cc:493] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.362167 25510 raft_consensus.cc:515] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.363735 25510 leader_election.cc:290] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.364822 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:26.364712 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18" is_pre_election: true
I20260709 12:13:26.365499 25438 raft_consensus.cc:2468] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 0.
I20260709 12:13:26.365605 25365 raft_consensus.cc:2468] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 0.
I20260709 12:13:26.366554 25254 leader_election.cc:304] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.367300 25510 raft_consensus.cc:2804] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.367627 25510 raft_consensus.cc:493] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.367962 25510 raft_consensus.cc:3060] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.373519 25510 raft_consensus.cc:515] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.375341 25510 leader_election.cc:290] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:26.376178 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:26.376402 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:26.376737 25365 raft_consensus.cc:3060] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.376965 25438 raft_consensus.cc:3060] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.382264 25438 raft_consensus.cc:2468] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 1.
I20260709 12:13:26.382308 25365 raft_consensus.cc:2468] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ec8d8dc63146f6be895c4617dc8ab3 in term 1.
I20260709 12:13:26.383376 25254 leader_election.cc:304] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:26.384052 25510 raft_consensus.cc:2804] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.384445 25510 raft_consensus.cc:697] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: Becoming Leader. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Running, Role: LEADER
I20260709 12:13:26.385251 25510 consensus_queue.cc:237] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:26.392256 25186 catalog_manager.cc:5697] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.500954 25487 consensus_queue.cc:1048] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:26.512586 25508 consensus_queue.cc:1048] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.552194 16125 ts_manager.cc:295] Set tserver state for c6ec8d8dc63146f6be895c4617dc8ab3 to MAINTENANCE_MODE
I20260709 12:13:26.552940 16125 tablet_server.cc:179] TabletServer@127.15.191.65:0 shutting down...
W20260709 12:13:26.561509 25328 consensus_peers.cc:597] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:26.565207 25328 consensus_peers.cc:597] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:26.574313 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:26.575217 16125 tablet_replica.cc:333] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.576056 16125 raft_consensus.cc:2243] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.576474 16125 raft_consensus.cc:2272] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.578994 16125 tablet_replica.cc:333] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.579108 25486 consensus_queue.cc:1048] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:26.579782 16125 raft_consensus.cc:2243] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.580324 16125 raft_consensus.cc:2272] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.582798 16125 tablet_replica.cc:333] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.583531 16125 raft_consensus.cc:2243] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.583909 16125 raft_consensus.cc:2272] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.586390 16125 tablet_replica.cc:333] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.588030 16125 raft_consensus.cc:2243] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:26.588809 16125 pending_rounds.cc:70] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Trying to abort 1 pending ops.
I20260709 12:13:26.589036 16125 pending_rounds.cc:77] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622348900216832 op_type: NO_OP noop_request { }
I20260709 12:13:26.589423 16125 raft_consensus.cc:2889] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:26.589767 16125 raft_consensus.cc:2272] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.595623 16125 tablet_replica.cc:333] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.596437 16125 raft_consensus.cc:2243] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:26.597165 16125 pending_rounds.cc:70] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Trying to abort 1 pending ops.
I20260709 12:13:26.597399 16125 pending_rounds.cc:77] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622348743413760 op_type: NO_OP noop_request { }
I20260709 12:13:26.597736 16125 raft_consensus.cc:2889] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:26.598065 16125 raft_consensus.cc:2272] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.598651 25486 consensus_queue.cc:1048] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:26.600591 16125 tablet_replica.cc:333] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.601455 16125 raft_consensus.cc:2243] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:26.602608 16125 raft_consensus.cc:2272] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.605057 16125 tablet_replica.cc:333] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.605840 16125 raft_consensus.cc:2243] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.606381 16125 raft_consensus.cc:2272] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.609351 16125 tablet_replica.cc:333] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.610085 16125 raft_consensus.cc:2243] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:26.610783 16125 pending_rounds.cc:70] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Trying to abort 1 pending ops.
I20260709 12:13:26.610983 16125 pending_rounds.cc:77] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622349361328128 op_type: NO_OP noop_request { }
I20260709 12:13:26.611418 16125 raft_consensus.cc:2889] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:26.611766 16125 raft_consensus.cc:2272] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.615052 16125 tablet_replica.cc:333] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.615789 16125 raft_consensus.cc:2243] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.616261 16125 raft_consensus.cc:2272] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.618557 16125 tablet_replica.cc:333] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: stopping tablet replica
I20260709 12:13:26.619182 16125 raft_consensus.cc:2243] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.619623 16125 raft_consensus.cc:2272] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.650005 16125 tablet_server.cc:196] TabletServer@127.15.191.65:0 shutdown complete.
I20260709 12:13:26.760377 25486 consensus_queue.cc:1048] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:26.779309 25328 consensus_peers.cc:597] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:26.780175 25402 consensus_peers.cc:597] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:26.788851 25328 consensus_peers.cc:597] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:26.815373 25508 consensus_queue.cc:1048] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:26.831964 25556 consensus_queue.cc:1048] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:26.910920 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:27.057109 25402 consensus_peers.cc:597] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:27.813105 25556 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.813565 25556 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.816095 25556 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:27.817245 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:27.817952 25438 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:27.819254 25329 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 
I20260709 12:13:27.820250 25556 raft_consensus.cc:2804] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:27.820628 25556 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:27.820799 25328 leader_election.cc:336] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:27.821274 25556 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.829030 25556 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.830881 25556 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:27.831974 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:27.832564 25438 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:27.837004 25328 leader_election.cc:336] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:27.839372 25438 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 2.
I20260709 12:13:27.840600 25329 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:27.841326 25556 raft_consensus.cc:2804] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.841784 25556 raft_consensus.cc:697] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:27.842582 25556 consensus_queue.cc:237] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.847080 25562 raft_consensus.cc:493] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6ec8d8dc63146f6be895c4617dc8ab3)
I20260709 12:13:27.847615 25562 raft_consensus.cc:515] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.849727 25562 leader_election.cc:290] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:27.851222 25185 catalog_manager.cc:5697] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 1 to 2, leader changed from c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65) to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.852092 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18" is_pre_election: true
I20260709 12:13:27.853971 25556 raft_consensus.cc:493] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6ec8d8dc63146f6be895c4617dc8ab3)
W20260709 12:13:27.854699 25402 leader_election.cc:336] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:27.854600 25556 raft_consensus.cc:515] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.855530 25402 leader_election.cc:304] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:27.856173 25562 raft_consensus.cc:2749] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.856968 25556 leader_election.cc:290] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:27.858070 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:27.860145 25438 raft_consensus.cc:2468] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:27.861595 25329 leader_election.cc:304] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 
I20260709 12:13:27.859483 25563 raft_consensus.cc:493] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:27.862715 25328 leader_election.cc:336] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:27.862663 25563 raft_consensus.cc:515] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.866528 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8d96a1631149c99dcfcc9876ca52b5" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" is_pre_election: true
I20260709 12:13:27.867179 25438 raft_consensus.cc:2468] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 1.
I20260709 12:13:27.868489 25329 leader_election.cc:304] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 
W20260709 12:13:27.869885 25328 leader_election.cc:336] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:27.871451 25568 raft_consensus.cc:2804] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:27.871765 25556 raft_consensus.cc:2804] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:27.872001 25568 raft_consensus.cc:493] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6ec8d8dc63146f6be895c4617dc8ab3)
I20260709 12:13:27.872014 25563 leader_election.cc:290] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:27.872717 25556 raft_consensus.cc:493] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.873234 25556 raft_consensus.cc:3060] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.873566 25568 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.880378 25556 raft_consensus.cc:515] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.881225 25568 raft_consensus.cc:515] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.883087 25556 leader_election.cc:290] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:27.884222 25438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d8d96a1631149c99dcfcc9876ca52b5" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:27.884873 25438 raft_consensus.cc:3060] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.885633 25568 leader_election.cc:290] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:27.885865 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
W20260709 12:13:27.886322 25328 leader_election.cc:336] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:27.886605 25439 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:27.886938 25328 leader_election.cc:336] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:27.892828 25438 raft_consensus.cc:2468] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 2.
I20260709 12:13:27.894207 25439 raft_consensus.cc:2468] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 2.
I20260709 12:13:27.894213 25329 leader_election.cc:304] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:27.895318 25568 raft_consensus.cc:2804] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.895679 25329 leader_election.cc:304] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:27.895787 25568 raft_consensus.cc:697] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:27.896473 25556 raft_consensus.cc:2804] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.896979 25556 raft_consensus.cc:697] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:27.896790 25568 consensus_queue.cc:237] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.897881 25556 consensus_queue.cc:237] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:27.905578 25185 catalog_manager.cc:5697] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 1 to 2, leader changed from c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65) to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:27.911800 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:27.918421 25185 catalog_manager.cc:5697] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 1 to 2, leader changed from c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65) to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.035554 25562 raft_consensus.cc:493] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.036072 25562 raft_consensus.cc:515] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:28.037837 25562 leader_election.cc:290] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:28.039497 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18" is_pre_election: true
I20260709 12:13:28.040170 25365 raft_consensus.cc:2468] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 1.
I20260709 12:13:28.041227 25402 leader_election.cc:304] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 
I20260709 12:13:28.041865 25562 raft_consensus.cc:2804] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:28.041917 25402 leader_election.cc:336] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:28.042356 25562 raft_consensus.cc:493] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.042712 25562 raft_consensus.cc:3060] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.048065 25562 raft_consensus.cc:515] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:28.049732 25562 leader_election.cc:290] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:28.051469 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:28.052126 25365 raft_consensus.cc:3060] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:28.053254 25402 leader_election.cc:336] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:28.058041 25365 raft_consensus.cc:2468] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 2.
I20260709 12:13:28.059242 25402 leader_election.cc:304] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:28.059931 25562 raft_consensus.cc:2804] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.060364 25562 raft_consensus.cc:697] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:28.061030 25562 consensus_queue.cc:237] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:28.069170 25185 catalog_manager.cc:5697] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 1 to 2, leader changed from c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65) to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:28.264472 25328 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111) [suppressed 125 similar messages]
I20260709 12:13:28.311687 25439 raft_consensus.cc:1275] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:28.313098 25556 consensus_queue.cc:1048] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:28.313750 25328 consensus_peers.cc:597] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:28.327728 25328 consensus_peers.cc:597] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:28.345825 25439 raft_consensus.cc:1275] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:28.347245 25556 consensus_queue.cc:1048] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:28.359954 25328 consensus_peers.cc:597] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:28.410714 25439 raft_consensus.cc:1275] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:28.412163 25556 consensus_queue.cc:1048] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:28.440145 25365 raft_consensus.cc:1275] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:28.441540 25562 consensus_queue.cc:1048] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:28.455582 25402 consensus_peers.cc:597] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:28.762800 25328 consensus_peers.cc:597] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.912688 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:29.008042 25328 consensus_peers.cc:597] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:29.141496 25328 consensus_peers.cc:597] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:29.192265 25328 consensus_peers.cc:597] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:29.227890 25402 consensus_peers.cc:597] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:29.665710 25402 consensus_peers.cc:597] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:29.913781 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:30.777515 25402 consensus_peers.cc:597] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:30.903981 25328 consensus_peers.cc:597] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:30.914914 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:30.955000 25328 consensus_peers.cc:597] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:31.108858 25328 consensus_peers.cc:597] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:31.414021 25328 consensus_peers.cc:597] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:31.463660 25328 consensus_peers.cc:597] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:31.594235 25402 consensus_peers.cc:597] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:31.669838 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:31.675174 25328 consensus_peers.cc:597] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:31.678467 25586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:31.679230 25585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:31.681265 25588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:31.681604 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:31.682736 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:31.682942 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:31.683096 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599211683085 us; error 0 us; skew 500 ppm
I20260709 12:13:31.683625 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:31.686422 16125 webserver.cc:533] Webserver started at http://127.15.191.65:44625/ using document root <none> and password file <none>
I20260709 12:13:31.686959 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:31.687136 16125 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:13:31.691421 16125 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:13:31.695802 25593 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:31.696743 16125 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:13:31.697078 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
format_stamp: "Formatted at 2026-07-09 12:13:24 on dist-test-slave-1sdq"
I20260709 12:13:31.697481 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:31.717756 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:31.719118 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:31.720695 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:31.724907 25600 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:13:31.786468 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:13:31.786818 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.063s	user 0.003s	sys 0.000s
I20260709 12:13:31.787130 16125 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:13:31.793465 25600 tablet_bootstrap.cc:492] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:31.806002 25600 tablet_bootstrap.cc:492] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:31.806800 25600 tablet_bootstrap.cc:492] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:31.807399 25600 ts_tablet_manager.cc:1403] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:13:31.810014 25600 raft_consensus.cc:359] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.811048 25600 raft_consensus.cc:740] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.811864 25600 consensus_queue.cc:260] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
W20260709 12:13:31.814469 25328 consensus_peers.cc:597] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:31.814824 25600 ts_tablet_manager.cc:1434] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:13:31.815676 25600 tablet_bootstrap.cc:492] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:31.829190 25600 tablet_bootstrap.cc:492] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:31.829975 25600 tablet_bootstrap.cc:492] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:31.830621 25600 ts_tablet_manager.cc:1403] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.006s
I20260709 12:13:31.832719 25600 raft_consensus.cc:359] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.833400 25600 raft_consensus.cc:740] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.834007 25600 consensus_queue.cc:260] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.835553 25600 ts_tablet_manager.cc:1434] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:31.836220 25600 tablet_bootstrap.cc:492] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:31.838217 16125 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:13:31.838527 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.051s	user 0.049s	sys 0.000s
I20260709 12:13:31.850325 25600 tablet_bootstrap.cc:492] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:31.851190 25600 tablet_bootstrap.cc:492] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:31.851760 25600 ts_tablet_manager.cc:1403] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:13:31.854586 25600 raft_consensus.cc:359] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.855312 25600 raft_consensus.cc:740] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.856132 25600 consensus_queue.cc:260] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.857944 25600 ts_tablet_manager.cc:1434] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:31.858717 25600 tablet_bootstrap.cc:492] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:31.870045 25600 tablet_bootstrap.cc:492] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:31.870895 25600 tablet_bootstrap.cc:492] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:31.871592 25600 ts_tablet_manager.cc:1403] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.008s
I20260709 12:13:31.873834 25600 raft_consensus.cc:359] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.874392 25600 raft_consensus.cc:740] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.875028 25600 consensus_queue.cc:260] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.876850 25600 ts_tablet_manager.cc:1434] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:31.877555 25600 tablet_bootstrap.cc:492] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:31.891060 25600 tablet_bootstrap.cc:492] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:31.892066 25600 tablet_bootstrap.cc:492] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:31.892648 25600 ts_tablet_manager.cc:1403] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:13:31.895233 25600 raft_consensus.cc:359] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.895745 25600 raft_consensus.cc:740] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.896574 25600 consensus_queue.cc:260] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.898865 25600 ts_tablet_manager.cc:1434] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:31.899823 25600 tablet_bootstrap.cc:492] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:31.900794 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:39353
I20260709 12:13:31.900904 25662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:39353 every 8 connection(s)
W20260709 12:13:31.906571 25664 tablet.cc:2406] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:31.907383 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.926010 25600 tablet_bootstrap.cc:492] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:31.927139 25600 tablet_bootstrap.cc:492] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:31.927830 25600 ts_tablet_manager.cc:1403] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.000s
W20260709 12:13:31.930482 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:31.930958 25600 raft_consensus.cc:359] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.932013 25600 raft_consensus.cc:740] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.932982 25600 consensus_queue.cc:260] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.935065 25600 ts_tablet_manager.cc:1434] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:31.935890 25600 tablet_bootstrap.cc:492] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:31.938794 25637 raft_consensus.cc:3060] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.944024 25663 heartbeater.cc:344] Connected to a master server at 127.15.191.126:44201
I20260709 12:13:31.944887 25663 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:31.950332 25663 heartbeater.cc:507] Master 127.15.191.126:44201 requested a full tablet report, sending...
I20260709 12:13:31.954712 25364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b1359947a004f75a90e56d5e590b59b"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
mode: GRACEFUL
new_leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:42394
I20260709 12:13:31.955770 25364 raft_consensus.cc:606] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Received request to transfer leadership to TS 5c8b800f1ff644b3bd8a975a43b2a3d4
I20260709 12:13:31.958771 25637 pending_rounds.cc:85] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Aborting all ops after (but not including) 0
I20260709 12:13:31.959288 25637 pending_rounds.cc:107] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:13:31.960057 25637 raft_consensus.cc:2889] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:31.960091 25364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9613be8870f49e7a887da6334d27010"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
mode: GRACEFUL
new_leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:42394
I20260709 12:13:31.960836 25364 raft_consensus.cc:606] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Received request to transfer leadership to TS 5c8b800f1ff644b3bd8a975a43b2a3d4
I20260709 12:13:31.977622 25364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
mode: GRACEFUL
new_leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:42394
I20260709 12:13:31.978434 25364 raft_consensus.cc:606] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Received request to transfer leadership to TS 5c8b800f1ff644b3bd8a975a43b2a3d4
I20260709 12:13:31.980026 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:31.980741 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:31.981645 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.983578 25600 tablet_bootstrap.cc:492] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:31.984777 25600 tablet_bootstrap.cc:492] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:31.985806 25600 ts_tablet_manager.cc:1403] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.050s	user 0.024s	sys 0.004s
I20260709 12:13:31.988899 25600 raft_consensus.cc:359] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.989753 25600 raft_consensus.cc:740] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.990641 25600 consensus_queue.cc:260] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:31.994119 25600 ts_tablet_manager.cc:1434] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:31.995086 25600 tablet_bootstrap.cc:492] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:32.012954 25185 ts_manager.cc:194] Re-registered known tserver with Master: c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353)
I20260709 12:13:32.015908 25600 tablet_bootstrap.cc:492] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:32.016791 25600 tablet_bootstrap.cc:492] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:32.017519 25600 ts_tablet_manager.cc:1403] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 12:13:32.019515 25600 raft_consensus.cc:359] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.020141 25600 raft_consensus.cc:740] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.020721 25600 consensus_queue.cc:260] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.022086 25185 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57956
I20260709 12:13:32.022531 25600 ts_tablet_manager.cc:1434] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:32.023406 25600 tablet_bootstrap.cc:492] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:32.026364 25663 heartbeater.cc:499] Master 127.15.191.126:44201 was elected leader, sending a full tablet report...
I20260709 12:13:32.034771 25600 tablet_bootstrap.cc:492] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.035465 25600 tablet_bootstrap.cc:492] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:32.036101 25600 ts_tablet_manager.cc:1403] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:13:32.038213 25600 raft_consensus.cc:359] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.038743 25600 raft_consensus.cc:740] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.039430 25600 consensus_queue.cc:260] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.041108 25600 ts_tablet_manager.cc:1434] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:32.041800 25600 tablet_bootstrap.cc:492] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap starting.
I20260709 12:13:32.052860 25600 tablet_bootstrap.cc:492] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:32.053529 25600 tablet_bootstrap.cc:492] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: Bootstrap complete.
I20260709 12:13:32.054149 25600 ts_tablet_manager.cc:1403] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:13:32.056466 25600 raft_consensus.cc:359] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.057179 25600 raft_consensus.cc:740] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ec8d8dc63146f6be895c4617dc8ab3, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.058205 25675 raft_consensus.cc:993] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18: : Instructing follower 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:32.057874 25600 consensus_queue.cc:260] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.058957 25673 raft_consensus.cc:1081] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Signalling peer 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:32.060451 25600 ts_tablet_manager.cc:1434] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:32.061299 25675 raft_consensus.cc:993] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18: : Instructing follower 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:32.061833 25673 raft_consensus.cc:1081] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Signalling peer 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:32.061986 25438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9613be8870f49e7a887da6334d27010"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:59266
I20260709 12:13:32.062703 25438 raft_consensus.cc:493] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.063135 25438 raft_consensus.cc:3060] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.063813 25439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:59266
I20260709 12:13:32.064471 25439 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.064858 25439 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.072916 25438 raft_consensus.cc:515] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.073875 25439 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.076484 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9613be8870f49e7a887da6334d27010" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:32.077303 25637 raft_consensus.cc:3060] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.077543 25438 leader_election.cc:290] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:32.077917 25364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:32.078439 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9613be8870f49e7a887da6334d27010" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:32.079135 25365 raft_consensus.cc:3055] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.079447 25365 raft_consensus.cc:740] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:32.080566 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:32.080442 25365 consensus_queue.cc:260] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.081271 25635 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.081719 25365 raft_consensus.cc:3060] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.078605 25364 raft_consensus.cc:3055] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.082263 25364 raft_consensus.cc:740] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:32.083384 25364 consensus_queue.cc:260] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.084750 25364 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.085769 25637 raft_consensus.cc:2468] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 2.
I20260709 12:13:32.087731 25402 leader_election.cc:304] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:32.090225 25562 raft_consensus.cc:2804] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.090716 25562 raft_consensus.cc:697] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:32.091737 25365 raft_consensus.cc:2468] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 2.
I20260709 12:13:32.091683 25562 consensus_queue.cc:237] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.093696 25439 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:32.096582 25364 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 3.
I20260709 12:13:32.100481 25402 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 
I20260709 12:13:32.091926 25635 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 3.
I20260709 12:13:32.101716 25682 raft_consensus.cc:2804] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:32.102629 25682 raft_consensus.cc:697] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:32.103869 25682 consensus_queue.cc:237] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.108886 25186 catalog_manager.cc:5697] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 1 to 2, leader changed from 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66) to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.130414 25185 catalog_manager.cc:5697] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 2 to 3, leader changed from 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66) to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 3 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.157663 25635 raft_consensus.cc:3060] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.163160 25635 pending_rounds.cc:85] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Aborting all ops after (but not including) 0
I20260709 12:13:32.163403 25635 pending_rounds.cc:107] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:13:32.163636 25635 raft_consensus.cc:2889] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:32.214162 25635 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.325659 25675 raft_consensus.cc:993] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18: : Instructing follower 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:32.326167 25673 raft_consensus.cc:1081] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Signalling peer 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:32.327888 25439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b1359947a004f75a90e56d5e590b59b"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:59266
I20260709 12:13:32.328420 25439 raft_consensus.cc:493] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.328740 25439 raft_consensus.cc:3060] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.334371 25439 raft_consensus.cc:515] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.336230 25439 leader_election.cc:290] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Requested vote from peers 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463), c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353)
I20260709 12:13:32.337044 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1359947a004f75a90e56d5e590b59b" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:32.337471 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1359947a004f75a90e56d5e590b59b" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:32.337770 25365 raft_consensus.cc:3055] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.338197 25635 raft_consensus.cc:3060] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.338200 25365 raft_consensus.cc:740] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:32.339385 25365 consensus_queue.cc:260] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.340826 25365 raft_consensus.cc:3060] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.346174 25635 raft_consensus.cc:2468] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 2.
I20260709 12:13:32.347615 25402 leader_election.cc:304] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:32.348402 25365 raft_consensus.cc:2468] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 2.
I20260709 12:13:32.348522 25682 raft_consensus.cc:2804] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.349156 25682 raft_consensus.cc:697] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:32.350150 25682 consensus_queue.cc:237] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:32.357671 25185 catalog_manager.cc:5697] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 1 to 2, leader changed from 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66) to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.496304 25365 raft_consensus.cc:1275] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:32.497530 25682 consensus_queue.cc:1048] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.508080 25635 raft_consensus.cc:1275] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:32.509996 25562 consensus_queue.cc:1048] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:32.510818 25562 consensus_queue.cc:1243] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Peer c6ec8d8dc63146f6be895c4617dc8ab3 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:13:32.513460 25635 pending_rounds.cc:85] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Aborting all ops after (but not including) 0
I20260709 12:13:32.513867 25635 pending_rounds.cc:107] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:13:32.514189 25635 raft_consensus.cc:2889] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:32.588618 25365 raft_consensus.cc:1275] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.589946 25562 consensus_queue.cc:1048] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.598953 25635 raft_consensus.cc:1275] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.600919 25682 consensus_queue.cc:1048] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:32.752717 25635 raft_consensus.cc:1275] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.754175 25562 consensus_queue.cc:1048] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.762624 25365 raft_consensus.cc:1275] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.764521 25682 consensus_queue.cc:1048] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:32.932478 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:33.000089 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.017902 25439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e760e131da944668801e411da2a513ef"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
mode: GRACEFUL
new_leader_uuid: "4196cd0a28c74ae598f09620a5f70c18"
 from {username='slave'} at 127.0.0.1:35840
I20260709 12:13:33.018491 25439 raft_consensus.cc:606] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Received request to transfer leadership to TS 4196cd0a28c74ae598f09620a5f70c18
I20260709 12:13:33.021054 25439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
mode: GRACEFUL
new_leader_uuid: "4196cd0a28c74ae598f09620a5f70c18"
 from {username='slave'} at 127.0.0.1:35840
I20260709 12:13:33.021559 25439 raft_consensus.cc:606] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 LEADER]: Received request to transfer leadership to TS 4196cd0a28c74ae598f09620a5f70c18
I20260709 12:13:33.022749 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:33.023301 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:33.023872 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.111438 25562 raft_consensus.cc:993] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4: : Instructing follower 4196cd0a28c74ae598f09620a5f70c18 to start an election
I20260709 12:13:33.111891 25682 raft_consensus.cc:1081] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 LEADER]: Signalling peer 4196cd0a28c74ae598f09620a5f70c18 to start an election
I20260709 12:13:33.113329 25365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
 from {username='slave'} at 127.0.0.1:50012
I20260709 12:13:33.113816 25365 raft_consensus.cc:493] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.114133 25365 raft_consensus.cc:3060] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.120148 25365 raft_consensus.cc:515] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:33.121889 25365 leader_election.cc:290] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:33.122804 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:33.123093 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:33.123485 25637 raft_consensus.cc:3060] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.123703 25439 raft_consensus.cc:3055] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.124033 25439 raft_consensus.cc:740] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:33.124711 25439 consensus_queue.cc:260] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:33.125777 25439 raft_consensus.cc:3060] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.129397 25637 raft_consensus.cc:2468] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 2.
I20260709 12:13:33.130959 25328 leader_election.cc:304] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:33.131819 25673 raft_consensus.cc:2804] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.132234 25439 raft_consensus.cc:2468] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 2.
I20260709 12:13:33.132314 25673 raft_consensus.cc:697] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:33.133622 25673 consensus_queue.cc:237] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:33.141791 25186 catalog_manager.cc:5697] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 1 to 2, leader changed from 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67) to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.252298 25562 raft_consensus.cc:993] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4: : Instructing follower 4196cd0a28c74ae598f09620a5f70c18 to start an election
I20260709 12:13:33.252756 25682 raft_consensus.cc:1081] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Signalling peer 4196cd0a28c74ae598f09620a5f70c18 to start an election
I20260709 12:13:33.254360 25365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e760e131da944668801e411da2a513ef"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
 from {username='slave'} at 127.0.0.1:50012
I20260709 12:13:33.254899 25365 raft_consensus.cc:493] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.255229 25365 raft_consensus.cc:3060] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.260788 25365 raft_consensus.cc:515] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:33.262684 25365 leader_election.cc:290] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 3 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:33.263569 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:33.263895 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e760e131da944668801e411da2a513ef" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:33.264314 25637 raft_consensus.cc:3060] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.264472 25439 raft_consensus.cc:3055] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.264920 25439 raft_consensus.cc:740] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:33.265853 25439 consensus_queue.cc:260] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:33.267295 25439 raft_consensus.cc:3060] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.272513 25637 raft_consensus.cc:2468] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 3.
I20260709 12:13:33.274180 25328 leader_election.cc:304] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:33.275043 25673 raft_consensus.cc:2804] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.275071 25439 raft_consensus.cc:2468] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 3.
I20260709 12:13:33.275691 25673 raft_consensus.cc:697] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 3 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:33.276711 25673 consensus_queue.cc:237] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:33.283926 25186 catalog_manager.cc:5697] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 2 to 3, leader changed from 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67) to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 3 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.682312 25637 raft_consensus.cc:1275] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:33.683617 25673 consensus_queue.cc:1048] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.694304 25439 raft_consensus.cc:1275] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:33.696029 25712 consensus_queue.cc:1048] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.707767 25637 raft_consensus.cc:1275] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.709197 25584 consensus_queue.cc:1048] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.718242 25439 raft_consensus.cc:1275] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.719907 25712 consensus_queue.cc:1048] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:33.933542 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:34.030580 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:34.038010 25365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
mode: GRACEFUL
new_leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:42394
I20260709 12:13:34.038581 25365 raft_consensus.cc:606] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Received request to transfer leadership to TS 5c8b800f1ff644b3bd8a975a43b2a3d4
I20260709 12:13:34.041323 25365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
mode: GRACEFUL
new_leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:42394
I20260709 12:13:34.041802 25365 raft_consensus.cc:606] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Received request to transfer leadership to TS 5c8b800f1ff644b3bd8a975a43b2a3d4
I20260709 12:13:34.042830 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:34.043292 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:34.043815 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:34.050341 25673 raft_consensus.cc:993] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18: : Instructing follower 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:34.050897 25712 raft_consensus.cc:1081] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Signalling peer 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:34.052354 25439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:59266
I20260709 12:13:34.052788 25439 raft_consensus.cc:493] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.053040 25439 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.057829 25439 raft_consensus.cc:515] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:34.059286 25439 leader_election.cc:290] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:34.060137 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:34.060366 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:34.060730 25637 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.060964 25365 raft_consensus.cc:3055] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:34.061306 25365 raft_consensus.cc:740] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:34.062080 25365 consensus_queue.cc:260] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:34.063187 25365 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.066965 25637 raft_consensus.cc:2468] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 3.
I20260709 12:13:34.068374 25402 leader_election.cc:304] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:34.068778 25365 raft_consensus.cc:2468] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 3.
I20260709 12:13:34.069082 25682 raft_consensus.cc:2804] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:34.070341 25682 raft_consensus.cc:697] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:34.071278 25682 consensus_queue.cc:237] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:34.078570 25185 catalog_manager.cc:5697] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 2 to 3, leader changed from 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66) to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 3 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:34.266145 25712 raft_consensus.cc:993] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18: : Instructing follower 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:34.266711 25673 raft_consensus.cc:1081] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Signalling peer 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:34.268251 25439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:59266
I20260709 12:13:34.268826 25439 raft_consensus.cc:493] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.269181 25439 raft_consensus.cc:3060] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.274483 25439 raft_consensus.cc:515] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:34.276244 25439 leader_election.cc:290] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:34.277024 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:34.277205 25365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f792cb08572f4c3d98ff00125ecfaf6b" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:34.277729 25637 raft_consensus.cc:3060] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.277802 25365 raft_consensus.cc:3055] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:34.278198 25365 raft_consensus.cc:740] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:34.278815 25365 consensus_queue.cc:260] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:34.279882 25365 raft_consensus.cc:3060] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.283087 25637 raft_consensus.cc:2468] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 3.
I20260709 12:13:34.284211 25402 leader_election.cc:304] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:34.284974 25682 raft_consensus.cc:2804] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:34.285167 25365 raft_consensus.cc:2468] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 3.
I20260709 12:13:34.285377 25682 raft_consensus.cc:697] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:34.286347 25682 consensus_queue.cc:237] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:34.292675 25185 catalog_manager.cc:5697] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 2 to 3, leader changed from 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66) to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 3 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:34.533797 25637 raft_consensus.cc:1275] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.535089 25682 consensus_queue.cc:1048] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.544543 25365 raft_consensus.cc:1275] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.547384 25726 consensus_queue.cc:1048] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.755677 25637 raft_consensus.cc:1275] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.757050 25682 consensus_queue.cc:1048] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.765720 25365 raft_consensus.cc:1275] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.767443 25682 consensus_queue.cc:1048] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:34.934638 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:35.051412 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:35.058760 25439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
mode: GRACEFUL
new_leader_uuid: "4196cd0a28c74ae598f09620a5f70c18"
 from {username='slave'} at 127.0.0.1:35840
I20260709 12:13:35.059340 25439 raft_consensus.cc:606] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Received request to transfer leadership to TS 4196cd0a28c74ae598f09620a5f70c18
I20260709 12:13:35.061720 25439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
mode: GRACEFUL
new_leader_uuid: "4196cd0a28c74ae598f09620a5f70c18"
 from {username='slave'} at 127.0.0.1:35840
I20260709 12:13:35.062183 25439 raft_consensus.cc:606] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Received request to transfer leadership to TS 4196cd0a28c74ae598f09620a5f70c18
I20260709 12:13:35.063138 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:35.063653 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:35.064208 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:35.146304 25726 raft_consensus.cc:993] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4: : Instructing follower 4196cd0a28c74ae598f09620a5f70c18 to start an election
I20260709 12:13:35.146967 25718 raft_consensus.cc:1081] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Signalling peer 4196cd0a28c74ae598f09620a5f70c18 to start an election
I20260709 12:13:35.148835 25365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
 from {username='slave'} at 127.0.0.1:50012
I20260709 12:13:35.149402 25365 raft_consensus.cc:493] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.149657 25365 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.155630 25365 raft_consensus.cc:515] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:35.157040 25365 leader_election.cc:290] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 4 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:35.157910 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:35.158042 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e085711a8a4d0da7e6c0b67561376e" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:35.158630 25637 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.158707 25439 raft_consensus.cc:3055] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:35.159082 25439 raft_consensus.cc:740] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:35.159660 25439 consensus_queue.cc:260] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:35.160523 25439 raft_consensus.cc:3060] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.164052 25637 raft_consensus.cc:2468] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 4.
I20260709 12:13:35.165277 25439 raft_consensus.cc:2468] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 4.
I20260709 12:13:35.165393 25328 leader_election.cc:304] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:35.166306 25673 raft_consensus.cc:2804] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:35.167196 25673 raft_consensus.cc:697] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 4 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:35.167970 25673 consensus_queue.cc:237] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:35.174408 25186 catalog_manager.cc:5697] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 3 to 4, leader changed from 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67) to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:35.545012 25718 raft_consensus.cc:993] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4: : Instructing follower 4196cd0a28c74ae598f09620a5f70c18 to start an election
I20260709 12:13:35.545490 25682 raft_consensus.cc:1081] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Signalling peer 4196cd0a28c74ae598f09620a5f70c18 to start an election
I20260709 12:13:35.547019 25364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
 from {username='slave'} at 127.0.0.1:50012
I20260709 12:13:35.547480 25364 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.547739 25364 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.553329 25364 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:35.555052 25364 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 4 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67:33845)
I20260709 12:13:35.555930 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:35.556149 25439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a8daf3db234096af5cceb3291ce550" candidate_uuid: "4196cd0a28c74ae598f09620a5f70c18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
I20260709 12:13:35.556609 25637 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.556682 25439 raft_consensus.cc:3055] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:35.557053 25439 raft_consensus.cc:740] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:35.557680 25439 consensus_queue.cc:260] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:35.558602 25439 raft_consensus.cc:3060] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:35.561924 25637 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 4.
I20260709 12:13:35.563073 25328 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:35.563342 25439 raft_consensus.cc:2468] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4196cd0a28c74ae598f09620a5f70c18 in term 4.
I20260709 12:13:35.563701 25673 raft_consensus.cc:2804] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:35.564499 25673 raft_consensus.cc:697] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 4 LEADER]: Becoming Leader. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:35.565330 25673 consensus_queue.cc:237] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:35.573637 25186 catalog_manager.cc:5697] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 reported cstate change: term changed from 3 to 4, leader changed from 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67) to 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66). New cstate: current_term: 4 leader_uuid: "4196cd0a28c74ae598f09620a5f70c18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:35.588534 25637 raft_consensus.cc:1275] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 4 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:35.589847 25673 consensus_queue.cc:1048] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:35.603394 25439 raft_consensus.cc:1275] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:35.605268 25740 consensus_queue.cc:1048] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:13:35.935621 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:36.070652 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:36.078459 25364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d60da2da7ab42829e9bd39536ce0887"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
mode: GRACEFUL
new_leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:42394
I20260709 12:13:36.079010 25364 raft_consensus.cc:606] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Received request to transfer leadership to TS 5c8b800f1ff644b3bd8a975a43b2a3d4
I20260709 12:13:36.081745 25364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5eccbc5fe143da8d3547ce5dae9ed0"
dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
mode: GRACEFUL
new_leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:42394
I20260709 12:13:36.082321 25364 raft_consensus.cc:606] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Received request to transfer leadership to TS 5c8b800f1ff644b3bd8a975a43b2a3d4
I20260709 12:13:36.083526 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:36.084007 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:36.084578 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:36.152745 25439 raft_consensus.cc:1275] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:36.154081 25673 consensus_queue.cc:1048] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:36.164532 25637 raft_consensus.cc:1275] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 4 FOLLOWER]: Refusing update from remote peer 4196cd0a28c74ae598f09620a5f70c18: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:36.166046 25740 consensus_queue.cc:1048] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:36.290993 25673 raft_consensus.cc:993] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18: : Instructing follower 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:36.291476 25740 raft_consensus.cc:1081] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Signalling peer 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:36.293067 25439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d60da2da7ab42829e9bd39536ce0887"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:59266
I20260709 12:13:36.293558 25439 raft_consensus.cc:493] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:36.293828 25439 raft_consensus.cc:3060] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.299052 25439 raft_consensus.cc:515] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:36.300621 25439 leader_election.cc:290] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:36.301429 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d60da2da7ab42829e9bd39536ce0887" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:36.301688 25364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d60da2da7ab42829e9bd39536ce0887" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:36.301966 25637 raft_consensus.cc:3060] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.302292 25364 raft_consensus.cc:3055] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:36.302569 25364 raft_consensus.cc:740] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:36.303289 25364 consensus_queue.cc:260] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:36.304267 25364 raft_consensus.cc:3060] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.307003 25637 raft_consensus.cc:2468] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 2.
I20260709 12:13:36.308130 25402 leader_election.cc:304] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:36.309742 25750 raft_consensus.cc:2804] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:36.310056 25364 raft_consensus.cc:2468] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 2.
I20260709 12:13:36.310352 25750 raft_consensus.cc:697] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:36.311702 25750 consensus_queue.cc:237] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:36.319113 25185 catalog_manager.cc:5697] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 1 to 2, leader changed from 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66) to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:36.521634 25673 raft_consensus.cc:993] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18: : Instructing follower 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:36.522128 25740 raft_consensus.cc:1081] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Signalling peer 5c8b800f1ff644b3bd8a975a43b2a3d4 to start an election
I20260709 12:13:36.523662 25439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe5eccbc5fe143da8d3547ce5dae9ed0"
dest_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4"
 from {username='slave'} at 127.0.0.1:59266
I20260709 12:13:36.524113 25439 raft_consensus.cc:493] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:36.524379 25439 raft_consensus.cc:3060] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.531136 25439 raft_consensus.cc:515] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:36.532608 25439 leader_election.cc:290] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Requested vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
I20260709 12:13:36.533492 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5eccbc5fe143da8d3547ce5dae9ed0" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3"
I20260709 12:13:36.533735 25364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5eccbc5fe143da8d3547ce5dae9ed0" candidate_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4196cd0a28c74ae598f09620a5f70c18"
I20260709 12:13:36.534078 25637 raft_consensus.cc:3060] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.534340 25364 raft_consensus.cc:3055] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:36.534653 25364 raft_consensus.cc:740] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4196cd0a28c74ae598f09620a5f70c18, State: Running, Role: LEADER
I20260709 12:13:36.535326 25364 consensus_queue.cc:260] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:36.536295 25364 raft_consensus.cc:3060] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:36.539100 25637 raft_consensus.cc:2468] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 2.
I20260709 12:13:36.540129 25402 leader_election.cc:304] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4, c6ec8d8dc63146f6be895c4617dc8ab3; no voters: 
I20260709 12:13:36.540809 25750 raft_consensus.cc:2804] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:36.541198 25750 raft_consensus.cc:697] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Becoming Leader. State: Replica: 5c8b800f1ff644b3bd8a975a43b2a3d4, State: Running, Role: LEADER
I20260709 12:13:36.542240 25364 raft_consensus.cc:2468] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c8b800f1ff644b3bd8a975a43b2a3d4 in term 2.
I20260709 12:13:36.542063 25750 consensus_queue.cc:237] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:36.549839 25185 catalog_manager.cc:5697] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 reported cstate change: term changed from 1 to 2, leader changed from 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66) to 5c8b800f1ff644b3bd8a975a43b2a3d4 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:36.788602 25637 raft_consensus.cc:1275] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:36.789875 25750 consensus_queue.cc:1048] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:36.800450 25364 raft_consensus.cc:1275] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:36.802601 25718 consensus_queue.cc:1048] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:36.936633 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:36.974221 25364 raft_consensus.cc:1275] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:36.975865 25760 consensus_queue.cc:1048] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:36.985558 25637 raft_consensus.cc:1275] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Refusing update from remote peer 5c8b800f1ff644b3bd8a975a43b2a3d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:36.987380 25750 consensus_queue.cc:1048] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:37.091061 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:37.123430 16125 tablet_server.cc:179] TabletServer@127.15.191.65:39353 shutting down...
I20260709 12:13:37.140506 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:37.141121 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.141714 16125 raft_consensus.cc:2243] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.142215 16125 raft_consensus.cc:2272] T 5d60da2da7ab42829e9bd39536ce0887 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.144881 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.145722 16125 raft_consensus.cc:2243] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:37.146178 25328 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 73 similar messages]
I20260709 12:13:37.146348 16125 raft_consensus.cc:2272] T fe5eccbc5fe143da8d3547ce5dae9ed0 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.149344 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.149923 16125 raft_consensus.cc:2243] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:37.150313 25328 consensus_peers.cc:597] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:37.150440 16125 raft_consensus.cc:2272] T a9613be8870f49e7a887da6334d27010 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.153009 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.153555 16125 raft_consensus.cc:2243] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.153926 16125 raft_consensus.cc:2272] T e0a8daf3db234096af5cceb3291ce550 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.156172 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.156711 16125 raft_consensus.cc:2243] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.157096 16125 raft_consensus.cc:2272] T d6e085711a8a4d0da7e6c0b67561376e P c6ec8d8dc63146f6be895c4617dc8ab3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.158901 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.159384 16125 raft_consensus.cc:2243] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.159742 16125 raft_consensus.cc:2272] T 1d8d96a1631149c99dcfcc9876ca52b5 P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.161715 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.162355 16125 raft_consensus.cc:2243] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.162786 16125 raft_consensus.cc:2272] T f792cb08572f4c3d98ff00125ecfaf6b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.164661 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.165174 16125 raft_consensus.cc:2243] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.165568 16125 raft_consensus.cc:2272] T e760e131da944668801e411da2a513ef P c6ec8d8dc63146f6be895c4617dc8ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.167409 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.167879 16125 raft_consensus.cc:2243] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.168278 16125 raft_consensus.cc:2272] T 1f194fb39d444b1fb95a6b2335d1f6fa P c6ec8d8dc63146f6be895c4617dc8ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.170457 16125 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:37.170923 16125 raft_consensus.cc:2243] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.171348 16125 raft_consensus.cc:2272] T 1b1359947a004f75a90e56d5e590b59b P c6ec8d8dc63146f6be895c4617dc8ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:37.172828 25328 consensus_peers.cc:597] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:37.192495 16125 tablet_server.cc:196] TabletServer@127.15.191.65:39353 shutdown complete.
W20260709 12:13:37.195576 25328 consensus_peers.cc:597] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.196056 25328 consensus_peers.cc:597] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.207847 25402 consensus_peers.cc:597] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:37.217585 16125 tablet_server.cc:179] TabletServer@127.15.191.66:0 shutting down...
W20260709 12:13:37.226020 25402 consensus_peers.cc:597] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.226744 25402 consensus_peers.cc:597] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.440302 25402 consensus_peers.cc:597] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.441154 25402 consensus_peers.cc:597] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:37.442886 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:37.443574 16125 tablet_replica.cc:333] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.444247 16125 raft_consensus.cc:2243] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.444701 16125 raft_consensus.cc:2272] T 5d60da2da7ab42829e9bd39536ce0887 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.447465 16125 tablet_replica.cc:333] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.448072 16125 raft_consensus.cc:2243] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.448499 16125 raft_consensus.cc:2272] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.451166 16125 tablet_replica.cc:333] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.451836 16125 raft_consensus.cc:2243] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.452286 16125 raft_consensus.cc:2272] T a9613be8870f49e7a887da6334d27010 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.454568 16125 tablet_replica.cc:333] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.455191 16125 raft_consensus.cc:2243] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:37.455942 16125 raft_consensus.cc:2272] T e0a8daf3db234096af5cceb3291ce550 P 4196cd0a28c74ae598f09620a5f70c18 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.458175 16125 tablet_replica.cc:333] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.458746 16125 raft_consensus.cc:2243] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.459162 16125 raft_consensus.cc:2272] T f792cb08572f4c3d98ff00125ecfaf6b P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.461220 16125 tablet_replica.cc:333] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.461794 16125 raft_consensus.cc:2243] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.462352 16125 raft_consensus.cc:2272] T 1f194fb39d444b1fb95a6b2335d1f6fa P 4196cd0a28c74ae598f09620a5f70c18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:37.462783 25402 consensus_peers.cc:597] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:37.464634 16125 tablet_replica.cc:333] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.465317 16125 raft_consensus.cc:2243] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:37.466150 16125 raft_consensus.cc:2272] T e760e131da944668801e411da2a513ef P 4196cd0a28c74ae598f09620a5f70c18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.468307 16125 tablet_replica.cc:333] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.468832 16125 raft_consensus.cc:2243] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.469273 16125 raft_consensus.cc:2272] T 1b1359947a004f75a90e56d5e590b59b P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.472144 16125 tablet_replica.cc:333] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.472741 16125 raft_consensus.cc:2243] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:37.473605 16125 raft_consensus.cc:2272] T 1d8d96a1631149c99dcfcc9876ca52b5 P 4196cd0a28c74ae598f09620a5f70c18 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:37.473938 25402 consensus_peers.cc:597] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:37.476166 16125 tablet_replica.cc:333] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18: stopping tablet replica
I20260709 12:13:37.476827 16125 raft_consensus.cc:2243] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:37.477638 16125 raft_consensus.cc:2272] T d6e085711a8a4d0da7e6c0b67561376e P 4196cd0a28c74ae598f09620a5f70c18 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:37.502745 25402 consensus_peers.cc:597] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.536260 25402 consensus_peers.cc:597] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.553498 25402 consensus_peers.cc:597] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.570885 25402 consensus_peers.cc:597] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.746472 25402 consensus_peers.cc:597] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.937665 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:38.348305 25386 debug-util.cc:398] Leaking SignalData structure 0x7b0800205180 after lost signal to thread 16128
W20260709 12:13:38.349581 25386 debug-util.cc:398] Leaking SignalData structure 0x7b0800238040 after lost signal to thread 25222
W20260709 12:13:38.351521 25386 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd6c0 after lost signal to thread 25463
W20260709 12:13:38.508448 16125 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 25386)
I20260709 12:13:38.544865 25750 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4196cd0a28c74ae598f09620a5f70c18)
I20260709 12:13:38.545471 25750 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:38.547300 25750 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
W20260709 12:13:38.552089 25402 leader_election.cc:336] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
W20260709 12:13:38.552856 25402 leader_election.cc:336] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111)
I20260709 12:13:38.553269 25402 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:38.554008 25750 raft_consensus.cc:2749] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:38.652055 25750 raft_consensus.cc:493] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4196cd0a28c74ae598f09620a5f70c18)
I20260709 12:13:38.652580 25750 raft_consensus.cc:515] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:38.654263 25750 leader_election.cc:290] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
W20260709 12:13:38.658222 25402 leader_election.cc:336] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
W20260709 12:13:38.658979 25402 leader_election.cc:336] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111)
I20260709 12:13:38.659363 25402 leader_election.cc:304] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:38.660068 25750 raft_consensus.cc:2749] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.728796 25750 raft_consensus.cc:493] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4196cd0a28c74ae598f09620a5f70c18)
I20260709 12:13:38.729278 25750 raft_consensus.cc:515] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:38.731141 25750 leader_election.cc:290] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
W20260709 12:13:38.735064 25402 leader_election.cc:336] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
W20260709 12:13:38.735648 25402 leader_election.cc:336] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111)
I20260709 12:13:38.735944 25402 leader_election.cc:304] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:38.736512 25750 raft_consensus.cc:2749] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.932189 25750 raft_consensus.cc:493] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4196cd0a28c74ae598f09620a5f70c18)
I20260709 12:13:38.932714 25750 raft_consensus.cc:515] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:38.934719 25750 leader_election.cc:290] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
W20260709 12:13:38.938639 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:38.939219 25402 leader_election.cc:336] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111)
W20260709 12:13:38.939883 25402 leader_election.cc:336] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
I20260709 12:13:38.940182 25402 leader_election.cc:304] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:38.940841 25750 raft_consensus.cc:2749] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:39.509034 16125 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 25386)
W20260709 12:13:39.528077 25402 consensus_peers.cc:597] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.583843 25402 consensus_peers.cc:597] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.686786 25402 consensus_peers.cc:597] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.713421 25402 consensus_peers.cc:597] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.786120 25402 consensus_peers.cc:597] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.823884 25402 consensus_peers.cc:597] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.844759 25402 consensus_peers.cc:597] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.910737 25402 consensus_peers.cc:597] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.939682 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:40.095170 25402 consensus_peers.cc:597] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.138043 25402 consensus_peers.cc:597] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.207029 25402 consensus_peers.cc:597] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Couldn't send request to peer c6ec8d8dc63146f6be895c4617dc8ab3. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.273240 25402 consensus_peers.cc:597] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 -> Peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Couldn't send request to peer 4196cd0a28c74ae598f09620a5f70c18. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:40.464087 25750 raft_consensus.cc:493] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4196cd0a28c74ae598f09620a5f70c18)
I20260709 12:13:40.464579 25750 raft_consensus.cc:515] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:40.466483 25750 leader_election.cc:290] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
W20260709 12:13:40.470818 25402 leader_election.cc:336] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
W20260709 12:13:40.471517 25402 leader_election.cc:336] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111)
I20260709 12:13:40.471813 25402 leader_election.cc:304] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:40.472380 25750 raft_consensus.cc:2749] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:40.509575 16125 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 25386)
I20260709 12:13:40.549254 25750 raft_consensus.cc:493] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4196cd0a28c74ae598f09620a5f70c18)
I20260709 12:13:40.549845 25750 raft_consensus.cc:515] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:40.551741 25750 leader_election.cc:290] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
W20260709 12:13:40.555419 25402 leader_election.cc:336] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
W20260709 12:13:40.556253 25402 leader_election.cc:336] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111)
I20260709 12:13:40.556561 25402 leader_election.cc:304] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:40.557116 25750 raft_consensus.cc:2749] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:40.583845 25750 raft_consensus.cc:493] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4196cd0a28c74ae598f09620a5f70c18)
I20260709 12:13:40.584299 25750 raft_consensus.cc:515] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:40.586185 25750 leader_election.cc:290] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
W20260709 12:13:40.589668 25402 leader_election.cc:336] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
W20260709 12:13:40.590503 25402 leader_election.cc:336] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111)
I20260709 12:13:40.590826 25402 leader_election.cc:304] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:40.591454 25750 raft_consensus.cc:2749] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.830276 25750 raft_consensus.cc:493] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4196cd0a28c74ae598f09620a5f70c18)
I20260709 12:13:40.830788 25750 raft_consensus.cc:515] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6ec8d8dc63146f6be895c4617dc8ab3" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 39353 } } peers { permanent_uuid: "4196cd0a28c74ae598f09620a5f70c18" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 37463 } } peers { permanent_uuid: "5c8b800f1ff644b3bd8a975a43b2a3d4" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 33845 } }
I20260709 12:13:40.832525 25750 leader_election.cc:290] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353), 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463)
W20260709 12:13:40.837759 25402 leader_election.cc:336] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6ec8d8dc63146f6be895c4617dc8ab3 (127.15.191.65:39353): Network error: Client connection negotiation failed: client connection to 127.15.191.65:39353: connect: Connection refused (error 111)
W20260709 12:13:40.838610 25402 leader_election.cc:336] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4196cd0a28c74ae598f09620a5f70c18 (127.15.191.66:37463): Network error: Client connection negotiation failed: client connection to 127.15.191.66:37463: connect: Connection refused (error 111)
I20260709 12:13:40.839012 25402 leader_election.cc:304] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c8b800f1ff644b3bd8a975a43b2a3d4; no voters: 4196cd0a28c74ae598f09620a5f70c18, c6ec8d8dc63146f6be895c4617dc8ab3
I20260709 12:13:40.839694 25750 raft_consensus.cc:2749] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:40.940724 25236 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:41.126464 16125 tablet_server.cc:196] TabletServer@127.15.191.66:0 shutdown complete.
I20260709 12:13:41.153724 16125 tablet_server.cc:179] TabletServer@127.15.191.67:0 shutting down...
I20260709 12:13:41.207026 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:41.208624 16125 tablet_replica.cc:333] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.211464 16125 raft_consensus.cc:2243] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.214331 16125 raft_consensus.cc:2272] T 5d60da2da7ab42829e9bd39536ce0887 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.217649 16125 tablet_replica.cc:333] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.218497 16125 raft_consensus.cc:2243] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.219942 16125 raft_consensus.cc:2272] T fe5eccbc5fe143da8d3547ce5dae9ed0 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.222868 16125 tablet_replica.cc:333] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.223748 16125 raft_consensus.cc:2243] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.225188 16125 raft_consensus.cc:2272] T a9613be8870f49e7a887da6334d27010 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.228065 16125 tablet_replica.cc:333] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.228742 16125 raft_consensus.cc:2243] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.229363 16125 raft_consensus.cc:2272] T e0a8daf3db234096af5cceb3291ce550 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.232175 16125 tablet_replica.cc:333] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.232800 16125 raft_consensus.cc:2243] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.233459 16125 raft_consensus.cc:2272] T 1d8d96a1631149c99dcfcc9876ca52b5 P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.236099 16125 tablet_replica.cc:333] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.236758 16125 raft_consensus.cc:2243] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.237533 16125 raft_consensus.cc:2272] T d6e085711a8a4d0da7e6c0b67561376e P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.240345 16125 tablet_replica.cc:333] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.241031 16125 raft_consensus.cc:2243] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.241660 16125 raft_consensus.cc:2272] T e760e131da944668801e411da2a513ef P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.244074 16125 tablet_replica.cc:333] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.244577 16125 raft_consensus.cc:2243] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.245996 16125 raft_consensus.cc:2272] T 1f194fb39d444b1fb95a6b2335d1f6fa P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.248628 16125 tablet_replica.cc:333] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.249205 16125 raft_consensus.cc:2243] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.250716 16125 raft_consensus.cc:2272] T 1b1359947a004f75a90e56d5e590b59b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.254823 16125 tablet_replica.cc:333] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4: stopping tablet replica
I20260709 12:13:41.255569 16125 raft_consensus.cc:2243] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.256971 16125 raft_consensus.cc:2272] T f792cb08572f4c3d98ff00125ecfaf6b P 5c8b800f1ff644b3bd8a975a43b2a3d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.299311 16125 tablet_server.cc:196] TabletServer@127.15.191.67:0 shutdown complete.
I20260709 12:13:41.332604 16125 master.cc:562] Master@127.15.191.126:44201 shutting down...
I20260709 12:13:41.360302 16125 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.361140 16125 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.361510 16125 tablet_replica.cc:333] T 00000000000000000000000000000000 P fdd6939e18e94867baa575ec88879bb1: stopping tablet replica
I20260709 12:13:41.383486 16125 master.cc:584] Master@127.15.191.126:44201 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (16662 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:13:41.435989 16125 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.191.126:44857
I20260709 12:13:41.437186 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:41.443568 25777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.443835 25778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.444605 25780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:41.445327 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:41.446426 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:41.446620 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:41.446746 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599221446734 us; error 0 us; skew 500 ppm
I20260709 12:13:41.447273 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:41.449652 16125 webserver.cc:533] Webserver started at http://127.15.191.126:36553/ using document root <none> and password file <none>
I20260709 12:13:41.450187 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:41.450369 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:41.450603 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:41.451817 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/master-0-root/instance:
uuid: "83befa6cf11a48a0b07511b1b12731ee"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-1sdq"
I20260709 12:13:41.456439 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:13:41.460112 25785 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.460844 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:41.461136 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/master-0-root
uuid: "83befa6cf11a48a0b07511b1b12731ee"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-1sdq"
I20260709 12:13:41.461429 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:41.518497 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:41.519770 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:41.558970 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.126:44857
I20260709 12:13:41.559090 25836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.126:44857 every 8 connection(s)
I20260709 12:13:41.563127 25837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:41.576978 25837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee: Bootstrap starting.
I20260709 12:13:41.582067 25837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:41.586730 25837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee: No bootstrap required, opened a new log
I20260709 12:13:41.589013 25837 raft_consensus.cc:359] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83befa6cf11a48a0b07511b1b12731ee" member_type: VOTER }
I20260709 12:13:41.589454 25837 raft_consensus.cc:385] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:41.589639 25837 raft_consensus.cc:740] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83befa6cf11a48a0b07511b1b12731ee, State: Initialized, Role: FOLLOWER
I20260709 12:13:41.590242 25837 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83befa6cf11a48a0b07511b1b12731ee" member_type: VOTER }
I20260709 12:13:41.590736 25837 raft_consensus.cc:399] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:41.590938 25837 raft_consensus.cc:493] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:41.591158 25837 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:41.596535 25837 raft_consensus.cc:515] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83befa6cf11a48a0b07511b1b12731ee" member_type: VOTER }
I20260709 12:13:41.597064 25837 leader_election.cc:304] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83befa6cf11a48a0b07511b1b12731ee; no voters: 
I20260709 12:13:41.598207 25837 leader_election.cc:290] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:41.598625 25840 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:41.599961 25840 raft_consensus.cc:697] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 1 LEADER]: Becoming Leader. State: Replica: 83befa6cf11a48a0b07511b1b12731ee, State: Running, Role: LEADER
I20260709 12:13:41.600684 25840 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83befa6cf11a48a0b07511b1b12731ee" member_type: VOTER }
I20260709 12:13:41.601053 25837 sys_catalog.cc:565] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:41.607064 25841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83befa6cf11a48a0b07511b1b12731ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83befa6cf11a48a0b07511b1b12731ee" member_type: VOTER } }
I20260709 12:13:41.607290 25842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83befa6cf11a48a0b07511b1b12731ee. Latest consensus state: current_term: 1 leader_uuid: "83befa6cf11a48a0b07511b1b12731ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83befa6cf11a48a0b07511b1b12731ee" member_type: VOTER } }
I20260709 12:13:41.607995 25842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:41.607867 25841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:41.611434 25848 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:41.617005 25848 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:41.618760 16125 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:41.626377 25848 catalog_manager.cc:1383] Generated new cluster ID: 019deec194e647b88cd8cb08cc69cb5c
I20260709 12:13:41.626662 25848 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:41.640703 25848 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:41.642071 25848 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:41.657663 25848 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee: Generated new TSK 0
I20260709 12:13:41.658298 25848 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:41.685642 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:41.692191 25858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.693166 25859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.694747 25861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:41.696547 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:41.700054 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:41.700309 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:41.700477 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599221700457 us; error 0 us; skew 500 ppm
I20260709 12:13:41.701081 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:41.703632 16125 webserver.cc:533] Webserver started at http://127.15.191.65:38233/ using document root <none> and password file <none>
I20260709 12:13:41.704128 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:41.704316 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:41.704571 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:41.705819 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-0-root/instance:
uuid: "640f0c8ccaa14ecca2df2413a9cac469"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-1sdq"
I20260709 12:13:41.710651 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:13:41.714370 25866 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.715188 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:13:41.715505 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "640f0c8ccaa14ecca2df2413a9cac469"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-1sdq"
I20260709 12:13:41.715787 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:41.729884 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:41.731180 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:41.732722 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:41.735178 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:41.735390 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.735641 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:41.735805 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.777217 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:46083
I20260709 12:13:41.777329 25928 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:46083 every 8 connection(s)
I20260709 12:13:41.782497 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:41.790318 25933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.793339 25934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.794468 25936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:41.795583 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:41.796895 25929 heartbeater.cc:344] Connected to a master server at 127.15.191.126:44857
I20260709 12:13:41.796895 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:41.797461 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:41.797540 25929 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:41.797624 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599221797608 us; error 0 us; skew 500 ppm
I20260709 12:13:41.798481 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:41.798650 25929 heartbeater.cc:507] Master 127.15.191.126:44857 requested a full tablet report, sending...
I20260709 12:13:41.801014 25802 ts_manager.cc:194] Registered new tserver with Master: 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083)
I20260709 12:13:41.801417 16125 webserver.cc:533] Webserver started at http://127.15.191.66:43895/ using document root <none> and password file <none>
I20260709 12:13:41.801975 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:41.802232 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:41.802484 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:41.803128 25802 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55838
I20260709 12:13:41.803735 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-1-root/instance:
uuid: "96ab56ee528946b087990ba140235e7c"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-1sdq"
I20260709 12:13:41.808583 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:41.812222 25941 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.813004 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:41.813295 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-1-root
uuid: "96ab56ee528946b087990ba140235e7c"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-1sdq"
I20260709 12:13:41.813653 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:41.832489 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:41.833738 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:41.835238 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:41.837522 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:41.837756 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.837992 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:41.838172 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:13:41.881306 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.66:43229
I20260709 12:13:41.881405 26003 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.66:43229 every 8 connection(s)
I20260709 12:13:41.886276 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:41.894208 26007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.895248 26008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.898450 26010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:41.898921 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:41.899684 26004 heartbeater.cc:344] Connected to a master server at 127.15.191.126:44857
I20260709 12:13:41.900053 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:13:41.900086 26004 heartbeater.cc:461] Registering TS with master...
W20260709 12:13:41.900372 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:41.900588 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599221900570 us; error 0 us; skew 500 ppm
I20260709 12:13:41.901124 26004 heartbeater.cc:507] Master 127.15.191.126:44857 requested a full tablet report, sending...
I20260709 12:13:41.901261 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:41.903507 25802 ts_manager.cc:194] Registered new tserver with Master: 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229)
I20260709 12:13:41.904273 16125 webserver.cc:533] Webserver started at http://127.15.191.67:46567/ using document root <none> and password file <none>
I20260709 12:13:41.905017 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:41.905261 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:41.905465 25802 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55842
I20260709 12:13:41.905637 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:41.907307 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-2-root/instance:
uuid: "35c21e2303604563a2654aa870e8354e"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-1sdq"
I20260709 12:13:41.912056 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:41.915997 26015 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.916783 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:13:41.917111 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-2-root
uuid: "35c21e2303604563a2654aa870e8354e"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-1sdq"
I20260709 12:13:41.917402 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598892377095-16125-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:41.929455 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:41.930780 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:41.932248 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:41.934605 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:41.934818 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.935048 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:41.935212 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.977620 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.67:36299
I20260709 12:13:41.977747 26077 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.67:36299 every 8 connection(s)
I20260709 12:13:41.992105 26078 heartbeater.cc:344] Connected to a master server at 127.15.191.126:44857
I20260709 12:13:41.992568 26078 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:41.993376 26078 heartbeater.cc:507] Master 127.15.191.126:44857 requested a full tablet report, sending...
I20260709 12:13:41.995404 25802 ts_manager.cc:194] Registered new tserver with Master: 35c21e2303604563a2654aa870e8354e (127.15.191.67:36299)
I20260709 12:13:41.995559 16125 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014778629s
I20260709 12:13:41.996842 25802 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55858
I20260709 12:13:42.027374 25802 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55868:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:42.030421 25802 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:42.084362 26043 tablet_service.cc:1511] Processing CreateTablet for tablet 58d55b8bd57e40bfa84ca1a4c146c91e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4b15e421c76d4f33afc4c1dbd336e24e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:42.085489 25969 tablet_service.cc:1511] Processing CreateTablet for tablet 58d55b8bd57e40bfa84ca1a4c146c91e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4b15e421c76d4f33afc4c1dbd336e24e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:42.085995 26043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d55b8bd57e40bfa84ca1a4c146c91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.087016 25969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d55b8bd57e40bfa84ca1a4c146c91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.091434 26042 tablet_service.cc:1511] Processing CreateTablet for tablet 0213f2a3923d4ac0a2a6f85ba37d723b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4b15e421c76d4f33afc4c1dbd336e24e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:42.092157 25968 tablet_service.cc:1511] Processing CreateTablet for tablet 0213f2a3923d4ac0a2a6f85ba37d723b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4b15e421c76d4f33afc4c1dbd336e24e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:42.092989 26042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0213f2a3923d4ac0a2a6f85ba37d723b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.093451 25968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0213f2a3923d4ac0a2a6f85ba37d723b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.119103 26093 tablet_bootstrap.cc:492] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e: Bootstrap starting.
I20260709 12:13:42.120507 25893 tablet_service.cc:1511] Processing CreateTablet for tablet 0213f2a3923d4ac0a2a6f85ba37d723b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4b15e421c76d4f33afc4c1dbd336e24e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:42.123437 25894 tablet_service.cc:1511] Processing CreateTablet for tablet 58d55b8bd57e40bfa84ca1a4c146c91e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4b15e421c76d4f33afc4c1dbd336e24e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:42.121953 25893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0213f2a3923d4ac0a2a6f85ba37d723b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.124959 25894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d55b8bd57e40bfa84ca1a4c146c91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.126662 26093 tablet_bootstrap.cc:654] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.128566 26094 tablet_bootstrap.cc:492] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c: Bootstrap starting.
I20260709 12:13:42.137440 26094 tablet_bootstrap.cc:654] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.138370 26093 tablet_bootstrap.cc:492] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e: No bootstrap required, opened a new log
I20260709 12:13:42.138991 26093 ts_tablet_manager.cc:1403] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:13:42.142277 26093 raft_consensus.cc:359] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.143064 26093 raft_consensus.cc:385] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.143402 26093 raft_consensus.cc:740] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c21e2303604563a2654aa870e8354e, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.144426 26093 consensus_queue.cc:260] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.149170 26098 tablet_bootstrap.cc:492] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469: Bootstrap starting.
I20260709 12:13:42.150996 26078 heartbeater.cc:499] Master 127.15.191.126:44857 was elected leader, sending a full tablet report...
I20260709 12:13:42.151386 26094 tablet_bootstrap.cc:492] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c: No bootstrap required, opened a new log
I20260709 12:13:42.151917 26094 ts_tablet_manager.cc:1403] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 12:13:42.152225 26093 ts_tablet_manager.cc:1434] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:13:42.153374 26093 tablet_bootstrap.cc:492] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e: Bootstrap starting.
I20260709 12:13:42.154969 26094 raft_consensus.cc:359] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.155875 26094 raft_consensus.cc:385] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.156240 26094 raft_consensus.cc:740] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96ab56ee528946b087990ba140235e7c, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.157203 26094 consensus_queue.cc:260] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.158993 26098 tablet_bootstrap.cc:654] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.161435 26093 tablet_bootstrap.cc:654] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.170446 26004 heartbeater.cc:499] Master 127.15.191.126:44857 was elected leader, sending a full tablet report...
I20260709 12:13:42.170522 26094 ts_tablet_manager.cc:1434] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:13:42.175369 26094 tablet_bootstrap.cc:492] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c: Bootstrap starting.
I20260709 12:13:42.178020 26098 tablet_bootstrap.cc:492] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469: No bootstrap required, opened a new log
I20260709 12:13:42.178663 26098 ts_tablet_manager.cc:1403] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.010s
I20260709 12:13:42.182900 26094 tablet_bootstrap.cc:654] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.182600 26098 raft_consensus.cc:359] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.183570 26098 raft_consensus.cc:385] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.183874 26093 tablet_bootstrap.cc:492] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e: No bootstrap required, opened a new log
I20260709 12:13:42.184481 26093 ts_tablet_manager.cc:1403] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.013s
I20260709 12:13:42.183948 26098 raft_consensus.cc:740] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.187282 26093 raft_consensus.cc:359] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.187435 26098 consensus_queue.cc:260] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.188367 26093 raft_consensus.cc:385] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.188844 26093 raft_consensus.cc:740] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c21e2303604563a2654aa870e8354e, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.190142 26093 consensus_queue.cc:260] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.190788 25929 heartbeater.cc:499] Master 127.15.191.126:44857 was elected leader, sending a full tablet report...
I20260709 12:13:42.191388 26098 ts_tablet_manager.cc:1434] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:13:42.192281 26094 tablet_bootstrap.cc:492] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c: No bootstrap required, opened a new log
I20260709 12:13:42.192639 26098 tablet_bootstrap.cc:492] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469: Bootstrap starting.
I20260709 12:13:42.192679 26093 ts_tablet_manager.cc:1434] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:42.192823 26094 ts_tablet_manager.cc:1403] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:13:42.196309 26094 raft_consensus.cc:359] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.197150 26094 raft_consensus.cc:385] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.197506 26094 raft_consensus.cc:740] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96ab56ee528946b087990ba140235e7c, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.198783 26098 tablet_bootstrap.cc:654] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.198342 26094 consensus_queue.cc:260] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.200875 26099 raft_consensus.cc:493] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.201196 26094 ts_tablet_manager.cc:1434] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:42.201414 26099 raft_consensus.cc:515] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.213225 26098 tablet_bootstrap.cc:492] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469: No bootstrap required, opened a new log
I20260709 12:13:42.214037 26098 ts_tablet_manager.cc:1403] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 12:13:42.217298 26053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d55b8bd57e40bfa84ca1a4c146c91e" candidate_uuid: "96ab56ee528946b087990ba140235e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c21e2303604563a2654aa870e8354e" is_pre_election: true
I20260709 12:13:42.217339 26098 raft_consensus.cc:359] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.218161 26053 raft_consensus.cc:2468] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96ab56ee528946b087990ba140235e7c in term 0.
I20260709 12:13:42.218499 26098 raft_consensus.cc:385] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.218869 26098 raft_consensus.cc:740] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.219647 26098 consensus_queue.cc:260] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.220321 25944 leader_election.cc:304] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 96ab56ee528946b087990ba140235e7c; no voters: 
I20260709 12:13:42.221935 26098 ts_tablet_manager.cc:1434] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:42.222193 26105 raft_consensus.cc:2804] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:42.222735 26105 raft_consensus.cc:493] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.223084 26105 raft_consensus.cc:3060] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.218055 26099 leader_election.cc:290] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35c21e2303604563a2654aa870e8354e (127.15.191.67:36299), 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083)
I20260709 12:13:42.234418 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d55b8bd57e40bfa84ca1a4c146c91e" candidate_uuid: "96ab56ee528946b087990ba140235e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469" is_pre_election: true
I20260709 12:13:42.233682 26105 raft_consensus.cc:515] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.235098 25904 raft_consensus.cc:2468] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96ab56ee528946b087990ba140235e7c in term 0.
I20260709 12:13:42.237313 26105 leader_election.cc:290] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [CANDIDATE]: Term 1 election: Requested vote from peers 35c21e2303604563a2654aa870e8354e (127.15.191.67:36299), 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083)
I20260709 12:13:42.237474 26053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d55b8bd57e40bfa84ca1a4c146c91e" candidate_uuid: "96ab56ee528946b087990ba140235e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c21e2303604563a2654aa870e8354e"
I20260709 12:13:42.238174 26053 raft_consensus.cc:3060] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.238260 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d55b8bd57e40bfa84ca1a4c146c91e" candidate_uuid: "96ab56ee528946b087990ba140235e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
I20260709 12:13:42.238834 25904 raft_consensus.cc:3060] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.244488 26053 raft_consensus.cc:2468] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96ab56ee528946b087990ba140235e7c in term 1.
I20260709 12:13:42.244745 25904 raft_consensus.cc:2468] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96ab56ee528946b087990ba140235e7c in term 1.
I20260709 12:13:42.245721 25944 leader_election.cc:304] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 96ab56ee528946b087990ba140235e7c; no voters: 
I20260709 12:13:42.246474 26105 raft_consensus.cc:2804] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:42.246917 26105 raft_consensus.cc:697] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 1 LEADER]: Becoming Leader. State: Replica: 96ab56ee528946b087990ba140235e7c, State: Running, Role: LEADER
I20260709 12:13:42.247627 26105 consensus_queue.cc:237] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.255285 26103 raft_consensus.cc:493] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.255838 26103 raft_consensus.cc:515] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.256757 25798 catalog_manager.cc:5697] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96ab56ee528946b087990ba140235e7c (127.15.191.66). New cstate: current_term: 1 leader_uuid: "96ab56ee528946b087990ba140235e7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:42.258329 26103 leader_election.cc:290] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229), 35c21e2303604563a2654aa870e8354e (127.15.191.67:36299)
I20260709 12:13:42.269685 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0213f2a3923d4ac0a2a6f85ba37d723b" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96ab56ee528946b087990ba140235e7c" is_pre_election: true
I20260709 12:13:42.270958 25979 raft_consensus.cc:2468] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 0.
I20260709 12:13:42.271808 26053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0213f2a3923d4ac0a2a6f85ba37d723b" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c21e2303604563a2654aa870e8354e" is_pre_election: true
I20260709 12:13:42.272389 25868 leader_election.cc:304] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 640f0c8ccaa14ecca2df2413a9cac469, 96ab56ee528946b087990ba140235e7c; no voters: 
I20260709 12:13:42.272650 26053 raft_consensus.cc:2468] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 0.
I20260709 12:13:42.273326 26103 raft_consensus.cc:2804] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:42.273671 26103 raft_consensus.cc:493] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.273937 26103 raft_consensus.cc:3060] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.280170 26103 raft_consensus.cc:515] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.281981 26103 leader_election.cc:290] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 1 election: Requested vote from peers 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229), 35c21e2303604563a2654aa870e8354e (127.15.191.67:36299)
I20260709 12:13:42.282996 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0213f2a3923d4ac0a2a6f85ba37d723b" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96ab56ee528946b087990ba140235e7c"
I20260709 12:13:42.283104 26053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0213f2a3923d4ac0a2a6f85ba37d723b" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c21e2303604563a2654aa870e8354e"
I20260709 12:13:42.283615 25979 raft_consensus.cc:3060] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.283706 26053 raft_consensus.cc:3060] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.289297 26053 raft_consensus.cc:2468] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 1.
I20260709 12:13:42.289923 25979 raft_consensus.cc:2468] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 1.
I20260709 12:13:42.290612 25869 leader_election.cc:304] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 640f0c8ccaa14ecca2df2413a9cac469; no voters: 
I20260709 12:13:42.291460 26103 raft_consensus.cc:2804] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:42.292536 26103 raft_consensus.cc:697] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 LEADER]: Becoming Leader. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Running, Role: LEADER
I20260709 12:13:42.293339 26103 consensus_queue.cc:237] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.300419 25798 catalog_manager.cc:5697] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 reported cstate change: term changed from 0 to 1, leader changed from <none> to 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "640f0c8ccaa14ecca2df2413a9cac469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:42.382293 25798 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55880:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:42.384272 25798 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:42.408995 25893 tablet_service.cc:1511] Processing CreateTablet for tablet 7591a31595f049e6b610095ba4a1af59 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e70cf75ede584c9e941749892f3fca73]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:42.409909 25969 tablet_service.cc:1511] Processing CreateTablet for tablet 7591a31595f049e6b610095ba4a1af59 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e70cf75ede584c9e941749892f3fca73]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:42.410418 25893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7591a31595f049e6b610095ba4a1af59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.411298 25969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7591a31595f049e6b610095ba4a1af59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.412889 26043 tablet_service.cc:1511] Processing CreateTablet for tablet 7591a31595f049e6b610095ba4a1af59 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e70cf75ede584c9e941749892f3fca73]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:42.414283 26043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7591a31595f049e6b610095ba4a1af59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.414415 25894 tablet_service.cc:1511] Processing CreateTablet for tablet 202c7e2dfca04f5ba4298db0439cd6b1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e70cf75ede584c9e941749892f3fca73]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:42.415685 25894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202c7e2dfca04f5ba4298db0439cd6b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.415783 25968 tablet_service.cc:1511] Processing CreateTablet for tablet 202c7e2dfca04f5ba4298db0439cd6b1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e70cf75ede584c9e941749892f3fca73]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:42.417117 25968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202c7e2dfca04f5ba4298db0439cd6b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.418538 26042 tablet_service.cc:1511] Processing CreateTablet for tablet 202c7e2dfca04f5ba4298db0439cd6b1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e70cf75ede584c9e941749892f3fca73]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:42.419797 26042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202c7e2dfca04f5ba4298db0439cd6b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.435899 26094 tablet_bootstrap.cc:492] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c: Bootstrap starting.
I20260709 12:13:42.442706 26094 tablet_bootstrap.cc:654] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.443784 26093 tablet_bootstrap.cc:492] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e: Bootstrap starting.
I20260709 12:13:42.450486 26093 tablet_bootstrap.cc:654] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.458568 26098 tablet_bootstrap.cc:492] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469: Bootstrap starting.
I20260709 12:13:42.461848 26094 tablet_bootstrap.cc:492] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c: No bootstrap required, opened a new log
I20260709 12:13:42.462674 26094 ts_tablet_manager.cc:1403] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.000s
I20260709 12:13:42.461848 26093 tablet_bootstrap.cc:492] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e: No bootstrap required, opened a new log
I20260709 12:13:42.465852 26098 tablet_bootstrap.cc:654] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.465970 26093 ts_tablet_manager.cc:1403] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:13:42.465088 26094 raft_consensus.cc:359] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.466735 26094 raft_consensus.cc:385] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.467116 26094 raft_consensus.cc:740] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96ab56ee528946b087990ba140235e7c, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.468042 26094 consensus_queue.cc:260] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.469394 26093 raft_consensus.cc:359] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.470289 26094 ts_tablet_manager.cc:1434] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:42.470412 26093 raft_consensus.cc:385] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.470942 26093 raft_consensus.cc:740] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c21e2303604563a2654aa870e8354e, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.472007 26094 tablet_bootstrap.cc:492] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c: Bootstrap starting.
I20260709 12:13:42.471873 26093 consensus_queue.cc:260] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.474879 26093 ts_tablet_manager.cc:1434] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:13:42.476142 26093 tablet_bootstrap.cc:492] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e: Bootstrap starting.
I20260709 12:13:42.478354 26098 tablet_bootstrap.cc:492] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469: No bootstrap required, opened a new log
I20260709 12:13:42.479027 26098 ts_tablet_manager.cc:1403] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 12:13:42.482380 26098 raft_consensus.cc:359] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.483264 26098 raft_consensus.cc:385] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.483601 26098 raft_consensus.cc:740] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.482939 26093 tablet_bootstrap.cc:654] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.486379 26098 consensus_queue.cc:260] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.489182 26098 ts_tablet_manager.cc:1434] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:13:42.489454 26094 tablet_bootstrap.cc:654] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.490383 26098 tablet_bootstrap.cc:492] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469: Bootstrap starting.
I20260709 12:13:42.492697 26093 tablet_bootstrap.cc:492] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e: No bootstrap required, opened a new log
I20260709 12:13:42.493391 26093 ts_tablet_manager.cc:1403] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:13:42.496666 26093 raft_consensus.cc:359] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.497506 26093 raft_consensus.cc:385] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.497862 26093 raft_consensus.cc:740] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c21e2303604563a2654aa870e8354e, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.498814 26098 tablet_bootstrap.cc:654] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.500558 26093 consensus_queue.cc:260] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.503144 26093 ts_tablet_manager.cc:1434] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:13:42.506421 26094 tablet_bootstrap.cc:492] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c: No bootstrap required, opened a new log
I20260709 12:13:42.506722 26098 tablet_bootstrap.cc:492] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469: No bootstrap required, opened a new log
I20260709 12:13:42.506925 26094 ts_tablet_manager.cc:1403] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.009s
I20260709 12:13:42.507283 26098 ts_tablet_manager.cc:1403] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 12:13:42.510026 26094 raft_consensus.cc:359] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.510069 26098 raft_consensus.cc:359] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.510807 26094 raft_consensus.cc:385] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.510946 26098 raft_consensus.cc:385] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.511233 26094 raft_consensus.cc:740] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96ab56ee528946b087990ba140235e7c, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.511323 26098 raft_consensus.cc:740] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.512072 26094 consensus_queue.cc:260] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.512243 26098 consensus_queue.cc:260] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.514456 26094 ts_tablet_manager.cc:1434] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:42.514925 26098 ts_tablet_manager.cc:1434] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:42.523367 26097 raft_consensus.cc:493] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.523991 26097 raft_consensus.cc:515] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.527520 26097 leader_election.cc:290] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083), 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229)
I20260709 12:13:42.540663 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202c7e2dfca04f5ba4298db0439cd6b1" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469" is_pre_election: true
I20260709 12:13:42.541430 25904 raft_consensus.cc:2468] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 0.
I20260709 12:13:42.541765 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202c7e2dfca04f5ba4298db0439cd6b1" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96ab56ee528946b087990ba140235e7c" is_pre_election: true
I20260709 12:13:42.542484 25979 raft_consensus.cc:2468] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 0.
I20260709 12:13:42.542645 26019 leader_election.cc:304] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 640f0c8ccaa14ecca2df2413a9cac469; no voters: 
I20260709 12:13:42.543522 26097 raft_consensus.cc:2804] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:42.543789 26097 raft_consensus.cc:493] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.544046 26097 raft_consensus.cc:3060] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.549870 26097 raft_consensus.cc:515] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.551720 26097 leader_election.cc:290] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 1 election: Requested vote from peers 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083), 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229)
I20260709 12:13:42.552495 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202c7e2dfca04f5ba4298db0439cd6b1" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
I20260709 12:13:42.552731 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202c7e2dfca04f5ba4298db0439cd6b1" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96ab56ee528946b087990ba140235e7c"
I20260709 12:13:42.553089 25904 raft_consensus.cc:3060] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.553289 25979 raft_consensus.cc:3060] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.558725 25979 raft_consensus.cc:2468] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 1.
I20260709 12:13:42.558748 25904 raft_consensus.cc:2468] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 1.
I20260709 12:13:42.559892 26017 leader_election.cc:304] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 96ab56ee528946b087990ba140235e7c; no voters: 
I20260709 12:13:42.560659 26097 raft_consensus.cc:2804] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:42.561726 26097 raft_consensus.cc:697] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Becoming Leader. State: Replica: 35c21e2303604563a2654aa870e8354e, State: Running, Role: LEADER
I20260709 12:13:42.562552 26097 consensus_queue.cc:237] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.570068 25800 catalog_manager.cc:5697] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35c21e2303604563a2654aa870e8354e (127.15.191.67). New cstate: current_term: 1 leader_uuid: "35c21e2303604563a2654aa870e8354e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:42.613848 25850 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:42.633476 26097 raft_consensus.cc:493] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.634057 26097 raft_consensus.cc:515] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.635986 26097 leader_election.cc:290] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083), 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229)
I20260709 12:13:42.636801 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469" is_pre_election: true
I20260709 12:13:42.637168 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96ab56ee528946b087990ba140235e7c" is_pre_election: true
I20260709 12:13:42.637421 25904 raft_consensus.cc:2468] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 0.
I20260709 12:13:42.637893 25979 raft_consensus.cc:2468] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 0.
I20260709 12:13:42.638463 26019 leader_election.cc:304] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 640f0c8ccaa14ecca2df2413a9cac469; no voters: 
I20260709 12:13:42.639230 26097 raft_consensus.cc:2804] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:42.639575 26097 raft_consensus.cc:493] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.639848 26097 raft_consensus.cc:3060] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.645265 26097 raft_consensus.cc:515] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.647068 26097 leader_election.cc:290] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 1 election: Requested vote from peers 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083), 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229)
I20260709 12:13:42.647946 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
I20260709 12:13:42.648164 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96ab56ee528946b087990ba140235e7c"
I20260709 12:13:42.648521 25904 raft_consensus.cc:3060] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.648769 25979 raft_consensus.cc:3060] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.653851 25904 raft_consensus.cc:2468] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 1.
I20260709 12:13:42.654188 25979 raft_consensus.cc:2468] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 1.
I20260709 12:13:42.654960 26019 leader_election.cc:304] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 640f0c8ccaa14ecca2df2413a9cac469; no voters: 
I20260709 12:13:42.655797 26097 raft_consensus.cc:2804] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:42.656234 26097 raft_consensus.cc:697] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Becoming Leader. State: Replica: 35c21e2303604563a2654aa870e8354e, State: Running, Role: LEADER
I20260709 12:13:42.656983 26097 consensus_queue.cc:237] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.663831 25800 catalog_manager.cc:5697] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35c21e2303604563a2654aa870e8354e (127.15.191.67). New cstate: current_term: 1 leader_uuid: "35c21e2303604563a2654aa870e8354e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.695704 25979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58d55b8bd57e40bfa84ca1a4c146c91e"
dest_uuid: "96ab56ee528946b087990ba140235e7c"
mode: GRACEFUL
new_leader_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
 from {username='slave'} at 127.0.0.1:42060
I20260709 12:13:42.696270 25979 raft_consensus.cc:606] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 1 LEADER]: Received request to transfer leadership to TS 640f0c8ccaa14ecca2df2413a9cac469
I20260709 12:13:42.708936 25904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0213f2a3923d4ac0a2a6f85ba37d723b"
dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
mode: GRACEFUL
new_leader_uuid: "35c21e2303604563a2654aa870e8354e"
 from {username='slave'} at 127.0.0.1:46984
I20260709 12:13:42.709478 25904 raft_consensus.cc:606] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 LEADER]: Received request to transfer leadership to TS 35c21e2303604563a2654aa870e8354e
I20260709 12:13:42.723534 26053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59"
dest_uuid: "35c21e2303604563a2654aa870e8354e"
mode: GRACEFUL
new_leader_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
 from {username='slave'} at 127.0.0.1:41960
I20260709 12:13:42.724148 26053 raft_consensus.cc:606] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Received request to transfer leadership to TS 640f0c8ccaa14ecca2df2413a9cac469
I20260709 12:13:42.725833 26105 consensus_queue.cc:1048] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:42.730229 26053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "202c7e2dfca04f5ba4298db0439cd6b1"
dest_uuid: "35c21e2303604563a2654aa870e8354e"
mode: GRACEFUL
new_leader_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
 from {username='slave'} at 127.0.0.1:41960
I20260709 12:13:42.731040 26053 raft_consensus.cc:606] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Received request to transfer leadership to TS 640f0c8ccaa14ecca2df2413a9cac469
I20260709 12:13:42.742741 26105 consensus_queue.cc:1048] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:42.752357 26099 raft_consensus.cc:993] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c: : Instructing follower 640f0c8ccaa14ecca2df2413a9cac469 to start an election
I20260709 12:13:42.752851 26099 raft_consensus.cc:1081] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 1 LEADER]: Signalling peer 640f0c8ccaa14ecca2df2413a9cac469 to start an election
I20260709 12:13:42.754386 25904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58d55b8bd57e40bfa84ca1a4c146c91e"
dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
 from {username='slave'} at 127.0.0.1:46966
I20260709 12:13:42.754912 25904 raft_consensus.cc:493] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:42.755282 25904 raft_consensus.cc:3060] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.761876 25904 raft_consensus.cc:515] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.764168 25904 leader_election.cc:290] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 2 election: Requested vote from peers 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229), 35c21e2303604563a2654aa870e8354e (127.15.191.67:36299)
I20260709 12:13:42.764972 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d55b8bd57e40bfa84ca1a4c146c91e" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96ab56ee528946b087990ba140235e7c"
I20260709 12:13:42.765697 25979 raft_consensus.cc:3055] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:42.765995 25979 raft_consensus.cc:740] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96ab56ee528946b087990ba140235e7c, State: Running, Role: LEADER
I20260709 12:13:42.765950 26052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d55b8bd57e40bfa84ca1a4c146c91e" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35c21e2303604563a2654aa870e8354e"
I20260709 12:13:42.766920 26052 raft_consensus.cc:3060] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.767197 25979 consensus_queue.cc:260] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.768688 25979 raft_consensus.cc:3060] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.774158 26052 raft_consensus.cc:2468] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 2.
I20260709 12:13:42.775437 25869 leader_election.cc:304] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 640f0c8ccaa14ecca2df2413a9cac469; no voters: 
I20260709 12:13:42.776279 26103 raft_consensus.cc:2804] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:42.776759 26103 raft_consensus.cc:697] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 LEADER]: Becoming Leader. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Running, Role: LEADER
I20260709 12:13:42.777650 26103 consensus_queue.cc:237] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } }
I20260709 12:13:42.776742 25979 raft_consensus.cc:2468] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 2.
I20260709 12:13:42.784649 25798 catalog_manager.cc:5697] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 reported cstate change: term changed from 1 to 2, leader changed from 96ab56ee528946b087990ba140235e7c (127.15.191.66) to 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "640f0c8ccaa14ecca2df2413a9cac469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.787907 26103 consensus_queue.cc:1048] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:42.798316 26108 raft_consensus.cc:993] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469: : Instructing follower 35c21e2303604563a2654aa870e8354e to start an election
I20260709 12:13:42.804970 26134 consensus_queue.cc:1048] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:42.812397 26103 raft_consensus.cc:1081] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 LEADER]: Signalling peer 35c21e2303604563a2654aa870e8354e to start an election
I20260709 12:13:42.815549 26052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0213f2a3923d4ac0a2a6f85ba37d723b"
dest_uuid: "35c21e2303604563a2654aa870e8354e"
 from {username='slave'} at 127.0.0.1:41958
I20260709 12:13:42.816206 26052 raft_consensus.cc:493] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:42.816593 26052 raft_consensus.cc:3060] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.825405 26052 raft_consensus.cc:515] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.827576 26052 leader_election.cc:290] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 2 election: Requested vote from peers 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083), 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229)
I20260709 12:13:42.828301 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0213f2a3923d4ac0a2a6f85ba37d723b" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
I20260709 12:13:42.828742 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0213f2a3923d4ac0a2a6f85ba37d723b" candidate_uuid: "35c21e2303604563a2654aa870e8354e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96ab56ee528946b087990ba140235e7c"
I20260709 12:13:42.829329 25979 raft_consensus.cc:3060] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.829042 25904 raft_consensus.cc:3055] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:42.829830 25904 raft_consensus.cc:740] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Running, Role: LEADER
I20260709 12:13:42.830690 25904 consensus_queue.cc:260] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.831804 25904 raft_consensus.cc:3060] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.835506 25979 raft_consensus.cc:2468] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 2.
I20260709 12:13:42.836854 26017 leader_election.cc:304] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 96ab56ee528946b087990ba140235e7c; no voters: 
I20260709 12:13:42.837224 25904 raft_consensus.cc:2468] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c21e2303604563a2654aa870e8354e in term 2.
I20260709 12:13:42.837604 26097 raft_consensus.cc:2804] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:42.838174 26097 raft_consensus.cc:697] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 2 LEADER]: Becoming Leader. State: Replica: 35c21e2303604563a2654aa870e8354e, State: Running, Role: LEADER
I20260709 12:13:42.838914 26097 consensus_queue.cc:237] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.845615 25800 catalog_manager.cc:5697] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e reported cstate change: term changed from 1 to 2, leader changed from 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65) to 35c21e2303604563a2654aa870e8354e (127.15.191.67). New cstate: current_term: 2 leader_uuid: "35c21e2303604563a2654aa870e8354e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.958258 26097 consensus_queue.cc:1048] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [LEADER]: Connected to new peer: Peer: permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:42.965562 26123 raft_consensus.cc:993] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e: : Instructing follower 640f0c8ccaa14ecca2df2413a9cac469 to start an election
I20260709 12:13:42.966348 26097 raft_consensus.cc:1081] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Signalling peer 640f0c8ccaa14ecca2df2413a9cac469 to start an election
I20260709 12:13:42.968766 25903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "202c7e2dfca04f5ba4298db0439cd6b1"
dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
 from {username='slave'} at 127.0.0.1:46972
I20260709 12:13:42.969403 25903 raft_consensus.cc:493] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:42.969818 25903 raft_consensus.cc:3060] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.971599 26123 consensus_queue.cc:1048] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [LEADER]: Connected to new peer: Peer: permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:42.977771 25903 raft_consensus.cc:515] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.979072 25904 raft_consensus.cc:1240] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Rejecting Update request from peer 35c21e2303604563a2654aa870e8354e for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.981956 25903 leader_election.cc:290] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 2 election: Requested vote from peers 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229), 35c21e2303604563a2654aa870e8354e (127.15.191.67:36299)
I20260709 12:13:42.982414 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202c7e2dfca04f5ba4298db0439cd6b1" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96ab56ee528946b087990ba140235e7c"
I20260709 12:13:42.982599 26052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202c7e2dfca04f5ba4298db0439cd6b1" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35c21e2303604563a2654aa870e8354e"
I20260709 12:13:42.983319 26052 raft_consensus.cc:3055] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:42.983716 26052 raft_consensus.cc:740] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35c21e2303604563a2654aa870e8354e, State: Running, Role: LEADER
I20260709 12:13:42.983191 25978 raft_consensus.cc:3060] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.984551 26052 consensus_queue.cc:260] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:42.985874 26052 raft_consensus.cc:3060] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:42.988656 26097 consensus_queue.cc:1175] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "640f0c8ccaa14ecca2df2413a9cac469" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 35c21e2303604563a2654aa870e8354e for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:42.993808 25978 raft_consensus.cc:2468] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 2.
I20260709 12:13:42.995086 25868 leader_election.cc:304] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 640f0c8ccaa14ecca2df2413a9cac469, 96ab56ee528946b087990ba140235e7c; no voters: 
I20260709 12:13:42.995360 26052 raft_consensus.cc:2468] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 2.
I20260709 12:13:42.995997 26103 raft_consensus.cc:2804] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:42.996517 26103 raft_consensus.cc:697] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 LEADER]: Becoming Leader. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Running, Role: LEADER
I20260709 12:13:42.997288 26103 consensus_queue.cc:237] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:43.003633 25798 catalog_manager.cc:5697] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 reported cstate change: term changed from 1 to 2, leader changed from 35c21e2303604563a2654aa870e8354e (127.15.191.67) to 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "640f0c8ccaa14ecca2df2413a9cac469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.128963 26097 consensus_queue.cc:1048] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [LEADER]: Connected to new peer: Peer: permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:43.139506 26123 consensus_queue.cc:1048] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [LEADER]: Connected to new peer: Peer: permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:43.147146 26137 raft_consensus.cc:993] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e: : Instructing follower 640f0c8ccaa14ecca2df2413a9cac469 to start an election
I20260709 12:13:43.147604 26123 raft_consensus.cc:1081] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Signalling peer 640f0c8ccaa14ecca2df2413a9cac469 to start an election
I20260709 12:13:43.149185 25904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59"
dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
 from {username='slave'} at 127.0.0.1:46972
I20260709 12:13:43.149887 25904 raft_consensus.cc:493] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:43.150334 25904 raft_consensus.cc:3060] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.155615 25904 raft_consensus.cc:515] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:43.157598 25904 leader_election.cc:290] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 2 election: Requested vote from peers 96ab56ee528946b087990ba140235e7c (127.15.191.66:43229), 35c21e2303604563a2654aa870e8354e (127.15.191.67:36299)
I20260709 12:13:43.158375 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96ab56ee528946b087990ba140235e7c"
I20260709 12:13:43.158833 26052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59" candidate_uuid: "640f0c8ccaa14ecca2df2413a9cac469" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35c21e2303604563a2654aa870e8354e"
I20260709 12:13:43.159137 25978 raft_consensus.cc:3060] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.159511 26052 raft_consensus.cc:3055] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.159813 26052 raft_consensus.cc:740] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35c21e2303604563a2654aa870e8354e, State: Running, Role: LEADER
I20260709 12:13:43.160530 26052 consensus_queue.cc:260] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:43.161522 26052 raft_consensus.cc:3060] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.166635 25978 raft_consensus.cc:2468] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 2.
I20260709 12:13:43.167876 25868 leader_election.cc:304] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 640f0c8ccaa14ecca2df2413a9cac469, 96ab56ee528946b087990ba140235e7c; no voters: 
I20260709 12:13:43.168593 26103 raft_consensus.cc:2804] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:43.168644 26052 raft_consensus.cc:2468] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640f0c8ccaa14ecca2df2413a9cac469 in term 2.
I20260709 12:13:43.169214 26103 raft_consensus.cc:697] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 LEADER]: Becoming Leader. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Running, Role: LEADER
I20260709 12:13:43.169970 26103 consensus_queue.cc:237] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:43.176008 25800 catalog_manager.cc:5697] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 reported cstate change: term changed from 1 to 2, leader changed from 35c21e2303604563a2654aa870e8354e (127.15.191.67) to 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "640f0c8ccaa14ecca2df2413a9cac469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.227087 16125 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:13:43.228716 16125 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:13:43.229127 16125 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:13:43.241053 25904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59"
dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
mode: GRACEFUL
new_leader_uuid: "96ab56ee528946b087990ba140235e7c"
 from {username='slave'} at 127.0.0.1:46994
I20260709 12:13:43.241657 25904 raft_consensus.cc:606] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 LEADER]: Received request to transfer leadership to TS 96ab56ee528946b087990ba140235e7c
I20260709 12:13:43.242844 16125 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:13:43.246470 26052 raft_consensus.cc:1275] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Refusing update from remote peer 640f0c8ccaa14ecca2df2413a9cac469: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:43.247753 26103 consensus_queue.cc:1048] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.256927 25978 raft_consensus.cc:1275] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Refusing update from remote peer 640f0c8ccaa14ecca2df2413a9cac469: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:43.258589 26134 consensus_queue.cc:1048] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.379549 25904 raft_consensus.cc:1275] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Refusing update from remote peer 35c21e2303604563a2654aa870e8354e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:43.380982 26123 consensus_queue.cc:1048] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [LEADER]: Connected to new peer: Peer: permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.387488 25978 raft_consensus.cc:1275] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Refusing update from remote peer 35c21e2303604563a2654aa870e8354e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:43.389197 26137 consensus_queue.cc:1048] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [LEADER]: Connected to new peer: Peer: permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.459926 26052 raft_consensus.cc:1275] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Refusing update from remote peer 640f0c8ccaa14ecca2df2413a9cac469: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:43.461328 26134 consensus_queue.cc:1048] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.469501 25978 raft_consensus.cc:1275] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Refusing update from remote peer 640f0c8ccaa14ecca2df2413a9cac469: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:43.471530 26134 consensus_queue.cc:1048] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.632963 26052 raft_consensus.cc:1275] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Refusing update from remote peer 640f0c8ccaa14ecca2df2413a9cac469: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:43.634405 26108 consensus_queue.cc:1048] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.642194 25978 raft_consensus.cc:1275] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Refusing update from remote peer 640f0c8ccaa14ecca2df2413a9cac469: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:43.645119 26108 consensus_queue.cc:1048] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.651427 26133 raft_consensus.cc:993] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469: : Instructing follower 96ab56ee528946b087990ba140235e7c to start an election
I20260709 12:13:43.651928 26108 raft_consensus.cc:1081] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 LEADER]: Signalling peer 96ab56ee528946b087990ba140235e7c to start an election
I20260709 12:13:43.653502 25978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59"
dest_uuid: "96ab56ee528946b087990ba140235e7c"
 from {username='slave'} at 127.0.0.1:42042
I20260709 12:13:43.654081 25978 raft_consensus.cc:493] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:43.654475 25978 raft_consensus.cc:3060] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.660508 25978 raft_consensus.cc:515] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:43.663019 25978 leader_election.cc:290] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [CANDIDATE]: Term 3 election: Requested vote from peers 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083), 35c21e2303604563a2654aa870e8354e (127.15.191.67:36299)
I20260709 12:13:43.663393 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59" candidate_uuid: "96ab56ee528946b087990ba140235e7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "640f0c8ccaa14ecca2df2413a9cac469"
I20260709 12:13:43.663686 26052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591a31595f049e6b610095ba4a1af59" candidate_uuid: "96ab56ee528946b087990ba140235e7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35c21e2303604563a2654aa870e8354e"
I20260709 12:13:43.664150 25904 raft_consensus.cc:3055] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:43.664276 26052 raft_consensus.cc:3060] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.665021 25904 raft_consensus.cc:740] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 640f0c8ccaa14ecca2df2413a9cac469, State: Running, Role: LEADER
I20260709 12:13:43.665930 25904 consensus_queue.cc:260] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:43.667275 25904 raft_consensus.cc:3060] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.672004 26052 raft_consensus.cc:2468] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96ab56ee528946b087990ba140235e7c in term 3.
I20260709 12:13:43.673393 25944 leader_election.cc:304] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c21e2303604563a2654aa870e8354e, 96ab56ee528946b087990ba140235e7c; no voters: 
I20260709 12:13:43.674157 26105 raft_consensus.cc:2804] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.674454 25904 raft_consensus.cc:2468] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96ab56ee528946b087990ba140235e7c in term 3.
I20260709 12:13:43.675176 26105 raft_consensus.cc:697] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 3 LEADER]: Becoming Leader. State: Replica: 96ab56ee528946b087990ba140235e7c, State: Running, Role: LEADER
I20260709 12:13:43.676076 26105 consensus_queue.cc:237] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } }
I20260709 12:13:43.682451 25802 catalog_manager.cc:5697] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c reported cstate change: term changed from 2 to 3, leader changed from 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65) to 96ab56ee528946b087990ba140235e7c (127.15.191.66). New cstate: current_term: 3 leader_uuid: "96ab56ee528946b087990ba140235e7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "640f0c8ccaa14ecca2df2413a9cac469" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 46083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96ab56ee528946b087990ba140235e7c" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c21e2303604563a2654aa870e8354e" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 36299 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.877375 16125 tablet_server.cc:179] TabletServer@127.15.191.65:0 shutting down...
I20260709 12:13:43.899204 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:43.899936 16125 tablet_replica.cc:333] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469: stopping tablet replica
I20260709 12:13:43.900494 16125 raft_consensus.cc:2243] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.900892 16125 raft_consensus.cc:2272] T 7591a31595f049e6b610095ba4a1af59 P 640f0c8ccaa14ecca2df2413a9cac469 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.903359 16125 tablet_replica.cc:333] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469: stopping tablet replica
I20260709 12:13:43.903873 16125 raft_consensus.cc:2243] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.904659 16125 raft_consensus.cc:2272] T 202c7e2dfca04f5ba4298db0439cd6b1 P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.906932 16125 tablet_replica.cc:333] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469: stopping tablet replica
I20260709 12:13:43.907433 16125 raft_consensus.cc:2243] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.907822 16125 raft_consensus.cc:2272] T 0213f2a3923d4ac0a2a6f85ba37d723b P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.909898 16125 tablet_replica.cc:333] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469: stopping tablet replica
I20260709 12:13:43.910410 16125 raft_consensus.cc:2243] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.911167 16125 raft_consensus.cc:2272] T 58d55b8bd57e40bfa84ca1a4c146c91e P 640f0c8ccaa14ecca2df2413a9cac469 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:43.927426 26019 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.191.65:46083: connect: Connection refused (error 111) [suppressed 119 similar messages]
W20260709 12:13:43.930761 26019 consensus_peers.cc:597] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e -> Peer 640f0c8ccaa14ecca2df2413a9cac469 (127.15.191.65:46083): Couldn't send request to peer 640f0c8ccaa14ecca2df2413a9cac469. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:46083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:43.934132 16125 tablet_server.cc:196] TabletServer@127.15.191.65:0 shutdown complete.
I20260709 12:13:43.946676 16125 tablet_server.cc:179] TabletServer@127.15.191.66:0 shutting down...
I20260709 12:13:43.963275 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:43.963918 16125 tablet_replica.cc:333] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c: stopping tablet replica
I20260709 12:13:43.964522 16125 raft_consensus.cc:2243] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.965191 16125 pending_rounds.cc:70] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c: Trying to abort 1 pending ops.
I20260709 12:13:43.965380 16125 pending_rounds.cc:77] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305622420184469504 op_type: NO_OP noop_request { }
I20260709 12:13:43.965692 16125 raft_consensus.cc:2889] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:43.965977 16125 raft_consensus.cc:2272] T 7591a31595f049e6b610095ba4a1af59 P 96ab56ee528946b087990ba140235e7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.968516 16125 tablet_replica.cc:333] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c: stopping tablet replica
I20260709 12:13:43.969062 16125 raft_consensus.cc:2243] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.969506 16125 raft_consensus.cc:2272] T 202c7e2dfca04f5ba4298db0439cd6b1 P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.971841 16125 tablet_replica.cc:333] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c: stopping tablet replica
I20260709 12:13:43.972349 16125 raft_consensus.cc:2243] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.972756 16125 raft_consensus.cc:2272] T 0213f2a3923d4ac0a2a6f85ba37d723b P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.975090 16125 tablet_replica.cc:333] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c: stopping tablet replica
I20260709 12:13:43.975533 16125 raft_consensus.cc:2243] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.975929 16125 raft_consensus.cc:2272] T 58d55b8bd57e40bfa84ca1a4c146c91e P 96ab56ee528946b087990ba140235e7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.988358 16125 tablet_server.cc:196] TabletServer@127.15.191.66:0 shutdown complete.
I20260709 12:13:44.000418 16125 tablet_server.cc:179] TabletServer@127.15.191.67:0 shutting down...
I20260709 12:13:44.016191 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:44.016841 16125 tablet_replica.cc:333] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e: stopping tablet replica
I20260709 12:13:44.017421 16125 raft_consensus.cc:2243] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.017894 16125 raft_consensus.cc:2272] T 7591a31595f049e6b610095ba4a1af59 P 35c21e2303604563a2654aa870e8354e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.020134 16125 tablet_replica.cc:333] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e: stopping tablet replica
I20260709 12:13:44.020639 16125 raft_consensus.cc:2243] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.021054 16125 raft_consensus.cc:2272] T 58d55b8bd57e40bfa84ca1a4c146c91e P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.023438 16125 tablet_replica.cc:333] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e: stopping tablet replica
I20260709 12:13:44.023960 16125 raft_consensus.cc:2243] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.024387 16125 raft_consensus.cc:2272] T 202c7e2dfca04f5ba4298db0439cd6b1 P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.026571 16125 tablet_replica.cc:333] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e: stopping tablet replica
I20260709 12:13:44.027055 16125 raft_consensus.cc:2243] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.027837 16125 raft_consensus.cc:2272] T 0213f2a3923d4ac0a2a6f85ba37d723b P 35c21e2303604563a2654aa870e8354e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.050458 16125 tablet_server.cc:196] TabletServer@127.15.191.67:0 shutdown complete.
I20260709 12:13:44.063297 16125 master.cc:562] Master@127.15.191.126:44857 shutting down...
I20260709 12:13:44.078418 16125 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.078980 16125 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.079309 16125 tablet_replica.cc:333] T 00000000000000000000000000000000 P 83befa6cf11a48a0b07511b1b12731ee: stopping tablet replica
I20260709 12:13:44.090377 16125 master.cc:584] Master@127.15.191.126:44857 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2685 ms)
[----------] 6 tests from LeaderRebalancerTest (331571 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:13:44.120877 16125 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.191.126:36731
I20260709 12:13:44.122038 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:44.127445 26149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:44.127617 26150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:44.128603 26152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:44.129669 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:44.130839 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:44.131069 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:44.131242 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599224131222 us; error 0 us; skew 500 ppm
I20260709 12:13:44.131816 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:44.134374 16125 webserver.cc:533] Webserver started at http://127.15.191.126:46427/ using document root <none> and password file <none>
I20260709 12:13:44.134908 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:44.135090 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:44.135357 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:44.136488 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/master-0-root/instance:
uuid: "e9d67ea8069e443cba9f4e7877848b24"
format_stamp: "Formatted at 2026-07-09 12:13:44 on dist-test-slave-1sdq"
I20260709 12:13:44.141114 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:13:44.144742 26157 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.145463 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:44.145745 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/master-0-root
uuid: "e9d67ea8069e443cba9f4e7877848b24"
format_stamp: "Formatted at 2026-07-09 12:13:44 on dist-test-slave-1sdq"
I20260709 12:13:44.146024 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:44.163564 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:44.164631 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:44.201210 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.126:36731
I20260709 12:13:44.201320 26208 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.126:36731 every 8 connection(s)
I20260709 12:13:44.205178 26209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.217095 26209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24: Bootstrap starting.
I20260709 12:13:44.221649 26209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.225828 26209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24: No bootstrap required, opened a new log
I20260709 12:13:44.228106 26209 raft_consensus.cc:359] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9d67ea8069e443cba9f4e7877848b24" member_type: VOTER }
I20260709 12:13:44.228511 26209 raft_consensus.cc:385] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.228693 26209 raft_consensus.cc:740] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9d67ea8069e443cba9f4e7877848b24, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.229202 26209 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9d67ea8069e443cba9f4e7877848b24" member_type: VOTER }
I20260709 12:13:44.229640 26209 raft_consensus.cc:399] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:44.229836 26209 raft_consensus.cc:493] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:44.230054 26209 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.235311 26209 raft_consensus.cc:515] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9d67ea8069e443cba9f4e7877848b24" member_type: VOTER }
I20260709 12:13:44.235823 26209 leader_election.cc:304] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9d67ea8069e443cba9f4e7877848b24; no voters: 
I20260709 12:13:44.237022 26209 leader_election.cc:290] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:44.237341 26212 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.238755 26212 raft_consensus.cc:697] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 1 LEADER]: Becoming Leader. State: Replica: e9d67ea8069e443cba9f4e7877848b24, State: Running, Role: LEADER
I20260709 12:13:44.239476 26212 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9d67ea8069e443cba9f4e7877848b24" member_type: VOTER }
I20260709 12:13:44.239889 26209 sys_catalog.cc:565] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:44.242327 26214 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9d67ea8069e443cba9f4e7877848b24. Latest consensus state: current_term: 1 leader_uuid: "e9d67ea8069e443cba9f4e7877848b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9d67ea8069e443cba9f4e7877848b24" member_type: VOTER } }
I20260709 12:13:44.242336 26213 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9d67ea8069e443cba9f4e7877848b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9d67ea8069e443cba9f4e7877848b24" member_type: VOTER } }
I20260709 12:13:44.243180 26213 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:44.243187 26214 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:44.245836 26217 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:44.250945 26217 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:44.256172 16125 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:44.260404 26217 catalog_manager.cc:1383] Generated new cluster ID: 51f9ee6741fd4c9fbfa98b658e182a84
I20260709 12:13:44.260736 26217 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:44.274919 26217 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:44.276301 26217 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:44.288944 26217 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24: Generated new TSK 0
I20260709 12:13:44.289602 26217 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:44.323944 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:44.330176 26230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:44.330976 26231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:44.332535 26233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:44.333381 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:44.334365 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:44.334563 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:44.334688 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599224334677 us; error 0 us; skew 500 ppm
I20260709 12:13:44.335171 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:44.337570 16125 webserver.cc:533] Webserver started at http://127.15.191.65:46723/ using document root <none> and password file <none>
I20260709 12:13:44.338075 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:44.338310 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:44.338531 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:44.339619 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-0-root/instance:
uuid: "f56f48f4cb954f69bbbe89790ff0184b"
format_stamp: "Formatted at 2026-07-09 12:13:44 on dist-test-slave-1sdq"
I20260709 12:13:44.344271 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:13:44.347991 26238 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.348789 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:13:44.349102 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "f56f48f4cb954f69bbbe89790ff0184b"
format_stamp: "Formatted at 2026-07-09 12:13:44 on dist-test-slave-1sdq"
I20260709 12:13:44.349398 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:44.370829 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:44.371970 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:44.373440 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:44.375823 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:44.376052 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.376278 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:44.376430 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.414717 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:32771
I20260709 12:13:44.414825 26300 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:32771 every 8 connection(s)
I20260709 12:13:44.419509 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:44.426860 26305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:44.427595 26306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:44.429636 26308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:44.430177 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:44.431265 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:44.431519 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:44.431682 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599224431662 us; error 0 us; skew 500 ppm
I20260709 12:13:44.432209 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:44.434338 26301 heartbeater.cc:344] Connected to a master server at 127.15.191.126:36731
I20260709 12:13:44.434787 26301 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:44.435186 16125 webserver.cc:533] Webserver started at http://127.15.191.66:37235/ using document root <none> and password file <none>
I20260709 12:13:44.435778 26301 heartbeater.cc:507] Master 127.15.191.126:36731 requested a full tablet report, sending...
I20260709 12:13:44.435904 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:44.436282 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:44.436623 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:44.437945 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-1-root/instance:
uuid: "8ec323776dd74df884d1a2895190de08"
format_stamp: "Formatted at 2026-07-09 12:13:44 on dist-test-slave-1sdq"
I20260709 12:13:44.438292 26174 ts_manager.cc:194] Registered new tserver with Master: f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771)
I20260709 12:13:44.440164 26174 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51670
I20260709 12:13:44.442787 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:44.446524 26313 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.447407 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:13:44.447731 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-1-root
uuid: "8ec323776dd74df884d1a2895190de08"
format_stamp: "Formatted at 2026-07-09 12:13:44 on dist-test-slave-1sdq"
I20260709 12:13:44.448058 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:44.459447 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:44.460526 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:44.461930 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:44.464190 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:44.464396 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.464634 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:44.464784 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.504349 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.66:36321
I20260709 12:13:44.504464 26375 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.66:36321 every 8 connection(s)
I20260709 12:13:44.509373 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:44.517028 26379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:44.517820 26380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:44.523526 26382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:44.523845 26376 heartbeater.cc:344] Connected to a master server at 127.15.191.126:36731
I20260709 12:13:44.524341 26376 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:44.524530 16125 server_base.cc:1061] running on GCE node
I20260709 12:13:44.525203 26376 heartbeater.cc:507] Master 127.15.191.126:36731 requested a full tablet report, sending...
I20260709 12:13:44.525496 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:44.525774 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:44.525934 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599224525918 us; error 0 us; skew 500 ppm
I20260709 12:13:44.526684 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:44.527462 26174 ts_manager.cc:194] Registered new tserver with Master: 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:44.529481 16125 webserver.cc:533] Webserver started at http://127.15.191.67:43537/ using document root <none> and password file <none>
I20260709 12:13:44.529481 26174 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51680
I20260709 12:13:44.530375 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:44.530591 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:44.530891 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:44.532333 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-2-root/instance:
uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
format_stamp: "Formatted at 2026-07-09 12:13:44 on dist-test-slave-1sdq"
I20260709 12:13:44.536998 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:13:44.540555 26387 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.541441 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:13:44.541788 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-2-root
uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
format_stamp: "Formatted at 2026-07-09 12:13:44 on dist-test-slave-1sdq"
I20260709 12:13:44.542069 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598892377095-16125-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:44.558395 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:44.559470 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:44.560967 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:44.563355 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:44.563565 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.563797 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:44.563947 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:44.602869 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.67:42609
I20260709 12:13:44.602988 26449 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.67:42609 every 8 connection(s)
I20260709 12:13:44.616374 26450 heartbeater.cc:344] Connected to a master server at 127.15.191.126:36731
I20260709 12:13:44.616845 26450 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:44.617594 26450 heartbeater.cc:507] Master 127.15.191.126:36731 requested a full tablet report, sending...
I20260709 12:13:44.619596 26174 ts_manager.cc:194] Registered new tserver with Master: cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:44.620707 16125 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014559387s
I20260709 12:13:44.621007 26174 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51694
I20260709 12:13:44.646781 26174 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51696:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:44.649506 26174 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:44.711977 26341 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4179658e9f4cbc96d5e111043540d8 (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:44.713562 26341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4179658e9f4cbc96d5e111043540d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.716465 26340 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa05f2a66314c89a64728182acf311a (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:44.718243 26340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa05f2a66314c89a64728182acf311a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.728997 26339 tablet_service.cc:1511] Processing CreateTablet for tablet 313bca89d2cf4461b91e2f5f87e4040d (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:44.730620 26339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313bca89d2cf4461b91e2f5f87e4040d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.734484 26338 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9cca0b928e4f8cbf0dc7e1bf9b749f (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:44.736486 26338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9cca0b928e4f8cbf0dc7e1bf9b749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.743144 26414 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa05f2a66314c89a64728182acf311a (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:44.741341 26415 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4179658e9f4cbc96d5e111043540d8 (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:44.743091 26463 tablet_bootstrap.cc:492] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:44.744256 26413 tablet_service.cc:1511] Processing CreateTablet for tablet 313bca89d2cf4461b91e2f5f87e4040d (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:44.744489 26412 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9cca0b928e4f8cbf0dc7e1bf9b749f (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:44.747262 26414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa05f2a66314c89a64728182acf311a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.754441 26463 tablet_bootstrap.cc:654] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.754561 26412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9cca0b928e4f8cbf0dc7e1bf9b749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.758522 26413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313bca89d2cf4461b91e2f5f87e4040d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.760516 26415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4179658e9f4cbc96d5e111043540d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.773371 26340 tablet_service.cc:1511] Processing CreateTablet for tablet 04e89064748241a2bb501953befa7732 (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:44.774888 26340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e89064748241a2bb501953befa7732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.782133 26411 tablet_service.cc:1511] Processing CreateTablet for tablet 04e89064748241a2bb501953befa7732 (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:44.784046 26411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e89064748241a2bb501953befa7732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.791724 26341 tablet_service.cc:1511] Processing CreateTablet for tablet bd3670397bae4ffebeffd8b52995a3e7 (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:44.793336 26341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3670397bae4ffebeffd8b52995a3e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.809852 26410 tablet_service.cc:1511] Processing CreateTablet for tablet bd3670397bae4ffebeffd8b52995a3e7 (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:44.811733 26410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3670397bae4ffebeffd8b52995a3e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.819626 26339 tablet_service.cc:1511] Processing CreateTablet for tablet b58abe74b412410aa73902953bd99aac (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:44.821139 26339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58abe74b412410aa73902953bd99aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.821628 26466 tablet_bootstrap.cc:492] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:44.826474 26463 tablet_bootstrap.cc:492] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:44.827091 26463 ts_tablet_manager.cc:1403] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.084s	user 0.021s	sys 0.047s
I20260709 12:13:44.828083 26414 tablet_service.cc:1511] Processing CreateTablet for tablet b58abe74b412410aa73902953bd99aac (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:44.829633 26414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58abe74b412410aa73902953bd99aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.830242 26463 raft_consensus.cc:359] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:44.831075 26463 raft_consensus.cc:385] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.831401 26463 raft_consensus.cc:740] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.832206 26463 consensus_queue.cc:260] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:44.839686 26466 tablet_bootstrap.cc:654] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.841084 26266 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4179658e9f4cbc96d5e111043540d8 (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:44.842561 26266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4179658e9f4cbc96d5e111043540d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.846282 26337 tablet_service.cc:1511] Processing CreateTablet for tablet af5dc33ed33644a0bee606cd2fdfbfbb (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:44.847924 26337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5dc33ed33644a0bee606cd2fdfbfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.848827 26376 heartbeater.cc:499] Master 127.15.191.126:36731 was elected leader, sending a full tablet report...
I20260709 12:13:44.849372 26463 ts_tablet_manager.cc:1434] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:13:44.849040 26265 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa05f2a66314c89a64728182acf311a (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:44.850582 26463 tablet_bootstrap.cc:492] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:44.850687 26265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa05f2a66314c89a64728182acf311a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.855788 26264 tablet_service.cc:1511] Processing CreateTablet for tablet 313bca89d2cf4461b91e2f5f87e4040d (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:44.856781 26463 tablet_bootstrap.cc:654] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.857383 26264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313bca89d2cf4461b91e2f5f87e4040d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.866374 26463 tablet_bootstrap.cc:492] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:44.867220 26463 ts_tablet_manager.cc:1403] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 12:13:44.870573 26463 raft_consensus.cc:359] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:44.871510 26463 raft_consensus.cc:385] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.871913 26463 raft_consensus.cc:740] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.872882 26463 consensus_queue.cc:260] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:44.875152 26263 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9cca0b928e4f8cbf0dc7e1bf9b749f (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:44.875775 26463 ts_tablet_manager.cc:1434] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:44.876644 26263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9cca0b928e4f8cbf0dc7e1bf9b749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.877099 26463 tablet_bootstrap.cc:492] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:44.882277 26262 tablet_service.cc:1511] Processing CreateTablet for tablet 04e89064748241a2bb501953befa7732 (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:44.883735 26262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e89064748241a2bb501953befa7732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.883867 26463 tablet_bootstrap.cc:654] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.887878 26261 tablet_service.cc:1511] Processing CreateTablet for tablet bd3670397bae4ffebeffd8b52995a3e7 (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:44.889369 26261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3670397bae4ffebeffd8b52995a3e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.894415 26260 tablet_service.cc:1511] Processing CreateTablet for tablet b58abe74b412410aa73902953bd99aac (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:44.895080 26412 tablet_service.cc:1511] Processing CreateTablet for tablet af5dc33ed33644a0bee606cd2fdfbfbb (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:44.895917 26260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58abe74b412410aa73902953bd99aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.896353 26412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5dc33ed33644a0bee606cd2fdfbfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.899715 26259 tablet_service.cc:1511] Processing CreateTablet for tablet af5dc33ed33644a0bee606cd2fdfbfbb (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:44.901175 26259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5dc33ed33644a0bee606cd2fdfbfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.905580 26341 tablet_service.cc:1511] Processing CreateTablet for tablet d75c4f0adb814b07aa31bcb2e32299ea (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:44.907261 26341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75c4f0adb814b07aa31bcb2e32299ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.911962 26414 tablet_service.cc:1511] Processing CreateTablet for tablet d75c4f0adb814b07aa31bcb2e32299ea (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:44.913456 26414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75c4f0adb814b07aa31bcb2e32299ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.926501 26258 tablet_service.cc:1511] Processing CreateTablet for tablet d75c4f0adb814b07aa31bcb2e32299ea (DEFAULT_TABLE table=test-workload [id=2c7a085922ea48aa8e3d293494dfc372]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:44.928053 26258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75c4f0adb814b07aa31bcb2e32299ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.937350 26463 tablet_bootstrap.cc:492] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:44.938161 26463 ts_tablet_manager.cc:1403] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.061s	user 0.031s	sys 0.029s
I20260709 12:13:44.941233 26463 raft_consensus.cc:359] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:44.942142 26463 raft_consensus.cc:385] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.942485 26463 raft_consensus.cc:740] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.943318 26463 consensus_queue.cc:260] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:44.944181 26471 tablet_bootstrap.cc:492] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:44.945773 26463 ts_tablet_manager.cc:1434] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:44.947052 26463 tablet_bootstrap.cc:492] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:44.953326 26463 tablet_bootstrap.cc:654] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.974817 26471 tablet_bootstrap.cc:654] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.985532 26467 raft_consensus.cc:493] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.986644 26467 raft_consensus.cc:515] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:44.993343 26467 leader_election.cc:290] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609), f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771)
I20260709 12:13:45.015158 26466 tablet_bootstrap.cc:492] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:45.015930 26466 ts_tablet_manager.cc:1403] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.195s	user 0.044s	sys 0.060s
I20260709 12:13:45.032480 26466 raft_consensus.cc:359] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.033320 26466 raft_consensus.cc:385] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.033618 26466 raft_consensus.cc:740] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.041465 26466 consensus_queue.cc:260] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.043322 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.043905 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:45.044323 26471 tablet_bootstrap.cc:492] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:45.044880 26471 ts_tablet_manager.cc:1403] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.031s
I20260709 12:13:45.043773 26463 tablet_bootstrap.cc:492] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:45.045656 26463 ts_tablet_manager.cc:1403] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.053s
W20260709 12:13:45.045658 26317 leader_election.cc:343] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:45.046831 26317 leader_election.cc:343] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.047313 26317 leader_election.cc:304] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ec323776dd74df884d1a2895190de08; no voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:45.048357 26471 raft_consensus.cc:359] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:45.049532 26467 raft_consensus.cc:2749] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.049261 26463 raft_consensus.cc:359] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.050240 26463 raft_consensus.cc:385] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.049265 26471 raft_consensus.cc:385] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.051446 26471 raft_consensus.cc:740] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.050560 26463 raft_consensus.cc:740] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.053077 26466 ts_tablet_manager.cc:1434] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.037s	user 0.014s	sys 0.003s
I20260709 12:13:45.059059 26450 heartbeater.cc:499] Master 127.15.191.126:36731 was elected leader, sending a full tablet report...
I20260709 12:13:45.058676 26463 consensus_queue.cc:260] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.059403 26466 tablet_bootstrap.cc:492] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:45.061311 26463 ts_tablet_manager.cc:1434] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:13:45.062418 26463 tablet_bootstrap.cc:492] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:45.066466 26466 tablet_bootstrap.cc:654] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.074124 26463 tablet_bootstrap.cc:654] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.086849 26463 tablet_bootstrap.cc:492] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:45.087527 26463 ts_tablet_manager.cc:1403] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 12:13:45.090993 26463 raft_consensus.cc:359] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.091892 26463 raft_consensus.cc:385] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.092233 26463 raft_consensus.cc:740] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.091550 26471 consensus_queue.cc:260] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:45.093374 26463 consensus_queue.cc:260] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.096344 26463 ts_tablet_manager.cc:1434] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:13:45.097692 26463 tablet_bootstrap.cc:492] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:45.104903 26463 tablet_bootstrap.cc:654] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.113715 26301 heartbeater.cc:499] Master 127.15.191.126:36731 was elected leader, sending a full tablet report...
I20260709 12:13:45.114341 26471 ts_tablet_manager.cc:1434] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.069s	user 0.033s	sys 0.018s
I20260709 12:13:45.115499 26471 tablet_bootstrap.cc:492] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:45.116422 26463 tablet_bootstrap.cc:492] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:45.117101 26463 ts_tablet_manager.cc:1403] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:13:45.118818 26466 tablet_bootstrap.cc:492] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:45.119438 26466 ts_tablet_manager.cc:1403] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.024s
I20260709 12:13:45.120492 26463 raft_consensus.cc:359] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.121430 26463 raft_consensus.cc:385] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.121861 26471 tablet_bootstrap.cc:654] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.121807 26463 raft_consensus.cc:740] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.122676 26466 raft_consensus.cc:359] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.122856 26463 consensus_queue.cc:260] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.123721 26466 raft_consensus.cc:385] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.124114 26466 raft_consensus.cc:740] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.125070 26466 consensus_queue.cc:260] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.126336 26463 ts_tablet_manager.cc:1434] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:13:45.127699 26466 ts_tablet_manager.cc:1434] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:45.127744 26463 tablet_bootstrap.cc:492] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:45.128881 26466 tablet_bootstrap.cc:492] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:45.135527 26463 tablet_bootstrap.cc:654] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.135911 26466 tablet_bootstrap.cc:654] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.136950 26471 tablet_bootstrap.cc:492] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:45.137578 26471 ts_tablet_manager.cc:1403] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:13:45.141806 26471 raft_consensus.cc:359] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.142783 26471 raft_consensus.cc:385] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.143117 26471 raft_consensus.cc:740] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.144163 26471 consensus_queue.cc:260] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.146860 26471 ts_tablet_manager.cc:1434] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:13:45.148473 26466 tablet_bootstrap.cc:492] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:45.149042 26466 ts_tablet_manager.cc:1403] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:13:45.152212 26466 raft_consensus.cc:359] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:45.152977 26466 raft_consensus.cc:385] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.153285 26466 raft_consensus.cc:740] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.154278 26466 consensus_queue.cc:260] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:45.158624 26466 ts_tablet_manager.cc:1434] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:13:45.159823 26471 tablet_bootstrap.cc:492] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:45.159814 26466 tablet_bootstrap.cc:492] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:45.167320 26466 tablet_bootstrap.cc:654] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.167747 26471 tablet_bootstrap.cc:654] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.173280 26463 tablet_bootstrap.cc:492] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:45.174067 26463 ts_tablet_manager.cc:1403] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.017s
I20260709 12:13:45.177810 26463 raft_consensus.cc:359] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.178879 26463 raft_consensus.cc:385] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.179302 26463 raft_consensus.cc:740] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.180219 26466 tablet_bootstrap.cc:492] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:45.180842 26466 ts_tablet_manager.cc:1403] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:13:45.180464 26463 consensus_queue.cc:260] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.183494 26466 raft_consensus.cc:359] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.184085 26466 raft_consensus.cc:385] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.184270 26466 raft_consensus.cc:740] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.184909 26466 consensus_queue.cc:260] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.187289 26463 ts_tablet_manager.cc:1434] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:13:45.189270 26475 raft_consensus.cc:493] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.190078 26463 tablet_bootstrap.cc:492] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:45.189927 26475 raft_consensus.cc:515] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.192866 26475 leader_election.cc:290] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.193328 26471 tablet_bootstrap.cc:492] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:45.193452 26475 raft_consensus.cc:493] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.194056 26471 ts_tablet_manager.cc:1403] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.011s
I20260709 12:13:45.195703 26475 raft_consensus.cc:515] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.198390 26463 tablet_bootstrap.cc:654] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.198927 26471 raft_consensus.cc:359] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.199736 26471 raft_consensus.cc:385] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.200151 26471 raft_consensus.cc:740] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.200479 26475 leader_election.cc:290] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.201179 26471 consensus_queue.cc:260] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.187561 26466 ts_tablet_manager.cc:1434] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.007s
I20260709 12:13:45.206650 26471 ts_tablet_manager.cc:1434] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:13:45.207278 26466 tablet_bootstrap.cc:492] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:45.208009 26471 tablet_bootstrap.cc:492] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:45.224892 26466 tablet_bootstrap.cc:654] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.225149 26471 tablet_bootstrap.cc:654] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.234304 26463 tablet_bootstrap.cc:492] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:45.236999 26463 ts_tablet_manager.cc:1403] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.023s
I20260709 12:13:45.240988 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.241953 26275 raft_consensus.cc:2468] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.241048 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e89064748241a2bb501953befa7732" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.243580 26391 leader_election.cc:304] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.244843 26485 raft_consensus.cc:2804] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.245285 26485 raft_consensus.cc:493] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.245612 26485 raft_consensus.cc:3060] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.246663 26463 raft_consensus.cc:359] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.250866 26463 raft_consensus.cc:385] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:45.248665 26391 leader_election.cc:343] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.251338 26463 raft_consensus.cc:740] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
W20260709 12:13:45.251327 26222 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:45.252432 26463 consensus_queue.cc:260] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.259191 26463 ts_tablet_manager.cc:1434] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:13:45.265061 26463 tablet_bootstrap.cc:492] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:45.273600 26466 tablet_bootstrap.cc:492] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:45.274173 26466 ts_tablet_manager.cc:1403] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.022s
I20260709 12:13:45.274734 26467 raft_consensus.cc:493] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.275319 26467 raft_consensus.cc:515] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.275967 26463 tablet_bootstrap.cc:654] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.276598 26471 tablet_bootstrap.cc:492] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:45.277196 26471 ts_tablet_manager.cc:1403] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.028s
I20260709 12:13:45.277467 26467 leader_election.cc:290] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.277400 26466 raft_consensus.cc:359] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.278373 26466 raft_consensus.cc:385] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.278681 26466 raft_consensus.cc:740] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.279657 26466 consensus_queue.cc:260] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.279867 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.280720 26276 raft_consensus.cc:2468] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:45.280953 26471 raft_consensus.cc:359] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.281383 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:45.281844 26471 raft_consensus.cc:385] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.282308 26471 raft_consensus.cc:740] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.282975 26317 leader_election.cc:304] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.283252 26471 consensus_queue.cc:260] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.284655 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e89064748241a2bb501953befa7732" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:45.285516 26351 raft_consensus.cc:2468] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.286178 26466 ts_tablet_manager.cc:1434] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:13:45.287351 26466 tablet_bootstrap.cc:492] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:45.287542 26388 leader_election.cc:304] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:45.288861 26471 ts_tablet_manager.cc:1434] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:13:45.289021 26475 raft_consensus.cc:2804] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.289580 26475 raft_consensus.cc:493] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.289960 26475 raft_consensus.cc:3060] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.290323 26471 tablet_bootstrap.cc:492] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:45.294137 26466 tablet_bootstrap.cc:654] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.294950 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:45.295784 26351 raft_consensus.cc:2468] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.298187 26471 tablet_bootstrap.cc:654] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.299912 26463 tablet_bootstrap.cc:492] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:45.300503 26463 ts_tablet_manager.cc:1403] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.017s
I20260709 12:13:45.307068 26471 tablet_bootstrap.cc:492] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:45.307814 26471 ts_tablet_manager.cc:1403] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:13:45.308633 26466 tablet_bootstrap.cc:492] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:45.308800 26467 raft_consensus.cc:2804] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.309258 26466 ts_tablet_manager.cc:1403] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 12:13:45.309245 26467 raft_consensus.cc:493] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.311053 26478 raft_consensus.cc:493] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.311388 26463 raft_consensus.cc:359] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.311255 26471 raft_consensus.cc:359] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.312244 26463 raft_consensus.cc:385] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.312435 26471 raft_consensus.cc:385] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.312165 26478 raft_consensus.cc:515] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:45.314949 26471 raft_consensus.cc:740] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.315990 26471 consensus_queue.cc:260] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.316396 26466 raft_consensus.cc:359] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.317231 26466 raft_consensus.cc:385] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.317564 26466 raft_consensus.cc:740] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.318378 26466 consensus_queue.cc:260] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.312845 26463 raft_consensus.cc:740] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.320096 26463 consensus_queue.cc:260] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.324708 26478 leader_election.cc:290] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.326624 26471 ts_tablet_manager.cc:1434] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.006s
I20260709 12:13:45.328831 26499 raft_consensus.cc:493] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.329413 26499 raft_consensus.cc:515] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.330035 26471 tablet_bootstrap.cc:492] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:45.331911 26463 ts_tablet_manager.cc:1434] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.010s
I20260709 12:13:45.337033 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313bca89d2cf4461b91e2f5f87e4040d" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.337862 26276 raft_consensus.cc:2468] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:45.337862 26471 tablet_bootstrap.cc:654] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.341228 26424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313bca89d2cf4461b91e2f5f87e4040d" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:45.342032 26424 raft_consensus.cc:2468] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:45.343832 26317 leader_election.cc:304] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:45.346206 26467 raft_consensus.cc:3060] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.352939 26499 leader_election.cc:290] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.354185 26499 raft_consensus.cc:493] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.354768 26499 raft_consensus.cc:515] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.357103 26499 leader_election.cc:290] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.357676 26499 raft_consensus.cc:2804] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.366955 26424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:45.366796 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.365887 26504 raft_consensus.cc:493] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.371289 26504 raft_consensus.cc:515] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
W20260709 12:13:45.372655 26317 leader_election.cc:343] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:45.373450 26317 leader_election.cc:343] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.373834 26317 leader_election.cc:304] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ec323776dd74df884d1a2895190de08; no voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:45.371765 26502 raft_consensus.cc:493] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.374747 26502 raft_consensus.cc:515] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.374827 26475 raft_consensus.cc:515] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.376984 26504 leader_election.cc:290] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.378942 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e89064748241a2bb501953befa7732" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:45.358027 26499 raft_consensus.cc:493] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.379735 26351 raft_consensus.cc:3060] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.380095 26499 raft_consensus.cc:3060] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.380173 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3670397bae4ffebeffd8b52995a3e7" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.380896 26276 raft_consensus.cc:2468] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:45.378196 26501 raft_consensus.cc:2749] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.383477 26502 leader_election.cc:290] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.385350 26424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3670397bae4ffebeffd8b52995a3e7" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:45.386132 26424 raft_consensus.cc:2468] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:45.385407 26317 leader_election.cc:304] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.387871 26501 raft_consensus.cc:2804] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.388253 26501 raft_consensus.cc:493] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.388576 26501 raft_consensus.cc:3060] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.391304 26350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3670397bae4ffebeffd8b52995a3e7" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:45.395499 26501 raft_consensus.cc:515] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.396855 26350 raft_consensus.cc:2393] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cac7b74a5a1941ac84b6e16cc57e9b45 in current term 1: Already voted for candidate 8ec323776dd74df884d1a2895190de08 in this term.
I20260709 12:13:45.397879 26502 raft_consensus.cc:493] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.398470 26502 raft_consensus.cc:515] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:45.257325 26485 raft_consensus.cc:515] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.400580 26425 raft_consensus.cc:2393] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ec323776dd74df884d1a2895190de08 in current term 1: Already voted for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in this term.
I20260709 12:13:45.402091 26350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:45.402890 26502 leader_election.cc:290] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771)
I20260709 12:13:45.403685 26350 raft_consensus.cc:2468] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.404574 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:45.405287 26388 leader_election.cc:304] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:45.406652 26502 raft_consensus.cc:2804] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.407029 26502 raft_consensus.cc:493] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.407356 26502 raft_consensus.cc:3060] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.411348 26499 raft_consensus.cc:515] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.389796 26351 raft_consensus.cc:2468] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:45.413772 26388 leader_election.cc:304] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:45.414253 26499 leader_election.cc:290] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.416298 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313bca89d2cf4461b91e2f5f87e4040d" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.416618 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313bca89d2cf4461b91e2f5f87e4040d" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:45.417054 26276 raft_consensus.cc:3060] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.417493 26425 raft_consensus.cc:3060] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.427300 26471 tablet_bootstrap.cc:492] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:45.427930 26471 ts_tablet_manager.cc:1403] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.030s
I20260709 12:13:45.428000 26274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e89064748241a2bb501953befa7732" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.401746 26485 leader_election.cc:290] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.429769 26485 raft_consensus.cc:2804] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.430393 26485 raft_consensus.cc:697] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:45.430615 26272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.431495 26272 raft_consensus.cc:2468] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.427091 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3670397bae4ffebeffd8b52995a3e7" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.432822 26275 raft_consensus.cc:2468] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.433298 26471 raft_consensus.cc:359] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.429883 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.434474 26273 raft_consensus.cc:3060] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.435844 26502 raft_consensus.cc:515] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:45.436517 26499 raft_consensus.cc:493] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.437101 26499 raft_consensus.cc:515] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.428208 26276 raft_consensus.cc:2468] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:45.434188 26471 raft_consensus.cc:385] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.439425 26499 leader_election.cc:290] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.441184 26499 raft_consensus.cc:493] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.443290 26499 raft_consensus.cc:515] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.445540 26499 leader_election.cc:290] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.440372 26317 leader_election.cc:304] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.439231 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:45.446754 26351 raft_consensus.cc:3060] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.440088 26471 raft_consensus.cc:740] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.440552 26424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:45.448433 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:45.449074 26495 raft_consensus.cc:2804] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.449451 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.448294 26471 consensus_queue.cc:260] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
W20260709 12:13:45.451372 26317 leader_election.cc:343] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:45.452208 26317 leader_election.cc:343] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:45.452926 26317 leader_election.cc:343] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.453346 26317 leader_election.cc:304] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ec323776dd74df884d1a2895190de08; no voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:45.453436 26467 raft_consensus.cc:515] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.454838 26349 raft_consensus.cc:2393] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cac7b74a5a1941ac84b6e16cc57e9b45 in current term 1: Already voted for candidate 8ec323776dd74df884d1a2895190de08 in this term.
I20260709 12:13:45.455181 26504 raft_consensus.cc:2749] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.456203 26425 raft_consensus.cc:2468] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:45.445578 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.458132 26276 raft_consensus.cc:2468] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:45.449798 26495 raft_consensus.cc:697] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:45.459545 26495 consensus_queue.cc:237] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.460206 26273 raft_consensus.cc:2468] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:45.461093 26501 leader_election.cc:290] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.458353 26485 consensus_queue.cc:237] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.463291 26471 ts_tablet_manager.cc:1434] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 12:13:45.465617 26475 leader_election.cc:290] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
W20260709 12:13:45.468379 26391 leader_election.cc:343] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.470772 26502 leader_election.cc:290] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771)
I20260709 12:13:45.471800 26317 leader_election.cc:304] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:45.472817 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3670397bae4ffebeffd8b52995a3e7" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.473623 26276 raft_consensus.cc:3060] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.474332 26501 raft_consensus.cc:2804] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.474826 26501 raft_consensus.cc:493] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.475363 26501 raft_consensus.cc:3060] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.481317 26471 tablet_bootstrap.cc:492] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:45.482836 26391 leader_election.cc:304] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 8ec323776dd74df884d1a2895190de08
I20260709 12:13:45.484365 26502 raft_consensus.cc:2804] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.484815 26502 raft_consensus.cc:493] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.485153 26502 raft_consensus.cc:3060] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.487825 26467 leader_election.cc:290] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.488570 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:45.489590 26423 raft_consensus.cc:2393] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ec323776dd74df884d1a2895190de08 in current term 1: Already voted for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in this term.
I20260709 12:13:45.491871 26391 leader_election.cc:304] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 8ec323776dd74df884d1a2895190de08
I20260709 12:13:45.493124 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3670397bae4ffebeffd8b52995a3e7" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:45.495083 26351 raft_consensus.cc:2468] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:45.496510 26388 leader_election.cc:304] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:45.497520 26475 raft_consensus.cc:2804] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.497778 26471 tablet_bootstrap.cc:654] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.498338 26174 catalog_manager.cc:5697] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 0 to 1, leader changed from <none> to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.499256 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.499531 26475 raft_consensus.cc:697] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:45.500625 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.501247 26275 raft_consensus.cc:3060] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.500792 26475 consensus_queue.cc:237] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:45.495620 26485 raft_consensus.cc:2804] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.505776 26502 raft_consensus.cc:515] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.507151 26425 raft_consensus.cc:2393] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ec323776dd74df884d1a2895190de08 in current term 1: Already voted for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in this term.
I20260709 12:13:45.508141 26466 ts_tablet_manager.cc:1434] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.198s	user 0.068s	sys 0.100s
I20260709 12:13:45.500069 26273 raft_consensus.cc:2393] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ec323776dd74df884d1a2895190de08 in current term 1: Already voted for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in this term.
I20260709 12:13:45.509310 26466 tablet_bootstrap.cc:492] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:45.510298 26317 leader_election.cc:304] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ec323776dd74df884d1a2895190de08; no voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:45.511569 26467 raft_consensus.cc:2749] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.515647 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:45.516577 26351 raft_consensus.cc:2393] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f56f48f4cb954f69bbbe89790ff0184b in current term 1: Already voted for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in this term.
I20260709 12:13:45.510751 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:45.521119 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3670397bae4ffebeffd8b52995a3e7" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.522336 26242 leader_election.cc:304] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f56f48f4cb954f69bbbe89790ff0184b; no voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:45.522068 26170 catalog_manager.cc:5697] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.524147 26276 raft_consensus.cc:2468] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:45.526263 26317 leader_election.cc:304] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:45.527755 26495 raft_consensus.cc:2804] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.528596 26495 raft_consensus.cc:697] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:45.529007 26275 raft_consensus.cc:2468] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:45.529870 26496 raft_consensus.cc:2749] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.531122 26485 raft_consensus.cc:697] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:45.533150 26485 consensus_queue.cc:237] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.538550 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3670397bae4ffebeffd8b52995a3e7" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:45.529713 26495 consensus_queue.cc:237] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.540031 26466 tablet_bootstrap.cc:654] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.540544 26388 leader_election.cc:304] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:45.541378 26502 leader_election.cc:290] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.542753 26475 raft_consensus.cc:2749] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.549067 26501 raft_consensus.cc:515] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.552394 26501 leader_election.cc:290] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.554291 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.555168 26471 tablet_bootstrap.cc:492] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:45.555938 26471 ts_tablet_manager.cc:1403] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.023s
I20260709 12:13:45.555121 26275 raft_consensus.cc:3060] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.561650 26471 raft_consensus.cc:359] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.562263 26471 raft_consensus.cc:385] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.562553 26471 raft_consensus.cc:740] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.555940 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:45.563361 26471 consensus_queue.cc:260] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
W20260709 12:13:45.564760 26317 leader_election.cc:343] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.565933 26471 ts_tablet_manager.cc:1434] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 12:13:45.567112 26471 tablet_bootstrap.cc:492] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:45.568132 26275 raft_consensus.cc:2468] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:45.569574 26317 leader_election.cc:304] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:45.570730 26495 raft_consensus.cc:2804] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.571413 26495 raft_consensus.cc:697] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:45.571913 26466 tablet_bootstrap.cc:492] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:45.572600 26466 ts_tablet_manager.cc:1403] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.015s
I20260709 12:13:45.572273 26495 consensus_queue.cc:237] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.573879 26471 tablet_bootstrap.cc:654] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.577289 26466 raft_consensus.cc:359] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.578289 26466 raft_consensus.cc:385] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.578665 26466 raft_consensus.cc:740] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.579668 26466 consensus_queue.cc:260] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.582415 26466 ts_tablet_manager.cc:1434] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:13:45.586150 26466 tablet_bootstrap.cc:492] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:45.592557 26466 tablet_bootstrap.cc:654] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.596688 26471 tablet_bootstrap.cc:492] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:45.597224 26471 ts_tablet_manager.cc:1403] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.016s
I20260709 12:13:45.597803 26466 tablet_bootstrap.cc:492] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:45.598366 26466 ts_tablet_manager.cc:1403] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 12:13:45.600054 26471 raft_consensus.cc:359] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.600823 26471 raft_consensus.cc:385] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.601073 26471 raft_consensus.cc:740] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.601004 26466 raft_consensus.cc:359] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.601744 26466 raft_consensus.cc:385] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.602011 26466 raft_consensus.cc:740] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.601994 26471 consensus_queue.cc:260] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.603112 26466 consensus_queue.cc:260] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.604614 26471 ts_tablet_manager.cc:1434] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:45.605309 26466 ts_tablet_manager.cc:1434] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:13:45.605707 26471 tablet_bootstrap.cc:492] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:45.605008 26170 catalog_manager.cc:5697] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 0 to 1, leader changed from <none> to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.606233 26466 tablet_bootstrap.cc:492] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:45.606920 26170 catalog_manager.cc:5697] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 0 to 1, leader changed from <none> to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.611181 26466 tablet_bootstrap.cc:654] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.611063 26174 catalog_manager.cc:5697] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.615759 26471 tablet_bootstrap.cc:654] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.615224 26174 catalog_manager.cc:5697] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.623234 26466 tablet_bootstrap.cc:492] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:45.623858 26466 ts_tablet_manager.cc:1403] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 12:13:45.626372 26466 raft_consensus.cc:359] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.626886 26466 raft_consensus.cc:385] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.627091 26466 raft_consensus.cc:740] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.627712 26466 consensus_queue.cc:260] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.629241 26466 ts_tablet_manager.cc:1434] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:13:45.632357 26471 tablet_bootstrap.cc:492] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:45.632938 26471 ts_tablet_manager.cc:1403] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.001s
I20260709 12:13:45.635619 26471 raft_consensus.cc:359] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.636297 26471 raft_consensus.cc:385] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.636519 26471 raft_consensus.cc:740] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.637144 26471 consensus_queue.cc:260] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.638972 26471 ts_tablet_manager.cc:1434] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:45.668109 26495 raft_consensus.cc:493] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.668749 26495 raft_consensus.cc:515] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.670682 26495 leader_election.cc:290] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.671573 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58abe74b412410aa73902953bd99aac" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.671927 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58abe74b412410aa73902953bd99aac" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:45.672318 26275 raft_consensus.cc:2468] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:45.672580 26425 raft_consensus.cc:2468] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:45.673508 26317 leader_election.cc:304] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.674356 26495 raft_consensus.cc:2804] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.674662 26495 raft_consensus.cc:493] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.674919 26495 raft_consensus.cc:3060] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.680231 26495 raft_consensus.cc:515] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.682003 26495 leader_election.cc:290] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:45.682924 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58abe74b412410aa73902953bd99aac" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.683228 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58abe74b412410aa73902953bd99aac" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:45.683529 26275 raft_consensus.cc:3060] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.683796 26425 raft_consensus.cc:3060] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.688912 26275 raft_consensus.cc:2468] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:45.688939 26425 raft_consensus.cc:2468] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:45.690235 26317 leader_election.cc:304] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.690886 26495 raft_consensus.cc:2804] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.691273 26495 raft_consensus.cc:697] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:45.692098 26495 consensus_queue.cc:237] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.699060 26170 catalog_manager.cc:5697] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.726006 26485 raft_consensus.cc:493] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.726639 26485 raft_consensus.cc:515] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.728404 26485 leader_election.cc:290] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.729157 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.729367 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:45.729781 26275 raft_consensus.cc:2468] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.729974 26351 raft_consensus.cc:2468] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.730786 26391 leader_election.cc:304] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.731544 26485 raft_consensus.cc:2804] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.731918 26485 raft_consensus.cc:493] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.732015 26475 raft_consensus.cc:493] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.732239 26485 raft_consensus.cc:3060] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.732556 26475 raft_consensus.cc:515] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.734439 26475 leader_election.cc:290] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.735328 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.735549 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:45.736033 26275 raft_consensus.cc:2393] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cac7b74a5a1941ac84b6e16cc57e9b45 in current term 1: Already voted for candidate 8ec323776dd74df884d1a2895190de08 in this term.
I20260709 12:13:45.737228 26388 leader_election.cc:304] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:45.737908 26475 raft_consensus.cc:3060] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.739724 26485 raft_consensus.cc:515] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.742198 26485 leader_election.cc:290] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.743007 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.743280 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:45.743579 26275 raft_consensus.cc:3060] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.744040 26351 raft_consensus.cc:3060] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.745466 26475 raft_consensus.cc:2749] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.749135 26275 raft_consensus.cc:2468] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:45.749953 26351 raft_consensus.cc:2468] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:45.750306 26391 leader_election.cc:304] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.751124 26475 raft_consensus.cc:2804] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.751571 26475 raft_consensus.cc:697] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:45.752327 26475 consensus_queue.cc:237] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.759435 26170 catalog_manager.cc:5697] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 0 to 1, leader changed from <none> to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.804563 26475 raft_consensus.cc:493] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.805126 26475 raft_consensus.cc:515] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.806913 26475 leader_election.cc:290] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.807813 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:45.808017 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:45.808475 26275 raft_consensus.cc:2468] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.808606 26351 raft_consensus.cc:2468] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:45.809465 26391 leader_election.cc:304] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.810230 26475 raft_consensus.cc:2804] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.810519 26475 raft_consensus.cc:493] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.810767 26475 raft_consensus.cc:3060] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.815915 26475 raft_consensus.cc:515] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.817690 26475 leader_election.cc:290] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:45.818537 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:45.818656 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:45.819099 26275 raft_consensus.cc:3060] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.819206 26351 raft_consensus.cc:3060] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.824220 26275 raft_consensus.cc:2468] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:45.824437 26351 raft_consensus.cc:2468] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:45.825301 26391 leader_election.cc:304] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:45.826149 26475 raft_consensus.cc:2804] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.826537 26475 raft_consensus.cc:697] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:45.827279 26475 consensus_queue.cc:237] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:45.834015 26170 catalog_manager.cc:5697] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 0 to 1, leader changed from <none> to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.907119 26495 consensus_queue.cc:1048] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.913825 26275 raft_consensus.cc:3060] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.924202 26485 consensus_queue.cc:1048] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.927104 26501 consensus_queue.cc:1048] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.940200 26502 consensus_queue.cc:1048] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:45.959838 26475 consensus_queue.cc:1048] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.971396 26475 consensus_queue.cc:1048] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:46.005445 26475 consensus_queue.cc:1048] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.009552 26502 consensus_queue.cc:1048] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.026697 26501 consensus_queue.cc:1048] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.040138 26495 consensus_queue.cc:1048] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.046274 26495 consensus_queue.cc:1048] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.060611 26501 consensus_queue.cc:1048] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.119889 26425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
mode: GRACEFUL
new_leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:13:46.120438 26425 raft_consensus.cc:606] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Received request to transfer leadership to TS f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:46.125857 26425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
mode: GRACEFUL
new_leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:13:46.126416 26425 raft_consensus.cc:606] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Received request to transfer leadership to TS f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:46.142132 26351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "313bca89d2cf4461b91e2f5f87e4040d"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
mode: GRACEFUL
new_leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:34924
I20260709 12:13:46.142665 26351 raft_consensus.cc:606] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Received request to transfer leadership to TS f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:46.147815 26425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
mode: GRACEFUL
new_leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:13:46.148371 26425 raft_consensus.cc:606] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Received request to transfer leadership to TS f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:46.153652 26425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04e89064748241a2bb501953befa7732"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
mode: GRACEFUL
new_leader_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:13:46.154223 26425 raft_consensus.cc:606] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Received request to transfer leadership to TS 8ec323776dd74df884d1a2895190de08
I20260709 12:13:46.164987 26425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
mode: GRACEFUL
new_leader_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:13:46.165534 26425 raft_consensus.cc:606] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Received request to transfer leadership to TS 8ec323776dd74df884d1a2895190de08
I20260709 12:13:46.170511 26351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
mode: GRACEFUL
new_leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:34924
I20260709 12:13:46.171034 26351 raft_consensus.cc:606] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Received request to transfer leadership to TS cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:46.210434 26501 consensus_queue.cc:1048] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.219020 26475 consensus_queue.cc:1048] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.224908 26501 consensus_queue.cc:1048] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.235448 26485 consensus_queue.cc:1048] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.244778 26475 raft_consensus.cc:993] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45: : Instructing follower f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:46.245291 26485 raft_consensus.cc:1081] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Signalling peer f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:46.247052 26275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:57668
I20260709 12:13:46.247632 26275 raft_consensus.cc:493] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:46.248005 26275 raft_consensus.cc:3060] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.255019 26275 raft_consensus.cc:515] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.257534 26275 leader_election.cc:290] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:46.258389 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:46.259158 26351 raft_consensus.cc:3060] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.258587 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9cca0b928e4f8cbf0dc7e1bf9b749f" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:46.259897 26425 raft_consensus.cc:3055] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:46.260212 26425 raft_consensus.cc:740] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:46.261031 26425 consensus_queue.cc:260] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.262410 26425 raft_consensus.cc:3060] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.267009 26351 raft_consensus.cc:2468] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:46.268309 26239 leader_election.cc:304] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:46.269178 26496 raft_consensus.cc:2804] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:46.270321 26496 raft_consensus.cc:697] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:46.270936 26425 raft_consensus.cc:2468] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:46.271135 26496 consensus_queue.cc:237] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.277572 26170 catalog_manager.cc:5697] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 1 to 2, leader changed from cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67) to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 2 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.349932 26485 consensus_queue.cc:1048] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.361397 26485 consensus_queue.cc:1048] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.369024 26510 raft_consensus.cc:993] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45: : Instructing follower 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:46.369482 26485 raft_consensus.cc:1081] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Signalling peer 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:46.371122 26351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:34918
I20260709 12:13:46.371739 26351 raft_consensus.cc:493] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:46.372116 26351 raft_consensus.cc:3060] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.379108 26351 raft_consensus.cc:515] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.380755 26351 leader_election.cc:290] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:46.382055 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:46.382220 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dc33ed33644a0bee606cd2fdfbfbb" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:46.382866 26425 raft_consensus.cc:3055] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:46.382932 26275 raft_consensus.cc:3060] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.383194 26425 raft_consensus.cc:740] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:46.384001 26425 consensus_queue.cc:260] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.385015 26425 raft_consensus.cc:3060] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.389308 26275 raft_consensus.cc:2468] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:46.390514 26425 raft_consensus.cc:2468] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:46.390568 26317 leader_election.cc:304] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:46.391428 26467 raft_consensus.cc:2804] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:46.391824 26467 raft_consensus.cc:697] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:46.392524 26467 consensus_queue.cc:237] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.398491 26173 catalog_manager.cc:5697] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 1 to 2, leader changed from cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67) to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.402213 26495 raft_consensus.cc:993] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08: : Instructing follower f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:46.402751 26467 raft_consensus.cc:1081] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Signalling peer f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:46.404305 26275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "313bca89d2cf4461b91e2f5f87e4040d"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:57662
I20260709 12:13:46.404898 26275 raft_consensus.cc:493] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:46.405275 26275 raft_consensus.cc:3060] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.410924 26275 raft_consensus.cc:515] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.412743 26275 leader_election.cc:290] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:46.413556 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313bca89d2cf4461b91e2f5f87e4040d" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:46.413952 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313bca89d2cf4461b91e2f5f87e4040d" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:46.414316 26351 raft_consensus.cc:3055] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:46.414610 26425 raft_consensus.cc:3060] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.414709 26351 raft_consensus.cc:740] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:46.415671 26351 consensus_queue.cc:260] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.416978 26351 raft_consensus.cc:3060] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.422364 26425 raft_consensus.cc:2468] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:46.423681 26242 leader_election.cc:304] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:46.424368 26351 raft_consensus.cc:2468] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:46.424554 26496 raft_consensus.cc:2804] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:46.425149 26496 raft_consensus.cc:697] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:46.426936 26496 consensus_queue.cc:237] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.433401 26173 catalog_manager.cc:5697] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 1 to 2, leader changed from 8ec323776dd74df884d1a2895190de08 (127.15.191.66) to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 2 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.462908 26495 raft_consensus.cc:993] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08: : Instructing follower cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:46.463390 26495 raft_consensus.cc:1081] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Signalling peer cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:46.464239 26510 raft_consensus.cc:993] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45: : Instructing follower 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:46.464798 26485 raft_consensus.cc:1081] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Signalling peer 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:46.465111 26425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:52008
I20260709 12:13:46.465749 26425 raft_consensus.cc:493] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:46.466143 26425 raft_consensus.cc:3060] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.466495 26351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04e89064748241a2bb501953befa7732"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:34918
I20260709 12:13:46.467089 26351 raft_consensus.cc:493] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:46.467458 26351 raft_consensus.cc:3060] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.475001 26502 raft_consensus.cc:993] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45: : Instructing follower f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:46.475180 26351 raft_consensus.cc:515] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.475646 26485 raft_consensus.cc:1081] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Signalling peer f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:46.476243 26425 raft_consensus.cc:515] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.477761 26275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:57668
I20260709 12:13:46.478322 26351 leader_election.cc:290] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:46.478485 26275 raft_consensus.cc:493] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:46.479089 26275 raft_consensus.cc:3060] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.479229 26425 leader_election.cc:290] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 2 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:46.478387 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e89064748241a2bb501953befa7732" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:46.480381 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:46.481263 26351 raft_consensus.cc:3055] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:46.481648 26351 raft_consensus.cc:740] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:46.479077 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e89064748241a2bb501953befa7732" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:46.482355 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75c4f0adb814b07aa31bcb2e32299ea" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:46.482582 26423 raft_consensus.cc:3055] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:46.483016 26273 raft_consensus.cc:3060] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.481199 26276 raft_consensus.cc:3060] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.482578 26351 consensus_queue.cc:260] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.484207 26351 raft_consensus.cc:3060] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.485942 26423 raft_consensus.cc:740] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:46.486920 26423 consensus_queue.cc:260] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.487365 26275 raft_consensus.cc:515] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:46.488345 26423 raft_consensus.cc:3060] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.489979 26275 leader_election.cc:290] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:46.490537 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:46.491079 26349 raft_consensus.cc:3060] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.491080 26273 raft_consensus.cc:2468] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 2.
I20260709 12:13:46.491672 26351 raft_consensus.cc:2468] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 2.
I20260709 12:13:46.492300 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:46.492913 26425 raft_consensus.cc:3055] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:46.493011 26388 leader_election.cc:304] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:46.493296 26425 raft_consensus.cc:740] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:46.494315 26425 consensus_queue.cc:260] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:46.495512 26425 raft_consensus.cc:3060] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.495604 26502 raft_consensus.cc:2804] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:46.496280 26502 raft_consensus.cc:697] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:46.497057 26502 consensus_queue.cc:237] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.502349 26276 raft_consensus.cc:2468] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:46.503685 26317 leader_election.cc:304] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:46.504549 26495 raft_consensus.cc:2804] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:46.505090 26495 raft_consensus.cc:697] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:46.504760 26173 catalog_manager.cc:5697] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 1 to 2, leader changed from 8ec323776dd74df884d1a2895190de08 (127.15.191.66) to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.505983 26495 consensus_queue.cc:237] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.509538 26423 raft_consensus.cc:2468] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:46.511821 26349 raft_consensus.cc:2468] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:46.513000 26351 raft_consensus.cc:1240] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Rejecting Update request from peer cac7b74a5a1941ac84b6e16cc57e9b45 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:46.515041 26239 leader_election.cc:304] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:46.515978 26496 raft_consensus.cc:2804] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:46.516700 26496 raft_consensus.cc:697] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:46.515956 26170 catalog_manager.cc:5697] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 1 to 2, leader changed from cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67) to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.516959 26425 raft_consensus.cc:2468] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:46.517580 26496 consensus_queue.cc:237] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:46.526548 26173 catalog_manager.cc:5697] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 1 to 2, leader changed from cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67) to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 2 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.563179 26510 raft_consensus.cc:993] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45: : Instructing follower f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:46.563611 26510 raft_consensus.cc:1081] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Signalling peer f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:46.565249 26276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:57668
I20260709 12:13:46.565758 26276 raft_consensus.cc:493] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:46.566051 26276 raft_consensus.cc:3060] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.571354 26276 raft_consensus.cc:515] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.573000 26276 leader_election.cc:290] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:46.573892 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:46.574199 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa05f2a66314c89a64728182acf311a" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:46.574499 26351 raft_consensus.cc:3060] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.574787 26425 raft_consensus.cc:3055] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:46.575068 26425 raft_consensus.cc:740] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:46.575742 26425 consensus_queue.cc:260] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.576713 26425 raft_consensus.cc:3060] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.579929 26351 raft_consensus.cc:2468] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:46.581395 26239 leader_election.cc:304] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:46.582124 26496 raft_consensus.cc:2804] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:46.582247 26425 raft_consensus.cc:2468] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:46.582671 26496 raft_consensus.cc:697] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:46.583526 26496 consensus_queue.cc:237] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:46.589946 26173 catalog_manager.cc:5697] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 1 to 2, leader changed from cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67) to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 2 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.773649 26425 raft_consensus.cc:1275] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.775069 26495 consensus_queue.cc:1048] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.783591 26276 raft_consensus.cc:1275] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.785461 26501 consensus_queue.cc:1048] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.793900 26425 raft_consensus.cc:1275] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.795398 26496 consensus_queue.cc:1048] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.803586 26351 raft_consensus.cc:1275] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.805585 26496 consensus_queue.cc:1048] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.933785 26351 raft_consensus.cc:1275] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.935115 26496 consensus_queue.cc:1048] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.944849 26425 raft_consensus.cc:1275] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.946561 26552 consensus_queue.cc:1048] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.951435 26351 raft_consensus.cc:1275] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.953289 26552 consensus_queue.cc:1048] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.959398 26351 raft_consensus.cc:1275] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.964170 26425 raft_consensus.cc:1275] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.965765 26273 raft_consensus.cc:1275] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.966367 26496 consensus_queue.cc:1048] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.967337 26510 consensus_queue.cc:1048] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.970763 26510 consensus_queue.cc:1048] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.991333 26425 raft_consensus.cc:1275] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.992713 26501 consensus_queue.cc:1048] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:47.002048 26273 raft_consensus.cc:1275] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:47.004033 26495 consensus_queue.cc:1048] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:47.011790 26423 raft_consensus.cc:1275] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:47.013291 26496 consensus_queue.cc:1048] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:47.023200 26351 raft_consensus.cc:1275] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:47.024492 26552 consensus_queue.cc:1048] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:49.202641 26173 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51698:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:49.204888 26173 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:49.256915 26259 tablet_service.cc:1511] Processing CreateTablet for tablet 87fa6e4a38ec4f46b59e408868e1c6f0 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:49.258294 26259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fa6e4a38ec4f46b59e408868e1c6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.258149 26339 tablet_service.cc:1511] Processing CreateTablet for tablet 87fa6e4a38ec4f46b59e408868e1c6f0 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:49.259624 26339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fa6e4a38ec4f46b59e408868e1c6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.259356 26412 tablet_service.cc:1511] Processing CreateTablet for tablet 87fa6e4a38ec4f46b59e408868e1c6f0 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:49.260743 26412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fa6e4a38ec4f46b59e408868e1c6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.263891 26340 tablet_service.cc:1511] Processing CreateTablet for tablet 9e89e04666ec42b1b7252fe5dac4edbe (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:49.265345 26340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e89e04666ec42b1b7252fe5dac4edbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.269438 26413 tablet_service.cc:1511] Processing CreateTablet for tablet 9e89e04666ec42b1b7252fe5dac4edbe (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:49.272212 26337 tablet_service.cc:1511] Processing CreateTablet for tablet e7539c0db9a44b819f5583103196413b (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:49.273792 26337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7539c0db9a44b819f5583103196413b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.272212 26414 tablet_service.cc:1511] Processing CreateTablet for tablet e7539c0db9a44b819f5583103196413b (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:49.274652 26260 tablet_service.cc:1511] Processing CreateTablet for tablet d09aa9e9fa774018bc66bf87c649b47a (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:49.270994 26413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e89e04666ec42b1b7252fe5dac4edbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.275547 26338 tablet_service.cc:1511] Processing CreateTablet for tablet d09aa9e9fa774018bc66bf87c649b47a (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:49.269384 26263 tablet_service.cc:1511] Processing CreateTablet for tablet 9e89e04666ec42b1b7252fe5dac4edbe (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:49.276890 26338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09aa9e9fa774018bc66bf87c649b47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.277786 26341 tablet_service.cc:1511] Processing CreateTablet for tablet f5ea3cb7262b48a3baf6527cd8567af9 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:49.279166 26341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ea3cb7262b48a3baf6527cd8567af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.276048 26260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09aa9e9fa774018bc66bf87c649b47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.280790 26258 tablet_service.cc:1511] Processing CreateTablet for tablet f5ea3cb7262b48a3baf6527cd8567af9 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:49.281139 26261 tablet_service.cc:1511] Processing CreateTablet for tablet f268d6e6f19d4dc293017ca00c938868 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:49.283103 26410 tablet_service.cc:1511] Processing CreateTablet for tablet d09aa9e9fa774018bc66bf87c649b47a (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:49.285259 26411 tablet_service.cc:1511] Processing CreateTablet for tablet f5ea3cb7262b48a3baf6527cd8567af9 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:49.279090 26262 tablet_service.cc:1511] Processing CreateTablet for tablet e7539c0db9a44b819f5583103196413b (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:49.288375 26415 tablet_service.cc:1511] Processing CreateTablet for tablet f268d6e6f19d4dc293017ca00c938868 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:49.288846 26264 tablet_service.cc:1511] Processing CreateTablet for tablet 2138be12b42442ebab6b29a5aae37375 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:49.289378 26258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ea3cb7262b48a3baf6527cd8567af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.290067 26263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e89e04666ec42b1b7252fe5dac4edbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.290732 26261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f268d6e6f19d4dc293017ca00c938868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.293020 26264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2138be12b42442ebab6b29a5aae37375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.295217 26409 tablet_service.cc:1511] Processing CreateTablet for tablet 2138be12b42442ebab6b29a5aae37375 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:49.296438 26266 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbe92014c1a4656a6b43c352a205a86 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:49.297789 26266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbe92014c1a4656a6b43c352a205a86. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:49.298231 26222 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:49.298089 26265 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5f5ecc981c4e8abc8278ed952d45a7 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:49.299209 26408 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbe92014c1a4656a6b43c352a205a86 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:49.301432 26407 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5f5ecc981c4e8abc8278ed952d45a7 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:49.302544 26336 tablet_service.cc:1511] Processing CreateTablet for tablet f268d6e6f19d4dc293017ca00c938868 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:49.303972 26336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f268d6e6f19d4dc293017ca00c938868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.303663 26333 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5f5ecc981c4e8abc8278ed952d45a7 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:49.305003 26333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5f5ecc981c4e8abc8278ed952d45a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.305922 26411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ea3cb7262b48a3baf6527cd8567af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.306061 26335 tablet_service.cc:1511] Processing CreateTablet for tablet 2138be12b42442ebab6b29a5aae37375 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:49.306945 26415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f268d6e6f19d4dc293017ca00c938868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.307617 26335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2138be12b42442ebab6b29a5aae37375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.307693 26408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbe92014c1a4656a6b43c352a205a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.309221 26265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5f5ecc981c4e8abc8278ed952d45a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.314193 26334 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbe92014c1a4656a6b43c352a205a86 (DEFAULT_TABLE table=soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:49.315631 26334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbe92014c1a4656a6b43c352a205a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.318468 26410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09aa9e9fa774018bc66bf87c649b47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.326498 26262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7539c0db9a44b819f5583103196413b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.329999 26409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2138be12b42442ebab6b29a5aae37375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.334520 26407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5f5ecc981c4e8abc8278ed952d45a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.338482 26414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7539c0db9a44b819f5583103196413b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.399848 26572 tablet_bootstrap.cc:492] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:49.442898 26573 tablet_bootstrap.cc:492] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:49.452899 26572 tablet_bootstrap.cc:654] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.454656 26574 tablet_bootstrap.cc:492] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:49.456394 26573 tablet_bootstrap.cc:654] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.476413 26574 tablet_bootstrap.cc:654] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.477308 26572 tablet_bootstrap.cc:492] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:49.477607 26573 tablet_bootstrap.cc:492] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:49.478004 26572 ts_tablet_manager.cc:1403] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.078s	user 0.005s	sys 0.016s
I20260709 12:13:49.478185 26573 ts_tablet_manager.cc:1403] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.006s
I20260709 12:13:49.481091 26573 raft_consensus.cc:359] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.481782 26573 raft_consensus.cc:385] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.481408 26572 raft_consensus.cc:359] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.482031 26573 raft_consensus.cc:740] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.482286 26572 raft_consensus.cc:385] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.482656 26572 raft_consensus.cc:740] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.482803 26573 consensus_queue.cc:260] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.483184 26574 tablet_bootstrap.cc:492] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:49.483944 26574 ts_tablet_manager.cc:1403] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 12:13:49.483510 26572 consensus_queue.cc:260] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.485090 26573 ts_tablet_manager.cc:1434] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:13:49.486269 26573 tablet_bootstrap.cc:492] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:49.486348 26572 ts_tablet_manager.cc:1434] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:49.487639 26572 tablet_bootstrap.cc:492] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:49.487715 26574 raft_consensus.cc:359] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.488581 26574 raft_consensus.cc:385] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.488881 26574 raft_consensus.cc:740] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.489707 26574 consensus_queue.cc:260] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.492290 26574 ts_tablet_manager.cc:1434] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:13:49.493582 26574 tablet_bootstrap.cc:492] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:49.493649 26573 tablet_bootstrap.cc:654] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.502018 26574 tablet_bootstrap.cc:654] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.505348 26572 tablet_bootstrap.cc:654] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.506798 26573 tablet_bootstrap.cc:492] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:49.507572 26573 ts_tablet_manager.cc:1403] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:13:49.511018 26573 raft_consensus.cc:359] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.514896 26573 raft_consensus.cc:385] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.515210 26573 raft_consensus.cc:740] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.515966 26573 consensus_queue.cc:260] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.518777 26573 ts_tablet_manager.cc:1434] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:13:49.519773 26573 tablet_bootstrap.cc:492] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:49.521982 26561 raft_consensus.cc:493] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.522603 26561 raft_consensus.cc:515] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.525772 26561 leader_election.cc:290] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:49.527593 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:49.529172 26574 tablet_bootstrap.cc:492] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:49.529956 26574 ts_tablet_manager.cc:1403] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.012s
W20260709 12:13:49.530196 26317 leader_election.cc:343] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.533551 26574 raft_consensus.cc:359] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.534531 26574 raft_consensus.cc:385] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.534869 26574 raft_consensus.cc:740] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.535773 26574 consensus_queue.cc:260] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.529307 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:49.538621 26574 ts_tablet_manager.cc:1434] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:49.539857 26574 tablet_bootstrap.cc:492] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:49.527101 26573 tablet_bootstrap.cc:654] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:49.538676 26317 leader_election.cc:343] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.544512 26317 leader_election.cc:304] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ec323776dd74df884d1a2895190de08; no voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:49.548120 26561 raft_consensus.cc:2749] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.556453 26574 tablet_bootstrap.cc:654] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.569258 26574 tablet_bootstrap.cc:492] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:49.575134 26574 ts_tablet_manager.cc:1403] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.005s
I20260709 12:13:49.578655 26574 raft_consensus.cc:359] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.579478 26574 raft_consensus.cc:385] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.579783 26574 raft_consensus.cc:740] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.580621 26574 consensus_queue.cc:260] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.583160 26574 ts_tablet_manager.cc:1434] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:49.584487 26574 tablet_bootstrap.cc:492] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:49.592221 26574 tablet_bootstrap.cc:654] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.606065 26572 tablet_bootstrap.cc:492] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:49.606631 26572 ts_tablet_manager.cc:1403] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.119s	user 0.029s	sys 0.059s
I20260709 12:13:49.613687 26572 raft_consensus.cc:359] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.614476 26572 raft_consensus.cc:385] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.614770 26572 raft_consensus.cc:740] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.615509 26572 consensus_queue.cc:260] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.619602 26572 ts_tablet_manager.cc:1434] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:13:49.619804 26574 tablet_bootstrap.cc:492] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:49.620828 26572 tablet_bootstrap.cc:492] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:49.624260 26574 ts_tablet_manager.cc:1403] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.016s
I20260709 12:13:49.628805 26572 tablet_bootstrap.cc:654] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.628890 26574 raft_consensus.cc:359] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.630014 26574 raft_consensus.cc:385] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.630429 26573 tablet_bootstrap.cc:492] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:49.630450 26574 raft_consensus.cc:740] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.631099 26573 ts_tablet_manager.cc:1403] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.053s
I20260709 12:13:49.631727 26574 consensus_queue.cc:260] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.634344 26574 ts_tablet_manager.cc:1434] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:13:49.634303 26573 raft_consensus.cc:359] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.635249 26572 tablet_bootstrap.cc:492] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:49.635625 26574 tablet_bootstrap.cc:492] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:49.635979 26572 ts_tablet_manager.cc:1403] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 12:13:49.639408 26572 raft_consensus.cc:359] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.640231 26572 raft_consensus.cc:385] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.640614 26572 raft_consensus.cc:740] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.641505 26572 consensus_queue.cc:260] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.642588 26574 tablet_bootstrap.cc:654] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.644192 26572 ts_tablet_manager.cc:1434] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:49.645547 26572 tablet_bootstrap.cc:492] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:49.635232 26573 raft_consensus.cc:385] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.651512 26573 raft_consensus.cc:740] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.652469 26574 tablet_bootstrap.cc:492] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:49.653067 26572 tablet_bootstrap.cc:654] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.652508 26573 consensus_queue.cc:260] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.653294 26574 ts_tablet_manager.cc:1403] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 12:13:49.656687 26574 raft_consensus.cc:359] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.657557 26574 raft_consensus.cc:385] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.657868 26574 raft_consensus.cc:740] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.658643 26574 consensus_queue.cc:260] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.661012 26574 ts_tablet_manager.cc:1434] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:49.662375 26574 tablet_bootstrap.cc:492] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:49.665064 26573 ts_tablet_manager.cc:1434] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:13:49.669160 26574 tablet_bootstrap.cc:654] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.671808 26573 tablet_bootstrap.cc:492] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:49.675117 26572 tablet_bootstrap.cc:492] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:49.675765 26574 tablet_bootstrap.cc:492] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:49.676010 26572 ts_tablet_manager.cc:1403] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.007s
I20260709 12:13:49.676220 26574 ts_tablet_manager.cc:1403] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.008s
I20260709 12:13:49.679677 26574 raft_consensus.cc:359] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.679746 26572 raft_consensus.cc:359] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.680581 26574 raft_consensus.cc:385] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.680737 26573 tablet_bootstrap.cc:654] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.680640 26572 raft_consensus.cc:385] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.681046 26574 raft_consensus.cc:740] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.681293 26572 raft_consensus.cc:740] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.681913 26574 consensus_queue.cc:260] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.682040 26572 consensus_queue.cc:260] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.684468 26572 ts_tablet_manager.cc:1434] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:13:49.684468 26574 ts_tablet_manager.cc:1434] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:49.685695 26572 tablet_bootstrap.cc:492] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:49.686477 26574 tablet_bootstrap.cc:492] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:49.693220 26572 tablet_bootstrap.cc:654] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.693672 26574 tablet_bootstrap.cc:654] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.706208 26572 tablet_bootstrap.cc:492] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:49.706362 26574 tablet_bootstrap.cc:492] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:49.706773 26572 ts_tablet_manager.cc:1403] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.003s
I20260709 12:13:49.706887 26574 ts_tablet_manager.cc:1403] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 12:13:49.708808 26573 tablet_bootstrap.cc:492] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:49.709280 26573 ts_tablet_manager.cc:1403] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.000s
I20260709 12:13:49.709990 26574 raft_consensus.cc:359] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.710250 26572 raft_consensus.cc:359] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.711037 26574 raft_consensus.cc:385] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.711136 26572 raft_consensus.cc:385] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.711418 26574 raft_consensus.cc:740] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.711556 26572 raft_consensus.cc:740] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.711822 26573 raft_consensus.cc:359] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.712549 26573 raft_consensus.cc:385] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.712963 26573 raft_consensus.cc:740] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.712314 26574 consensus_queue.cc:260] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.712314 26572 consensus_queue.cc:260] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.713764 26573 consensus_queue.cc:260] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.715058 26572 ts_tablet_manager.cc:1434] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:49.715101 26574 ts_tablet_manager.cc:1434] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:49.716413 26572 tablet_bootstrap.cc:492] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:49.716441 26574 tablet_bootstrap.cc:492] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:49.716470 26573 ts_tablet_manager.cc:1434] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:49.722579 26573 tablet_bootstrap.cc:492] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:49.723263 26572 tablet_bootstrap.cc:654] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.723809 26574 tablet_bootstrap.cc:654] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.735455 26574 tablet_bootstrap.cc:492] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:49.735921 26572 tablet_bootstrap.cc:492] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:49.735981 26574 ts_tablet_manager.cc:1403] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:13:49.736682 26572 ts_tablet_manager.cc:1403] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 12:13:49.739478 26574 raft_consensus.cc:359] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.740321 26574 raft_consensus.cc:385] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.740612 26574 raft_consensus.cc:740] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.741207 26574 consensus_queue.cc:260] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.743047 26574 ts_tablet_manager.cc:1434] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:49.739928 26572 raft_consensus.cc:359] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.743434 26572 raft_consensus.cc:385] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.743752 26572 raft_consensus.cc:740] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.744568 26572 consensus_queue.cc:260] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.747040 26572 ts_tablet_manager.cc:1434] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:49.748240 26574 tablet_bootstrap.cc:492] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45: Bootstrap starting.
I20260709 12:13:49.753021 26573 tablet_bootstrap.cc:654] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.758415 26574 tablet_bootstrap.cc:654] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.749037 26572 tablet_bootstrap.cc:492] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:49.764902 26573 tablet_bootstrap.cc:492] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:49.765270 26578 raft_consensus.cc:493] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.765201 26560 raft_consensus.cc:493] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.765620 26573 ts_tablet_manager.cc:1403] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.000s
I20260709 12:13:49.766217 26560 raft_consensus.cc:515] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.768633 26572 tablet_bootstrap.cc:654] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.769423 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:49.769716 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:49.770500 26423 raft_consensus.cc:2468] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 0.
W20260709 12:13:49.771442 26239 leader_election.cc:343] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.771955 26556 raft_consensus.cc:493] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.772528 26556 raft_consensus.cc:515] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.775256 26574 tablet_bootstrap.cc:492] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45: No bootstrap required, opened a new log
I20260709 12:13:49.775842 26574 ts_tablet_manager.cc:1403] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.007s
I20260709 12:13:49.776489 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fa6e4a38ec4f46b59e408868e1c6f0" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
W20260709 12:13:49.778337 26391 leader_election.cc:343] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.778791 26242 leader_election.cc:304] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 8ec323776dd74df884d1a2895190de08
I20260709 12:13:49.779213 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fa6e4a38ec4f46b59e408868e1c6f0" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:49.778973 26574 raft_consensus.cc:359] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.779903 26574 raft_consensus.cc:385] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.780193 26574 raft_consensus.cc:740] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.779620 26578 raft_consensus.cc:515] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.780594 26572 tablet_bootstrap.cc:492] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
W20260709 12:13:49.780804 26388 leader_election.cc:343] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.772297 26573 raft_consensus.cc:359] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.781471 26572 ts_tablet_manager.cc:1403] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.005s
I20260709 12:13:49.781618 26573 raft_consensus.cc:385] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.781560 26388 leader_election.cc:304] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:49.780920 26574 consensus_queue.cc:260] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.782235 26573 raft_consensus.cc:740] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.783928 26578 leader_election.cc:290] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:49.784580 26573 consensus_queue.cc:260] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.785189 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:49.784945 26572 raft_consensus.cc:359] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.785787 26572 raft_consensus.cc:385] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.785907 26273 raft_consensus.cc:2468] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:49.786139 26572 raft_consensus.cc:740] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.786922 26572 consensus_queue.cc:260] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.787305 26391 leader_election.cc:304] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:49.787623 26573 ts_tablet_manager.cc:1434] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:13:49.788472 26556 leader_election.cc:290] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:49.788851 26573 tablet_bootstrap.cc:492] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:49.789254 26556 raft_consensus.cc:2804] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.789721 26556 raft_consensus.cc:493] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.784554 26578 raft_consensus.cc:2749] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.790841 26556 raft_consensus.cc:3060] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.793570 26601 raft_consensus.cc:2804] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.794055 26601 raft_consensus.cc:493] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.794396 26601 raft_consensus.cc:3060] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.796378 26573 tablet_bootstrap.cc:654] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.799865 26574 ts_tablet_manager.cc:1434] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:13:49.800101 26560 leader_election.cc:290] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:49.803866 26572 ts_tablet_manager.cc:1434] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:13:49.805111 26572 tablet_bootstrap.cc:492] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:49.811931 26572 tablet_bootstrap.cc:654] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.815263 26601 raft_consensus.cc:515] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.816390 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:49.817540 26601 leader_election.cc:290] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
W20260709 12:13:49.818198 26388 leader_election.cc:343] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.818388 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
W20260709 12:13:49.819993 26239 leader_election.cc:343] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.821784 26573 tablet_bootstrap.cc:492] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:49.822372 26573 ts_tablet_manager.cc:1403] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.014s
I20260709 12:13:49.823472 26572 tablet_bootstrap.cc:492] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
W20260709 12:13:49.823727 26242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:42609, user_credentials={real_user=slave}} blocked reactor thread for 45043.3us
I20260709 12:13:49.824044 26572 ts_tablet_manager.cc:1403] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 12:13:49.825637 26573 raft_consensus.cc:359] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.826444 26573 raft_consensus.cc:385] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.826741 26573 raft_consensus.cc:740] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.826951 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:49.827082 26572 raft_consensus.cc:359] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.827818 26572 raft_consensus.cc:385] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.827494 26573 consensus_queue.cc:260] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.828158 26572 raft_consensus.cc:740] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.827957 26556 raft_consensus.cc:515] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.829353 26573 ts_tablet_manager.cc:1434] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:13:49.829049 26572 consensus_queue.cc:260] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.827684 26423 raft_consensus.cc:3060] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.830751 26573 tablet_bootstrap.cc:492] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:49.831336 26572 ts_tablet_manager.cc:1434] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:49.832393 26572 tablet_bootstrap.cc:492] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b: Bootstrap starting.
I20260709 12:13:49.837628 26573 tablet_bootstrap.cc:654] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.838255 26572 tablet_bootstrap.cc:654] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.845749 26586 raft_consensus.cc:493] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.846398 26586 raft_consensus.cc:515] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.848712 26586 leader_election.cc:290] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:49.849282 26586 raft_consensus.cc:493] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.849867 26572 tablet_bootstrap.cc:492] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b: No bootstrap required, opened a new log
I20260709 12:13:49.850560 26572 ts_tablet_manager.cc:1403] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 12:13:49.851277 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:49.852257 26556 leader_election.cc:290] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:49.853518 26572 raft_consensus.cc:359] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.853997 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:49.854403 26572 raft_consensus.cc:385] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.854739 26572 raft_consensus.cc:740] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.855499 26572 consensus_queue.cc:260] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.856952 26273 raft_consensus.cc:3060] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.849711 26586 raft_consensus.cc:515] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.864375 26586 leader_election.cc:290] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:49.864933 26351 raft_consensus.cc:3060] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.875562 26586 raft_consensus.cc:493] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.876125 26586 raft_consensus.cc:515] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.877040 26351 raft_consensus.cc:2468] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:49.880260 26572 ts_tablet_manager.cc:1434] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:13:49.883909 26388 leader_election.cc:304] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:49.885124 26556 raft_consensus.cc:2804] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.885774 26556 raft_consensus.cc:697] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:49.886363 26586 leader_election.cc:290] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:49.888687 26423 raft_consensus.cc:2468] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 1.
I20260709 12:13:49.887166 26556 consensus_queue.cc:237] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.892446 26273 raft_consensus.cc:2468] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:49.894706 26242 leader_election.cc:304] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 8ec323776dd74df884d1a2895190de08
I20260709 12:13:49.895747 26601 raft_consensus.cc:2804] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.896274 26601 raft_consensus.cc:697] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
W20260709 12:13:49.896412 26317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:42609, user_credentials={real_user=slave}} blocked reactor thread for 51580.9us
I20260709 12:13:49.897215 26601 consensus_queue.cc:237] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.898411 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2138be12b42442ebab6b29a5aae37375" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:49.899247 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2138be12b42442ebab6b29a5aae37375" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:49.899518 26276 raft_consensus.cc:2468] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:49.900182 26425 raft_consensus.cc:2468] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:49.902633 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:49.903684 26276 raft_consensus.cc:2393] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ec323776dd74df884d1a2895190de08 in current term 1: Already voted for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in this term.
I20260709 12:13:49.906180 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:49.911660 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09aa9e9fa774018bc66bf87c649b47a" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:49.912473 26276 raft_consensus.cc:2468] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:49.911660 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09aa9e9fa774018bc66bf87c649b47a" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:49.913378 26425 raft_consensus.cc:2468] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 0.
I20260709 12:13:49.914587 26317 leader_election.cc:304] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:49.915382 26561 raft_consensus.cc:2804] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.915766 26561 raft_consensus.cc:493] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.915803 26317 leader_election.cc:304] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:49.916152 26561 raft_consensus.cc:3060] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.917086 26606 raft_consensus.cc:2804] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.917495 26606 raft_consensus.cc:493] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.917539 26173 catalog_manager.cc:5697] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 0 to 1, leader changed from <none> to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 1 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.918884 26317 leader_election.cc:304] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ec323776dd74df884d1a2895190de08; no voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:49.917807 26606 raft_consensus.cc:3060] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.924965 26561 raft_consensus.cc:515] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.926316 26586 raft_consensus.cc:2749] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.927712 26561 leader_election.cc:290] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:49.930368 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2138be12b42442ebab6b29a5aae37375" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:49.930368 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2138be12b42442ebab6b29a5aae37375" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:49.931346 26423 raft_consensus.cc:3060] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.931421 26273 raft_consensus.cc:3060] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.937039 26170 catalog_manager.cc:5697] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 0 to 1, leader changed from <none> to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.941102 26573 tablet_bootstrap.cc:492] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:49.941118 26423 raft_consensus.cc:2468] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:49.941923 26573 ts_tablet_manager.cc:1403] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.111s	user 0.042s	sys 0.067s
I20260709 12:13:49.942675 26317 leader_election.cc:304] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:49.943748 26586 raft_consensus.cc:2804] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.944311 26586 raft_consensus.cc:697] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:49.944864 26273 raft_consensus.cc:2468] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:49.945223 26586 consensus_queue.cc:237] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.945569 26573 raft_consensus.cc:359] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.943506 26606 raft_consensus.cc:515] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.946573 26573 raft_consensus.cc:385] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.946929 26573 raft_consensus.cc:740] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.947700 26573 consensus_queue.cc:260] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.948640 26606 leader_election.cc:290] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:49.950133 26573 ts_tablet_manager.cc:1434] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:49.951409 26573 tablet_bootstrap.cc:492] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:49.951568 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09aa9e9fa774018bc66bf87c649b47a" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:49.952490 26273 raft_consensus.cc:3060] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.954176 26556 raft_consensus.cc:493] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.954802 26556 raft_consensus.cc:515] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.955142 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09aa9e9fa774018bc66bf87c649b47a" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:49.956089 26423 raft_consensus.cc:3060] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.958910 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7539c0db9a44b819f5583103196413b" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:49.960258 26276 raft_consensus.cc:2468] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:49.961155 26573 tablet_bootstrap.cc:654] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.961678 26391 leader_election.cc:304] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:49.962679 26578 raft_consensus.cc:2804] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.963030 26578 raft_consensus.cc:493] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.963351 26578 raft_consensus.cc:3060] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.964458 26556 leader_election.cc:290] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:49.959600 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7539c0db9a44b819f5583103196413b" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:49.966559 26351 raft_consensus.cc:2468] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:49.967706 26273 raft_consensus.cc:2468] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:49.971444 26171 catalog_manager.cc:5697] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.972807 26573 tablet_bootstrap.cc:492] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:49.973946 26578 raft_consensus.cc:515] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.975003 26573 ts_tablet_manager.cc:1403] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 12:13:49.977596 26317 leader_election.cc:304] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:49.977764 26601 raft_consensus.cc:493] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.978137 26573 raft_consensus.cc:359] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.974184 26423 raft_consensus.cc:2468] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 1.
I20260709 12:13:49.980070 26573 raft_consensus.cc:385] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.980508 26573 raft_consensus.cc:740] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.979398 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7539c0db9a44b819f5583103196413b" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:49.981385 26276 raft_consensus.cc:3060] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.981307 26573 consensus_queue.cc:260] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.980052 26601 raft_consensus.cc:515] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.983541 26573 ts_tablet_manager.cc:1434] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:49.984309 26601 leader_election.cc:290] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:49.984483 26573 tablet_bootstrap.cc:492] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08: Bootstrap starting.
I20260709 12:13:49.984954 26606 raft_consensus.cc:2804] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.985509 26606 raft_consensus.cc:697] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:49.986361 26606 consensus_queue.cc:237] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.987350 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:49.988014 26351 raft_consensus.cc:2468] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 0.
I20260709 12:13:49.989349 26239 leader_election.cc:304] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:49.990394 26556 raft_consensus.cc:493] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.990518 26601 raft_consensus.cc:2804] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.991153 26601 raft_consensus.cc:493] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.991658 26601 raft_consensus.cc:3060] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.993203 26573 tablet_bootstrap.cc:654] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.991104 26556 raft_consensus.cc:515] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:49.994768 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:49.995481 26423 raft_consensus.cc:2468] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 0.
I20260709 12:13:49.998538 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:49.999192 26351 raft_consensus.cc:2468] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:50.000627 26388 leader_election.cc:304] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:50.001672 26599 raft_consensus.cc:2804] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.002079 26599 raft_consensus.cc:493] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.000730 26556 leader_election.cc:290] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:50.002436 26599 raft_consensus.cc:3060] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.000459 26578 leader_election.cc:290] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:50.005846 26573 tablet_bootstrap.cc:492] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08: No bootstrap required, opened a new log
I20260709 12:13:50.006417 26573 ts_tablet_manager.cc:1403] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 12:13:50.006574 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7539c0db9a44b819f5583103196413b" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.007203 26351 raft_consensus.cc:3060] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.007381 26601 raft_consensus.cc:515] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.009307 26573 raft_consensus.cc:359] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.009696 26601 leader_election.cc:290] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.010090 26573 raft_consensus.cc:385] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.010546 26573 raft_consensus.cc:740] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.010972 26586 raft_consensus.cc:493] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.011123 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:50.011334 26573 consensus_queue.cc:260] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.010707 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.012245 26349 raft_consensus.cc:3060] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.013597 26573 ts_tablet_manager.cc:1434] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:50.018502 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:50.021224 26276 raft_consensus.cc:2468] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:50.019326 26273 raft_consensus.cc:2393] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cac7b74a5a1941ac84b6e16cc57e9b45 in current term 1: Already voted for candidate f56f48f4cb954f69bbbe89790ff0184b in this term.
I20260709 12:13:50.022416 26391 leader_election.cc:304] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.017916 26599 raft_consensus.cc:515] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.023265 26556 raft_consensus.cc:2804] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.025792 26556 raft_consensus.cc:697] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:50.026420 26423 raft_consensus.cc:2393] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f56f48f4cb954f69bbbe89790ff0184b in current term 1: Already voted for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in this term.
I20260709 12:13:50.026715 26556 consensus_queue.cc:237] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.028481 26351 raft_consensus.cc:2468] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:50.011559 26586 raft_consensus.cc:515] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.028944 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:50.029551 26599 leader_election.cc:290] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:50.029798 26276 raft_consensus.cc:2393] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cac7b74a5a1941ac84b6e16cc57e9b45 in current term 1: Already voted for candidate f56f48f4cb954f69bbbe89790ff0184b in this term.
I20260709 12:13:50.030879 26586 leader_election.cc:290] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.032435 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.032662 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:50.033471 26423 raft_consensus.cc:2393] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ec323776dd74df884d1a2895190de08 in current term 1: Already voted for candidate f56f48f4cb954f69bbbe89790ff0184b in this term.
I20260709 12:13:50.033862 26388 leader_election.cc:304] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:50.035138 26578 raft_consensus.cc:2749] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.036055 26349 raft_consensus.cc:2468] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 1.
I20260709 12:13:50.036094 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:50.037515 26239 leader_election.cc:304] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:50.037699 26317 leader_election.cc:304] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ec323776dd74df884d1a2895190de08; no voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:50.038403 26171 catalog_manager.cc:5697] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 1 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.040251 26586 raft_consensus.cc:3060] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.042930 26170 catalog_manager.cc:5697] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 0 to 1, leader changed from <none> to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:50.046890 26586 raft_consensus.cc:2749] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.047801 26601 raft_consensus.cc:2804] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.048391 26601 raft_consensus.cc:697] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:50.049255 26601 consensus_queue.cc:237] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.049732 26556 raft_consensus.cc:493] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.051882 26556 raft_consensus.cc:515] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.055534 26556 leader_election.cc:290] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:50.055810 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:50.056119 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b" is_pre_election: true
I20260709 12:13:50.056614 26349 raft_consensus.cc:2468] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:50.056756 26273 raft_consensus.cc:2468] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 0.
I20260709 12:13:50.057789 26391 leader_election.cc:304] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.058487 26556 raft_consensus.cc:2804] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.058771 26556 raft_consensus.cc:493] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.059084 26556 raft_consensus.cc:3060] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.058800 26170 catalog_manager.cc:5697] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 0 to 1, leader changed from <none> to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 1 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.065891 26556 raft_consensus.cc:515] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.068370 26556 leader_election.cc:290] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:50.068905 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.068980 26273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:50.069512 26349 raft_consensus.cc:3060] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.069615 26273 raft_consensus.cc:3060] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.074937 26273 raft_consensus.cc:2468] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:50.075016 26349 raft_consensus.cc:2468] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 1.
I20260709 12:13:50.076093 26391 leader_election.cc:304] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.076803 26556 raft_consensus.cc:2804] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.077162 26556 raft_consensus.cc:697] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:50.077900 26556 consensus_queue.cc:237] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.085691 26170 catalog_manager.cc:5697] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 0 to 1, leader changed from <none> to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 1 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:50.153939 26601 raft_consensus.cc:493] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.154532 26601 raft_consensus.cc:515] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.156307 26601 leader_election.cc:290] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.157177 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5f5ecc981c4e8abc8278ed952d45a7" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:50.157384 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5f5ecc981c4e8abc8278ed952d45a7" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:50.157932 26349 raft_consensus.cc:2468] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 0.
I20260709 12:13:50.157979 26423 raft_consensus.cc:2468] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 0.
I20260709 12:13:50.159191 26242 leader_election.cc:304] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.159878 26601 raft_consensus.cc:2804] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.160267 26601 raft_consensus.cc:493] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.160535 26601 raft_consensus.cc:3060] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.166388 26601 raft_consensus.cc:515] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.168031 26601 leader_election.cc:290] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.168979 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5f5ecc981c4e8abc8278ed952d45a7" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.169142 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5f5ecc981c4e8abc8278ed952d45a7" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:50.169603 26349 raft_consensus.cc:3060] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.169662 26423 raft_consensus.cc:3060] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.175515 26423 raft_consensus.cc:2468] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 1.
I20260709 12:13:50.175631 26349 raft_consensus.cc:2468] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 1.
I20260709 12:13:50.176676 26242 leader_election.cc:304] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.177415 26601 raft_consensus.cc:2804] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.177888 26601 raft_consensus.cc:697] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:50.178829 26601 consensus_queue.cc:237] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.186831 26170 catalog_manager.cc:5697] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 0 to 1, leader changed from <none> to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 1 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.257593 26601 raft_consensus.cc:493] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.258150 26601 raft_consensus.cc:515] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.259915 26601 leader_election.cc:290] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.260728 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fa6e4a38ec4f46b59e408868e1c6f0" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08" is_pre_election: true
I20260709 12:13:50.261034 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fa6e4a38ec4f46b59e408868e1c6f0" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" is_pre_election: true
I20260709 12:13:50.261512 26349 raft_consensus.cc:2468] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 0.
I20260709 12:13:50.261648 26423 raft_consensus.cc:2468] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 0.
I20260709 12:13:50.262677 26239 leader_election.cc:304] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.263355 26601 raft_consensus.cc:2804] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.263737 26601 raft_consensus.cc:493] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.263971 26601 raft_consensus.cc:3060] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.269320 26601 raft_consensus.cc:515] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.271200 26601 leader_election.cc:290] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.272022 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fa6e4a38ec4f46b59e408868e1c6f0" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.272662 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fa6e4a38ec4f46b59e408868e1c6f0" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:50.272668 26349 raft_consensus.cc:3060] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.273219 26423 raft_consensus.cc:3060] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.278610 26349 raft_consensus.cc:2468] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 1.
I20260709 12:13:50.278834 26423 raft_consensus.cc:2468] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 1.
I20260709 12:13:50.279852 26242 leader_election.cc:304] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.280642 26601 raft_consensus.cc:2804] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.281008 26601 raft_consensus.cc:697] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:50.281760 26601 consensus_queue.cc:237] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.288939 26170 catalog_manager.cc:5697] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 0 to 1, leader changed from <none> to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 1 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.302596 26556 consensus_queue.cc:1048] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.322463 26578 consensus_queue.cc:1048] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.355001 26601 consensus_queue.cc:1048] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.367012 26601 consensus_queue.cc:1048] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.367990 26586 consensus_queue.cc:1048] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:50.384677 26586 consensus_queue.cc:1048] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.453366 26598 consensus_queue.cc:1048] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.464098 26601 consensus_queue.cc:1048] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:50.480728 26599 consensus_queue.cc:1048] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.491959 26578 consensus_queue.cc:1048] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.515269 26423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
mode: GRACEFUL
new_leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:13:50.515790 26423 raft_consensus.cc:606] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Received request to transfer leadership to TS f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:50.521023 26423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7539c0db9a44b819f5583103196413b"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
mode: GRACEFUL
new_leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:13:50.521512 26423 raft_consensus.cc:606] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Received request to transfer leadership to TS f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:50.526674 26349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d09aa9e9fa774018bc66bf87c649b47a"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
mode: GRACEFUL
new_leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:34924
I20260709 12:13:50.527171 26349 raft_consensus.cc:606] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Received request to transfer leadership to TS f56f48f4cb954f69bbbe89790ff0184b
I20260709 12:13:50.532738 26423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
mode: GRACEFUL
new_leader_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:13:50.533264 26423 raft_consensus.cc:606] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Received request to transfer leadership to TS 8ec323776dd74df884d1a2895190de08
I20260709 12:13:50.547665 26273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
mode: GRACEFUL
new_leader_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:46250
I20260709 12:13:50.548295 26273 raft_consensus.cc:606] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Received request to transfer leadership to TS 8ec323776dd74df884d1a2895190de08
I20260709 12:13:50.550308 26586 consensus_queue.cc:1048] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.557298 26273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
mode: GRACEFUL
new_leader_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:46250
I20260709 12:13:50.557958 26273 raft_consensus.cc:606] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Received request to transfer leadership to TS 8ec323776dd74df884d1a2895190de08
I20260709 12:13:50.563287 26606 consensus_queue.cc:1048] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.565958 26276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e5f5ecc981c4e8abc8278ed952d45a7"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
mode: GRACEFUL
new_leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:46250
I20260709 12:13:50.569990 26276 raft_consensus.cc:606] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Received request to transfer leadership to TS cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:50.573571 26578 consensus_queue.cc:1048] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:50.574709 26600 consensus_queue.cc:1048] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.591557 26606 raft_consensus.cc:993] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08: : Instructing follower f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:50.592047 26606 raft_consensus.cc:1081] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Signalling peer f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:50.594779 26273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d09aa9e9fa774018bc66bf87c649b47a"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:57662
I20260709 12:13:50.595481 26273 raft_consensus.cc:493] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:50.595935 26273 raft_consensus.cc:3060] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.600656 26599 raft_consensus.cc:993] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45: : Instructing follower f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:50.601225 26599 raft_consensus.cc:1081] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Signalling peer f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:50.603709 26275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7539c0db9a44b819f5583103196413b"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:57668
I20260709 12:13:50.604280 26273 raft_consensus.cc:515] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.604383 26275 raft_consensus.cc:493] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:50.606547 26275 raft_consensus.cc:3060] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.607649 26273 leader_election.cc:290] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.607882 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09aa9e9fa774018bc66bf87c649b47a" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:50.608480 26423 raft_consensus.cc:3060] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.610020 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09aa9e9fa774018bc66bf87c649b47a" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.610718 26349 raft_consensus.cc:3055] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.611006 26349 raft_consensus.cc:740] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:50.611649 26349 consensus_queue.cc:260] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.612604 26349 raft_consensus.cc:3060] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.613425 26275 raft_consensus.cc:515] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.614357 26276 raft_consensus.cc:1240] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Rejecting Update request from peer cac7b74a5a1941ac84b6e16cc57e9b45 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:50.616338 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7539c0db9a44b819f5583103196413b" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.617100 26351 raft_consensus.cc:3060] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.619679 26349 raft_consensus.cc:2468] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:50.620675 26423 raft_consensus.cc:2468] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:50.621505 26275 leader_election.cc:290] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.621408 26239 leader_election.cc:304] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.622982 26601 raft_consensus.cc:2804] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:50.623247 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7539c0db9a44b819f5583103196413b" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:50.623461 26601 raft_consensus.cc:697] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:50.623983 26351 raft_consensus.cc:2468] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:50.621594 26578 consensus_queue.cc:1059] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:50.625097 26239 leader_election.cc:304] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.625916 26598 raft_consensus.cc:2804] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:50.625761 26628 consensus_queue.cc:1048] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:50.624289 26601 consensus_queue.cc:237] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.626531 26425 raft_consensus.cc:3055] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.626962 26425 raft_consensus.cc:740] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:50.627848 26425 consensus_queue.cc:260] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.629204 26425 raft_consensus.cc:3060] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.635219 26173 catalog_manager.cc:5697] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 1 to 2, leader changed from 8ec323776dd74df884d1a2895190de08 (127.15.191.66) to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 2 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.637256 26425 raft_consensus.cc:2468] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
W20260709 12:13:50.637851 26578 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:13:50.646320 26598 raft_consensus.cc:697] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:50.647347 26598 consensus_queue.cc:237] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.655102 26643 raft_consensus.cc:993] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b: : Instructing follower cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:50.655659 26601 raft_consensus.cc:1081] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Signalling peer cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:50.659701 26170 catalog_manager.cc:5697] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 1 to 2, leader changed from cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67) to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 2 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.662400 26425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e5f5ecc981c4e8abc8278ed952d45a7"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:52012
I20260709 12:13:50.663138 26425 raft_consensus.cc:493] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:50.663514 26425 raft_consensus.cc:3060] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.668402 26643 consensus_queue.cc:1048] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.670081 26425 raft_consensus.cc:515] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.672855 26425 leader_election.cc:290] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 2 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:50.673158 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5f5ecc981c4e8abc8278ed952d45a7" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:50.673877 26275 raft_consensus.cc:3055] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.674256 26275 raft_consensus.cc:740] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:50.673533 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5f5ecc981c4e8abc8278ed952d45a7" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.675123 26275 consensus_queue.cc:260] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.676620 26275 raft_consensus.cc:3060] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.683821 26275 raft_consensus.cc:2468] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 2.
I20260709 12:13:50.684863 26391 leader_election.cc:304] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 8ec323776dd74df884d1a2895190de08
I20260709 12:13:50.685634 26578 raft_consensus.cc:2804] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:50.686062 26578 raft_consensus.cc:697] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:50.686829 26578 consensus_queue.cc:237] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.693720 26173 catalog_manager.cc:5697] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 1 to 2, leader changed from f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65) to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:50.769851 26643 consensus_queue.cc:1048] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.780913 26601 consensus_queue.cc:1048] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.807097 26578 raft_consensus.cc:993] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45: : Instructing follower f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:50.807591 26578 raft_consensus.cc:1081] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Signalling peer f56f48f4cb954f69bbbe89790ff0184b to start an election
I20260709 12:13:50.809180 26275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
 from {username='slave'} at 127.0.0.1:57668
I20260709 12:13:50.809626 26275 raft_consensus.cc:493] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:50.809895 26275 raft_consensus.cc:3060] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.814685 26275 raft_consensus.cc:515] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.816223 26275 leader_election.cc:290] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.817054 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:50.817250 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e89e04666ec42b1b7252fe5dac4edbe" candidate_uuid: "f56f48f4cb954f69bbbe89790ff0184b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:50.817652 26349 raft_consensus.cc:3060] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.817795 26425 raft_consensus.cc:3055] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.818166 26425 raft_consensus.cc:740] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:50.818804 26425 consensus_queue.cc:260] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.819700 26425 raft_consensus.cc:3060] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.823032 26349 raft_consensus.cc:2468] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:50.824229 26239 leader_election.cc:304] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.824487 26425 raft_consensus.cc:2468] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f56f48f4cb954f69bbbe89790ff0184b in term 2.
I20260709 12:13:50.824934 26601 raft_consensus.cc:2804] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:50.825440 26601 raft_consensus.cc:697] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Becoming Leader. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:50.826263 26601 consensus_queue.cc:237] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.832906 26173 catalog_manager.cc:5697] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b reported cstate change: term changed from 1 to 2, leader changed from cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67) to f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65). New cstate: current_term: 2 leader_uuid: "f56f48f4cb954f69bbbe89790ff0184b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.964435 26599 raft_consensus.cc:993] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45: : Instructing follower 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:50.964871 26578 raft_consensus.cc:1081] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Signalling peer 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:50.966337 26349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:34918
I20260709 12:13:50.966815 26349 raft_consensus.cc:493] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:50.967090 26349 raft_consensus.cc:3060] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.972770 26601 raft_consensus.cc:993] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b: : Instructing follower 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:50.973346 26598 raft_consensus.cc:1081] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Signalling peer 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:50.974282 26349 raft_consensus.cc:515] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.975186 26351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:34920
I20260709 12:13:50.975811 26351 raft_consensus.cc:493] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:50.976151 26351 raft_consensus.cc:3060] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.977037 26349 leader_election.cc:290] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.977116 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:50.977873 26275 raft_consensus.cc:3060] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.978193 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ea3cb7262b48a3baf6527cd8567af9" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:50.978655 26423 raft_consensus.cc:3055] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.978842 26423 raft_consensus.cc:740] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:50.979377 26423 consensus_queue.cc:260] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.980095 26423 raft_consensus.cc:3060] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.983357 26351 raft_consensus.cc:515] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.984911 26275 raft_consensus.cc:2468] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:50.985535 26351 leader_election.cc:290] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:50.986407 26317 leader_election.cc:304] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:50.986598 26425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:50.986796 26423 raft_consensus.cc:2468] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:50.987222 26425 raft_consensus.cc:3060] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.987344 26606 raft_consensus.cc:2804] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:50.986613 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:50.987991 26606 raft_consensus.cc:697] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:50.988117 26275 raft_consensus.cc:3055] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.988492 26275 raft_consensus.cc:740] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:50.989076 26275 consensus_queue.cc:260] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.988862 26606 consensus_queue.cc:237] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.989977 26275 raft_consensus.cc:3060] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.994757 26425 raft_consensus.cc:2468] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:50.995539 26275 raft_consensus.cc:2468] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:50.995929 26317 leader_election.cc:304] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:50.996815 26606 raft_consensus.cc:2804] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:50.997257 26606 raft_consensus.cc:697] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:50.997911 26606 consensus_queue.cc:237] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:50.998243 26173 catalog_manager.cc:5697] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 1 to 2, leader changed from cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67) to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.010640 26173 catalog_manager.cc:5697] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 1 to 2, leader changed from f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65) to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.076910 26351 raft_consensus.cc:1275] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.078246 26598 consensus_queue.cc:1048] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.085644 26425 raft_consensus.cc:1275] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.087113 26598 consensus_queue.cc:1048] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.096539 26598 raft_consensus.cc:993] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b: : Instructing follower 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:51.097426 26598 raft_consensus.cc:1081] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Signalling peer 8ec323776dd74df884d1a2895190de08 to start an election
I20260709 12:13:51.099373 26351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
 from {username='slave'} at 127.0.0.1:34920
I20260709 12:13:51.099901 26351 raft_consensus.cc:493] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:51.100261 26351 raft_consensus.cc:3060] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.106369 26351 raft_consensus.cc:515] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:51.108119 26351 leader_election.cc:290] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609)
I20260709 12:13:51.108903 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:51.109207 26423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbe92014c1a4656a6b43c352a205a86" candidate_uuid: "8ec323776dd74df884d1a2895190de08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
I20260709 12:13:51.109658 26275 raft_consensus.cc:3055] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:51.109871 26423 raft_consensus.cc:3060] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.110015 26275 raft_consensus.cc:740] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:51.110958 26275 consensus_queue.cc:260] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:51.112040 26275 raft_consensus.cc:3060] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.115077 26423 raft_consensus.cc:2468] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:51.116115 26317 leader_election.cc:304] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:51.116791 26606 raft_consensus.cc:2804] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:51.116786 26275 raft_consensus.cc:2468] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ec323776dd74df884d1a2895190de08 in term 2.
I20260709 12:13:51.117267 26606 raft_consensus.cc:697] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Becoming Leader. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:51.118019 26606 consensus_queue.cc:237] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:51.121428 26423 raft_consensus.cc:1275] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.122825 26598 consensus_queue.cc:1048] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.125689 26171 catalog_manager.cc:5697] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 reported cstate change: term changed from 1 to 2, leader changed from f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65) to 8ec323776dd74df884d1a2895190de08 (127.15.191.66). New cstate: current_term: 2 leader_uuid: "8ec323776dd74df884d1a2895190de08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.133153 26351 raft_consensus.cc:1275] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.134756 26628 consensus_queue.cc:1048] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.143519 26349 raft_consensus.cc:3060] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.151932 26349 raft_consensus.cc:1275] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.153414 26578 consensus_queue.cc:1048] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.164191 26275 raft_consensus.cc:1275] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.165547 26600 consensus_queue.cc:1048] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:51.317328 26349 raft_consensus.cc:1275] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.319494 26601 consensus_queue.cc:1048] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:51.331408 26425 raft_consensus.cc:1275] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer f56f48f4cb954f69bbbe89790ff0184b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.336099 26598 consensus_queue.cc:1048] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:51.399540 26423 raft_consensus.cc:1275] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.400930 26586 consensus_queue.cc:1048] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.411799 26275 raft_consensus.cc:1275] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.417400 26606 consensus_queue.cc:1048] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:51.526983 26275 raft_consensus.cc:1275] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.528285 26586 consensus_queue.cc:1048] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.541431 26423 raft_consensus.cc:1275] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.542840 26586 consensus_queue.cc:1048] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.559065 26275 raft_consensus.cc:1275] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.560449 26586 consensus_queue.cc:1048] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.571283 26423 raft_consensus.cc:1275] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Refusing update from remote peer 8ec323776dd74df884d1a2895190de08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.572645 26586 consensus_queue.cc:1048] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:53.574156 26173 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51698:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:13:53.598613 26173 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51698:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:13:53.674762 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:53.771739 26701 tablet.cc:1724] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:53.802042 26705 tablet.cc:1724] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:53.747071 26699 tablet.cc:1724] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:53.808243 26706 tablet.cc:1724] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:53.842303 26704 tablet.cc:1724] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:53.845759 26712 tablet.cc:1724] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:53.845597 26714 tablet.cc:1724] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:13:53.886579 26302 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:2138be12b42442ebab6b29a5aae37375)
I20260709 12:13:53.887101 26273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7539c0db9a44b819f5583103196413b"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
mode: GRACEFUL
new_leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:46256
I20260709 12:13:53.887976 26273 raft_consensus.cc:606] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Received request to transfer leadership to TS cac7b74a5a1941ac84b6e16cc57e9b45
W20260709 12:13:53.901067 26302 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:2138be12b42442ebab6b29a5aae37375)
W20260709 12:13:53.901970 26302 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:2138be12b42442ebab6b29a5aae37375)
I20260709 12:13:53.920295 26725 tablet.cc:1724] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:53.892233 26701 tablet.cc:1724] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:53.932821 26714 tablet.cc:1724] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:13:53.925453 26317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:42609, user_credentials={real_user=slave}} blocked reactor thread for 70820.5us
I20260709 12:13:53.991349 26702 raft_consensus.cc:993] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b: : Instructing follower cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:53.991984 26702 raft_consensus.cc:1081] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Signalling peer cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:53.997821 26706 tablet.cc:1724] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.000423 26421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7539c0db9a44b819f5583103196413b"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:52012
I20260709 12:13:54.001214 26421 raft_consensus.cc:493] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:54.001667 26421 raft_consensus.cc:3060] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.008209 26704 tablet.cc:1724] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.015096 26421 raft_consensus.cc:515] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:54.016494 26422 raft_consensus.cc:1240] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Rejecting Update request from peer f56f48f4cb954f69bbbe89790ff0184b for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:54.021004 26726 tablet.cc:1724] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.025712 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7539c0db9a44b819f5583103196413b" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:54.026580 26275 raft_consensus.cc:3055] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.026916 26275 raft_consensus.cc:740] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:54.028044 26275 consensus_queue.cc:260] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:54.029057 26275 raft_consensus.cc:3060] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.034631 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7539c0db9a44b819f5583103196413b" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:54.039454 26421 leader_election.cc:290] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 3 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:54.043291 26726 tablet.cc:1724] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.006440 26724 tablet.cc:1724] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.050081 26727 tablet.cc:1724] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:53.986465 26701 tablet.cc:1724] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.057957 26704 tablet.cc:1724] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.060123 26712 tablet.cc:1724] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.065106 26275 raft_consensus.cc:2468] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 3.
I20260709 12:13:54.072484 26391 leader_election.cc:304] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 8ec323776dd74df884d1a2895190de08
I20260709 12:13:54.074571 26706 tablet.cc:1724] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.088258 26731 raft_consensus.cc:2804] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.088939 26731 raft_consensus.cc:697] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:54.094715 26724 tablet.cc:1724] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.098338 26725 tablet.cc:1724] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.099838 26721 tablet.cc:1724] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.097177 26726 tablet.cc:1724] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.096436 26699 tablet.cc:1724] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.089902 26731 consensus_queue.cc:237] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:54.125617 26171 catalog_manager.cc:5697] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 2 to 3, leader changed from f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65) to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 3 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:54.127620 26171 catalog_manager.cc:5789] TS cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67:42609) does not have the latest schema for tablet e7539c0db9a44b819f5583103196413b (table soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]). Expected version 1 got 0
I20260709 12:13:54.141997 26348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
mode: GRACEFUL
new_leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:36700
I20260709 12:13:54.142850 26348 raft_consensus.cc:606] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Received request to transfer leadership to TS cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:54.144541 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:13:54.145282 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:54.147920 26173 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24: soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53] alter complete (version 1)
I20260709 12:13:54.173091 26275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8"
dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
mode: GRACEFUL
new_leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:46256
I20260709 12:13:54.173656 26275 raft_consensus.cc:606] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Received request to transfer leadership to TS cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:54.176378 26348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b58abe74b412410aa73902953bd99aac"
dest_uuid: "8ec323776dd74df884d1a2895190de08"
mode: GRACEFUL
new_leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:36700
I20260709 12:13:54.176903 26348 raft_consensus.cc:606] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Received request to transfer leadership to TS cac7b74a5a1941ac84b6e16cc57e9b45
I20260709 12:13:54.178225 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:54.178742 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:54.424633 26639 raft_consensus.cc:993] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08: : Instructing follower cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:54.425444 26722 raft_consensus.cc:1081] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Signalling peer cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:54.427279 26425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:52008
I20260709 12:13:54.427852 26425 raft_consensus.cc:493] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:54.428205 26425 raft_consensus.cc:3060] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.435364 26425 raft_consensus.cc:515] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:54.437418 26425 leader_election.cc:290] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 3 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:54.438781 26275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:54.439334 26275 raft_consensus.cc:3060] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.439136 26348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f268d6e6f19d4dc293017ca00c938868" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:54.443099 26348 raft_consensus.cc:3055] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.443451 26348 raft_consensus.cc:740] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:54.444326 26348 consensus_queue.cc:260] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:54.445552 26348 raft_consensus.cc:3060] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.446368 26275 raft_consensus.cc:2468] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 3.
I20260709 12:13:54.447896 26391 leader_election.cc:304] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cac7b74a5a1941ac84b6e16cc57e9b45, f56f48f4cb954f69bbbe89790ff0184b; no voters: 
I20260709 12:13:54.448660 26731 raft_consensus.cc:2804] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.449108 26731 raft_consensus.cc:697] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:54.449998 26731 consensus_queue.cc:237] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:54.454396 26348 raft_consensus.cc:2468] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 3.
I20260709 12:13:54.459719 26174 catalog_manager.cc:5697] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 2 to 3, leader changed from 8ec323776dd74df884d1a2895190de08 (127.15.191.66) to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 3 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:54.666013 26348 raft_consensus.cc:3060] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.666646 26275 raft_consensus.cc:1275] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:54.668111 26715 consensus_queue.cc:1048] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:54.679914 26348 raft_consensus.cc:1275] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:54.681506 26715 consensus_queue.cc:1048] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:54.702131 26738 raft_consensus.cc:993] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b: : Instructing follower cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:54.702734 26738 raft_consensus.cc:1081] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Signalling peer cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:54.705684 26425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:52012
I20260709 12:13:54.706344 26425 raft_consensus.cc:493] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:54.706759 26425 raft_consensus.cc:3060] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.709028 26722 raft_consensus.cc:993] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08: : Instructing follower cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:54.709798 26722 raft_consensus.cc:1081] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Signalling peer cac7b74a5a1941ac84b6e16cc57e9b45 to start an election
I20260709 12:13:54.710052 26739 tablet.cc:1724] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.715232 26421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b58abe74b412410aa73902953bd99aac"
dest_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45"
 from {username='slave'} at 127.0.0.1:52008
I20260709 12:13:54.716686 26421 raft_consensus.cc:493] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:54.717120 26421 raft_consensus.cc:3060] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:54.717635 26743 tablet.cc:1724] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:54.713999 26174 catalog_manager.cc:5789] TS 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321) does not have the latest schema for tablet e7539c0db9a44b819f5583103196413b (table soft_deleted_table [id=ddc7c69e0ccb489d8ccf9280b861fe53]). Expected version 1 got 0
I20260709 12:13:54.729305 26425 raft_consensus.cc:515] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:54.738164 26425 leader_election.cc:290] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 3 election: Requested vote from peers 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321), f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771)
I20260709 12:13:54.738914 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:54.739159 26739 tablet.cc:1719] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:13:54.739599 26351 raft_consensus.cc:3060] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.739789 26276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4179658e9f4cbc96d5e111043540d8" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:54.740381 26276 raft_consensus.cc:3055] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.740695 26276 raft_consensus.cc:740] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f56f48f4cb954f69bbbe89790ff0184b, State: Running, Role: LEADER
I20260709 12:13:54.735796 26421 raft_consensus.cc:515] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:54.743213 26421 leader_election.cc:290] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 2 election: Requested vote from peers f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771), 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321)
I20260709 12:13:54.744405 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58abe74b412410aa73902953bd99aac" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ec323776dd74df884d1a2895190de08"
I20260709 12:13:54.745048 26349 raft_consensus.cc:3055] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:54.745324 26349 raft_consensus.cc:740] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ec323776dd74df884d1a2895190de08, State: Running, Role: LEADER
I20260709 12:13:54.746049 26349 consensus_queue.cc:260] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:54.741627 26276 consensus_queue.cc:260] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:54.747152 26349 raft_consensus.cc:3060] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:54.748303 26276 raft_consensus.cc:3060] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.755252 26351 raft_consensus.cc:2468] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 3.
I20260709 12:13:54.759338 26272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58abe74b412410aa73902953bd99aac" candidate_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f56f48f4cb954f69bbbe89790ff0184b"
I20260709 12:13:54.762449 26272 raft_consensus.cc:3060] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:54.763274 26388 leader_election.cc:304] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:54.764082 26349 raft_consensus.cc:2468] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 2.
I20260709 12:13:54.764281 26715 raft_consensus.cc:2804] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.764822 26715 raft_consensus.cc:697] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:54.757786 26276 raft_consensus.cc:2468] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 3.
I20260709 12:13:54.759347 26745 tablet.cc:1719] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:13:54.765733 26715 consensus_queue.cc:237] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } }
I20260709 12:13:54.767885 26388 leader_election.cc:304] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ec323776dd74df884d1a2895190de08, cac7b74a5a1941ac84b6e16cc57e9b45; no voters: 
I20260709 12:13:54.761349 26743 tablet.cc:1719] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:13:54.768822 26731 raft_consensus.cc:2804] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:54.769344 26731 raft_consensus.cc:697] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 LEADER]: Becoming Leader. State: Replica: cac7b74a5a1941ac84b6e16cc57e9b45, State: Running, Role: LEADER
I20260709 12:13:54.770321 26731 consensus_queue.cc:237] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } }
I20260709 12:13:54.770732 26272 raft_consensus.cc:2468] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cac7b74a5a1941ac84b6e16cc57e9b45 in term 2.
I20260709 12:13:54.777415 26171 catalog_manager.cc:5697] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 2 to 3, leader changed from f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65) to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 3 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.789594 26171 catalog_manager.cc:5697] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 reported cstate change: term changed from 1 to 2, leader changed from 8ec323776dd74df884d1a2895190de08 (127.15.191.66) to cac7b74a5a1941ac84b6e16cc57e9b45 (127.15.191.67). New cstate: current_term: 2 leader_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cac7b74a5a1941ac84b6e16cc57e9b45" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.002087 26349 raft_consensus.cc:1275] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:55.003396 26715 consensus_queue.cc:1048] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.015997 26272 raft_consensus.cc:1275] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:55.019169 26715 consensus_queue.cc:1048] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:55.179742 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:55.186322 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:55.186918 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:55.193409 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:55.193987 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:55.195587 26272 raft_consensus.cc:1275] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:55.196961 26731 consensus_queue.cc:1048] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.206214 26349 raft_consensus.cc:1275] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:55.211257 26715 consensus_queue.cc:1048] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.333451 26272 raft_consensus.cc:1275] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:55.334751 26715 consensus_queue.cc:1048] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f56f48f4cb954f69bbbe89790ff0184b" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:55.344492 26349 raft_consensus.cc:1275] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Refusing update from remote peer cac7b74a5a1941ac84b6e16cc57e9b45: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:55.346583 26731 consensus_queue.cc:1048] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ec323776dd74df884d1a2895190de08" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:56.195159 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:56.200990 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:56.201494 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:56.209614 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:56.210222 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:57.211349 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:57.218282 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:57.218778 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:57.223641 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:57.224151 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:58.225220 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:58.231518 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:58.231920 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:58.236732 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:58.237107 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:59.238217 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:59.243355 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:59.243836 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:59.249298 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:59.249742 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:00.250914 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:00.257004 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:00.257517 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:00.263119 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:00.263573 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:01.264642 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:01.315548 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:01.316705 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:01.325608 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:01.326261 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:02.327919 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:02.334406 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:02.334833 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:02.339562 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:02.340072 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:03.341269 16125 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:03.347446 16125 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:03.348016 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:03.354558 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:03.354983 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:04.418711 16125 tablet_server.cc:179] TabletServer@127.15.191.65:0 shutting down...
I20260709 12:14:04.457643 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:04.459437 16125 tablet_replica.cc:333] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
W20260709 12:14:04.459636 26391 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:04.460445 16125 raft_consensus.cc:2243] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.461731 16125 raft_consensus.cc:2272] T f5ea3cb7262b48a3baf6527cd8567af9 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:04.463697 26391 consensus_peers.cc:597] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 -> Peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Couldn't send request to peer f56f48f4cb954f69bbbe89790ff0184b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:04.465346 26391 consensus_peers.cc:597] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 -> Peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Couldn't send request to peer f56f48f4cb954f69bbbe89790ff0184b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.465924 16125 tablet_replica.cc:333] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.466737 16125 raft_consensus.cc:2243] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.467294 16125 raft_consensus.cc:2272] T 2e5f5ecc981c4e8abc8278ed952d45a7 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.469918 16125 tablet_replica.cc:333] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.470705 16125 raft_consensus.cc:2243] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.471668 16125 raft_consensus.cc:2272] T 9e89e04666ec42b1b7252fe5dac4edbe P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.474273 16125 tablet_replica.cc:333] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.475065 16125 raft_consensus.cc:2243] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.475981 16125 raft_consensus.cc:2272] T d09aa9e9fa774018bc66bf87c649b47a P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.478837 16125 tablet_replica.cc:333] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.479501 16125 raft_consensus.cc:2243] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.480262 16125 raft_consensus.cc:2272] T e7539c0db9a44b819f5583103196413b P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.483208 16125 tablet_replica.cc:333] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.484083 16125 raft_consensus.cc:2243] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.484890 16125 raft_consensus.cc:2272] T 2138be12b42442ebab6b29a5aae37375 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:04.487421 26391 consensus_peers.cc:597] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 -> Peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Couldn't send request to peer f56f48f4cb954f69bbbe89790ff0184b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.488132 16125 tablet_replica.cc:333] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.488956 16125 raft_consensus.cc:2243] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.490151 16125 raft_consensus.cc:2272] T 5fa05f2a66314c89a64728182acf311a P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.492540 16125 tablet_replica.cc:333] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.493116 16125 raft_consensus.cc:2243] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.493722 16125 raft_consensus.cc:2272] T f268d6e6f19d4dc293017ca00c938868 P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.496351 16125 tablet_replica.cc:333] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.496942 16125 raft_consensus.cc:2243] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.497440 16125 raft_consensus.cc:2272] T bd3670397bae4ffebeffd8b52995a3e7 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.500074 16125 tablet_replica.cc:333] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.500849 16125 raft_consensus.cc:2243] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.501375 16125 raft_consensus.cc:2272] T 04e89064748241a2bb501953befa7732 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.503844 16125 tablet_replica.cc:333] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.504443 16125 raft_consensus.cc:2243] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.505419 16125 raft_consensus.cc:2272] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.507916 16125 tablet_replica.cc:333] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.508486 16125 raft_consensus.cc:2243] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.509426 16125 raft_consensus.cc:2272] T 313bca89d2cf4461b91e2f5f87e4040d P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.511833 16125 tablet_replica.cc:333] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.512379 16125 raft_consensus.cc:2243] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.512918 16125 raft_consensus.cc:2272] T 4bbe92014c1a4656a6b43c352a205a86 P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.515681 16125 tablet_replica.cc:333] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.516408 16125 raft_consensus.cc:2243] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.517005 16125 raft_consensus.cc:2272] T b58abe74b412410aa73902953bd99aac P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.519754 16125 tablet_replica.cc:333] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.520335 16125 raft_consensus.cc:2243] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.521257 16125 raft_consensus.cc:2272] T 87fa6e4a38ec4f46b59e408868e1c6f0 P f56f48f4cb954f69bbbe89790ff0184b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.523684 16125 tablet_replica.cc:333] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.524232 16125 raft_consensus.cc:2243] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.524739 16125 raft_consensus.cc:2272] T af5dc33ed33644a0bee606cd2fdfbfbb P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.527249 16125 tablet_replica.cc:333] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.527761 16125 raft_consensus.cc:2243] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.528326 16125 raft_consensus.cc:2272] T d75c4f0adb814b07aa31bcb2e32299ea P f56f48f4cb954f69bbbe89790ff0184b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.530787 16125 tablet_replica.cc:333] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b: stopping tablet replica
I20260709 12:14:04.531277 16125 raft_consensus.cc:2243] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.531798 16125 raft_consensus.cc:2272] T 9a4179658e9f4cbc96d5e111043540d8 P f56f48f4cb954f69bbbe89790ff0184b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:04.538489 26317 consensus_peers.cc:597] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 -> Peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Couldn't send request to peer f56f48f4cb954f69bbbe89790ff0184b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.571236 16125 tablet_server.cc:196] TabletServer@127.15.191.65:0 shutdown complete.
W20260709 12:14:04.595660 26391 consensus_peers.cc:597] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 -> Peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Couldn't send request to peer f56f48f4cb954f69bbbe89790ff0184b. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:32771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.622212 16125 tablet_server.cc:179] TabletServer@127.15.191.66:0 shutting down...
I20260709 12:14:04.650007 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:04.650861 16125 tablet_replica.cc:333] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.651661 16125 raft_consensus.cc:2243] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.652281 16125 raft_consensus.cc:2272] T 2e5f5ecc981c4e8abc8278ed952d45a7 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.654857 16125 tablet_replica.cc:333] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.655514 16125 raft_consensus.cc:2243] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.656047 16125 raft_consensus.cc:2272] T 9e89e04666ec42b1b7252fe5dac4edbe P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.658444 16125 tablet_replica.cc:333] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.659132 16125 raft_consensus.cc:2243] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.660069 16125 raft_consensus.cc:2272] T f5ea3cb7262b48a3baf6527cd8567af9 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.662334 16125 tablet_replica.cc:333] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.662961 16125 raft_consensus.cc:2243] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.663492 16125 raft_consensus.cc:2272] T b58abe74b412410aa73902953bd99aac P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.665781 16125 tablet_replica.cc:333] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.666419 16125 raft_consensus.cc:2243] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.667366 16125 raft_consensus.cc:2272] T bd3670397bae4ffebeffd8b52995a3e7 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.669750 16125 tablet_replica.cc:333] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.670384 16125 raft_consensus.cc:2243] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.671322 16125 raft_consensus.cc:2272] T 04e89064748241a2bb501953befa7732 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.673753 16125 tablet_replica.cc:333] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.674495 16125 raft_consensus.cc:2243] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.675079 16125 raft_consensus.cc:2272] T 87fa6e4a38ec4f46b59e408868e1c6f0 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.677274 16125 tablet_replica.cc:333] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.677820 16125 raft_consensus.cc:2243] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.678690 16125 raft_consensus.cc:2272] T af5dc33ed33644a0bee606cd2fdfbfbb P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.681082 16125 tablet_replica.cc:333] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.681823 16125 raft_consensus.cc:2243] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.682657 16125 raft_consensus.cc:2272] T e7539c0db9a44b819f5583103196413b P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:04.684836 26388 consensus_peers.cc:597] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 -> Peer 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321): Couldn't send request to peer 8ec323776dd74df884d1a2895190de08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.685478 16125 tablet_replica.cc:333] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.686206 16125 raft_consensus.cc:2243] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.686744 16125 raft_consensus.cc:2272] T d09aa9e9fa774018bc66bf87c649b47a P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.689144 16125 tablet_replica.cc:333] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.689733 16125 raft_consensus.cc:2243] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.690702 16125 raft_consensus.cc:2272] T 2138be12b42442ebab6b29a5aae37375 P 8ec323776dd74df884d1a2895190de08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.692962 16125 tablet_replica.cc:333] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.693524 16125 raft_consensus.cc:2243] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.693992 16125 raft_consensus.cc:2272] T d75c4f0adb814b07aa31bcb2e32299ea P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.696405 16125 tablet_replica.cc:333] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.696996 16125 raft_consensus.cc:2243] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.697909 16125 raft_consensus.cc:2272] T 4bbe92014c1a4656a6b43c352a205a86 P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.700184 16125 tablet_replica.cc:333] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.700728 16125 raft_consensus.cc:2243] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.701202 16125 raft_consensus.cc:2272] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.703527 16125 tablet_replica.cc:333] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.704059 16125 raft_consensus.cc:2243] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.704531 16125 raft_consensus.cc:2272] T 313bca89d2cf4461b91e2f5f87e4040d P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.707087 16125 tablet_replica.cc:333] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.707710 16125 raft_consensus.cc:2243] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.708360 16125 raft_consensus.cc:2272] T f268d6e6f19d4dc293017ca00c938868 P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:04.711244 26391 consensus_peers.cc:597] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 -> Peer f56f48f4cb954f69bbbe89790ff0184b (127.15.191.65:32771): Couldn't send request to peer f56f48f4cb954f69bbbe89790ff0184b. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:32771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.711750 16125 tablet_replica.cc:333] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.712361 16125 raft_consensus.cc:2243] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.712844 16125 raft_consensus.cc:2272] T 5fa05f2a66314c89a64728182acf311a P 8ec323776dd74df884d1a2895190de08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.715269 16125 tablet_replica.cc:333] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08: stopping tablet replica
I20260709 12:14:04.715728 16125 raft_consensus.cc:2243] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.716204 16125 raft_consensus.cc:2272] T 9a4179658e9f4cbc96d5e111043540d8 P 8ec323776dd74df884d1a2895190de08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.760591 16125 tablet_server.cc:196] TabletServer@127.15.191.66:0 shutdown complete.
I20260709 12:14:04.800138 16125 tablet_server.cc:179] TabletServer@127.15.191.67:0 shutting down...
W20260709 12:14:04.811477 26388 consensus_peers.cc:597] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 -> Peer 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321): Couldn't send request to peer 8ec323776dd74df884d1a2895190de08. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:36321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.829306 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:04.831729 16125 tablet_replica.cc:333] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.832769 16125 raft_consensus.cc:2243] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.833642 16125 raft_consensus.cc:2272] T 2e5f5ecc981c4e8abc8278ed952d45a7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:04.834354 26388 consensus_peers.cc:597] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 -> Peer 8ec323776dd74df884d1a2895190de08 (127.15.191.66:36321): Couldn't send request to peer 8ec323776dd74df884d1a2895190de08. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:36321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.836095 16125 tablet_replica.cc:333] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.836807 16125 raft_consensus.cc:2243] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.837700 16125 raft_consensus.cc:2272] T e7539c0db9a44b819f5583103196413b P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.839885 16125 tablet_replica.cc:333] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.840468 16125 raft_consensus.cc:2243] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.840941 16125 raft_consensus.cc:2272] T d09aa9e9fa774018bc66bf87c649b47a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.843142 16125 tablet_replica.cc:333] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.843773 16125 raft_consensus.cc:2243] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.844257 16125 raft_consensus.cc:2272] T 2138be12b42442ebab6b29a5aae37375 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.846447 16125 tablet_replica.cc:333] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.847025 16125 raft_consensus.cc:2243] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.847571 16125 raft_consensus.cc:2272] T f5ea3cb7262b48a3baf6527cd8567af9 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.849668 16125 tablet_replica.cc:333] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.850308 16125 raft_consensus.cc:2243] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.850878 16125 raft_consensus.cc:2272] T 9e89e04666ec42b1b7252fe5dac4edbe P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.852825 16125 tablet_replica.cc:333] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.853353 16125 raft_consensus.cc:2243] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.854264 16125 raft_consensus.cc:2272] T d75c4f0adb814b07aa31bcb2e32299ea P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.856393 16125 tablet_replica.cc:333] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.856943 16125 raft_consensus.cc:2243] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.857429 16125 raft_consensus.cc:2272] T 313bca89d2cf4461b91e2f5f87e4040d P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.859649 16125 tablet_replica.cc:333] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.860205 16125 raft_consensus.cc:2243] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.860674 16125 raft_consensus.cc:2272] T 1d9cca0b928e4f8cbf0dc7e1bf9b749f P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.862932 16125 tablet_replica.cc:333] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.863459 16125 raft_consensus.cc:2243] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.863925 16125 raft_consensus.cc:2272] T 4bbe92014c1a4656a6b43c352a205a86 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.866171 16125 tablet_replica.cc:333] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.866724 16125 raft_consensus.cc:2243] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.867548 16125 raft_consensus.cc:2272] T b58abe74b412410aa73902953bd99aac P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.869652 16125 tablet_replica.cc:333] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.870251 16125 raft_consensus.cc:2243] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.870716 16125 raft_consensus.cc:2272] T 87fa6e4a38ec4f46b59e408868e1c6f0 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.872817 16125 tablet_replica.cc:333] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.873338 16125 raft_consensus.cc:2243] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.873804 16125 raft_consensus.cc:2272] T af5dc33ed33644a0bee606cd2fdfbfbb P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.876150 16125 tablet_replica.cc:333] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.876663 16125 raft_consensus.cc:2243] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.877054 16125 raft_consensus.cc:2272] T bd3670397bae4ffebeffd8b52995a3e7 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.879158 16125 tablet_replica.cc:333] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.879673 16125 raft_consensus.cc:2243] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.880129 16125 raft_consensus.cc:2272] T 04e89064748241a2bb501953befa7732 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.882279 16125 tablet_replica.cc:333] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.882797 16125 raft_consensus.cc:2243] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.883646 16125 raft_consensus.cc:2272] T 9a4179658e9f4cbc96d5e111043540d8 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.885780 16125 tablet_replica.cc:333] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.886336 16125 raft_consensus.cc:2243] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.887197 16125 raft_consensus.cc:2272] T f268d6e6f19d4dc293017ca00c938868 P cac7b74a5a1941ac84b6e16cc57e9b45 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.889396 16125 tablet_replica.cc:333] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45: stopping tablet replica
I20260709 12:14:04.889905 16125 raft_consensus.cc:2243] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.890403 16125 raft_consensus.cc:2272] T 5fa05f2a66314c89a64728182acf311a P cac7b74a5a1941ac84b6e16cc57e9b45 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.932487 16125 tablet_server.cc:196] TabletServer@127.15.191.67:0 shutdown complete.
I20260709 12:14:04.970888 16125 master.cc:562] Master@127.15.191.126:36731 shutting down...
I20260709 12:14:04.993394 16125 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.994082 16125 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.994509 16125 tablet_replica.cc:333] T 00000000000000000000000000000000 P e9d67ea8069e443cba9f4e7877848b24: stopping tablet replica
I20260709 12:14:05.014405 16125 master.cc:584] Master@127.15.191.126:36731 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20946 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:14:05.066957 16125 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.191.126:39417
I20260709 12:14:05.068100 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:05.073856 26778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.073905 26779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.074636 26781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:05.076836 16125 server_base.cc:1061] running on GCE node
I20260709 12:14:05.077906 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:05.078125 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:05.078270 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599245078252 us; error 0 us; skew 500 ppm
I20260709 12:14:05.078780 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:05.081147 16125 webserver.cc:533] Webserver started at http://127.15.191.126:33551/ using document root <none> and password file <none>
I20260709 12:14:05.081616 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:05.081790 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:05.082048 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:05.083262 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/master-0-root/instance:
uuid: "92c37802078341d991dd41b280b1d92c"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-1sdq"
I20260709 12:14:05.087780 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:05.091228 26786 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.091988 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:05.092278 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/master-0-root
uuid: "92c37802078341d991dd41b280b1d92c"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-1sdq"
I20260709 12:14:05.092545 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:05.105826 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:05.107072 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:05.144869 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.126:39417
I20260709 12:14:05.145028 26837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.126:39417 every 8 connection(s)
I20260709 12:14:05.148949 26838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.161121 26838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c: Bootstrap starting.
I20260709 12:14:05.166199 26838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.170579 26838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c: No bootstrap required, opened a new log
I20260709 12:14:05.172824 26838 raft_consensus.cc:359] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92c37802078341d991dd41b280b1d92c" member_type: VOTER }
I20260709 12:14:05.173255 26838 raft_consensus.cc:385] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.173430 26838 raft_consensus.cc:740] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92c37802078341d991dd41b280b1d92c, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.173951 26838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92c37802078341d991dd41b280b1d92c" member_type: VOTER }
I20260709 12:14:05.174417 26838 raft_consensus.cc:399] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:05.174615 26838 raft_consensus.cc:493] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:05.174834 26838 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.179868 26838 raft_consensus.cc:515] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92c37802078341d991dd41b280b1d92c" member_type: VOTER }
I20260709 12:14:05.180377 26838 leader_election.cc:304] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92c37802078341d991dd41b280b1d92c; no voters: 
I20260709 12:14:05.181459 26838 leader_election.cc:290] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:05.181806 26841 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.183148 26841 raft_consensus.cc:697] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 1 LEADER]: Becoming Leader. State: Replica: 92c37802078341d991dd41b280b1d92c, State: Running, Role: LEADER
I20260709 12:14:05.183890 26841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92c37802078341d991dd41b280b1d92c" member_type: VOTER }
I20260709 12:14:05.184370 26838 sys_catalog.cc:565] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:05.188571 26842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92c37802078341d991dd41b280b1d92c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92c37802078341d991dd41b280b1d92c" member_type: VOTER } }
I20260709 12:14:05.189422 26842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:05.189441 26843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92c37802078341d991dd41b280b1d92c. Latest consensus state: current_term: 1 leader_uuid: "92c37802078341d991dd41b280b1d92c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92c37802078341d991dd41b280b1d92c" member_type: VOTER } }
I20260709 12:14:05.190179 26843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:05.192488 26849 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:05.199975 26849 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:05.202917 16125 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:05.209993 26849 catalog_manager.cc:1383] Generated new cluster ID: c8682198919f439f9880b6b0eb60c95f
I20260709 12:14:05.210368 26849 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:05.225271 26849 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:05.226747 26849 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:05.242416 26849 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c: Generated new TSK 0
I20260709 12:14:05.243196 26849 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:05.269940 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:05.277341 26859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.278026 26860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:05.280536 16125 server_base.cc:1061] running on GCE node
W20260709 12:14:05.280514 26862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:05.281822 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:05.282012 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:05.282184 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599245282167 us; error 0 us; skew 500 ppm
I20260709 12:14:05.282660 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:05.284859 16125 webserver.cc:533] Webserver started at http://127.15.191.65:39087/ using document root <none> and password file <none>
I20260709 12:14:05.285323 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:05.285494 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:05.285799 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:05.286978 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-0-root/instance:
uuid: "b0598be35f1b49ddb4d91def97f830e4"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-1sdq"
I20260709 12:14:05.291611 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:05.295312 26867 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.296154 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:14:05.296466 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-0-root
uuid: "b0598be35f1b49ddb4d91def97f830e4"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-1sdq"
I20260709 12:14:05.296789 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:05.313591 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:05.314915 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:05.316473 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:05.318981 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:05.319213 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.319443 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:05.319614 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.360018 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.65:33181
I20260709 12:14:05.360175 26929 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.65:33181 every 8 connection(s)
I20260709 12:14:05.364974 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:05.371778 26934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.372265 26935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.376019 26937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:05.377204 16125 server_base.cc:1061] running on GCE node
I20260709 12:14:05.377255 26930 heartbeater.cc:344] Connected to a master server at 127.15.191.126:39417
I20260709 12:14:05.377830 26930 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:05.378306 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:05.378571 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:05.378659 26930 heartbeater.cc:507] Master 127.15.191.126:39417 requested a full tablet report, sending...
I20260709 12:14:05.378888 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599245378863 us; error 0 us; skew 500 ppm
I20260709 12:14:05.379591 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:05.381342 26803 ts_manager.cc:194] Registered new tserver with Master: b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181)
I20260709 12:14:05.382454 16125 webserver.cc:533] Webserver started at http://127.15.191.66:34597/ using document root <none> and password file <none>
I20260709 12:14:05.383188 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:05.383422 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:05.383714 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:05.383917 26803 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36648
I20260709 12:14:05.385428 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-1-root/instance:
uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-1sdq"
I20260709 12:14:05.390272 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:14:05.394008 26942 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.394901 16125 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:05.395223 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-1-root
uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-1sdq"
I20260709 12:14:05.395494 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:05.419296 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:05.420492 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:05.421993 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:05.424269 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:05.424477 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.424943 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:05.425170 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.469239 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.66:43929
I20260709 12:14:05.469372 27004 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.66:43929 every 8 connection(s)
I20260709 12:14:05.473980 16125 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:05.480820 27008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.482934 27009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:05.486285 27005 heartbeater.cc:344] Connected to a master server at 127.15.191.126:39417
I20260709 12:14:05.486855 27005 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:05.486999 16125 server_base.cc:1061] running on GCE node
W20260709 12:14:05.487280 27011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:05.487941 27005 heartbeater.cc:507] Master 127.15.191.126:39417 requested a full tablet report, sending...
I20260709 12:14:05.488363 16125 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:05.488598 16125 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:05.488754 16125 hybrid_clock.cc:648] HybridClock initialized: now 1783599245488738 us; error 0 us; skew 500 ppm
I20260709 12:14:05.489487 16125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:05.490198 26803 ts_manager.cc:194] Registered new tserver with Master: b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:05.492214 26803 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36664
I20260709 12:14:05.492429 16125 webserver.cc:533] Webserver started at http://127.15.191.67:41489/ using document root <none> and password file <none>
I20260709 12:14:05.493135 16125 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:05.493376 16125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:05.493683 16125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:05.495030 16125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-2-root/instance:
uuid: "448cf7456ed247c5aed55ba83537dd8c"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-1sdq"
I20260709 12:14:05.499794 16125 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:05.503261 27016 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.504032 16125 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:14:05.504305 16125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-2-root
uuid: "448cf7456ed247c5aed55ba83537dd8c"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-1sdq"
I20260709 12:14:05.504552 16125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOeqT9L/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598892377095-16125-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:05.521834 16125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:05.523147 16125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:05.524616 16125 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:05.526993 16125 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:05.527195 16125 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.527441 16125 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:05.527582 16125 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.567514 16125 rpc_server.cc:307] RPC server started. Bound to: 127.15.191.67:46459
I20260709 12:14:05.567677 27078 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.191.67:46459 every 8 connection(s)
I20260709 12:14:05.581629 27079 heartbeater.cc:344] Connected to a master server at 127.15.191.126:39417
I20260709 12:14:05.582139 27079 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:05.582926 27079 heartbeater.cc:507] Master 127.15.191.126:39417 requested a full tablet report, sending...
I20260709 12:14:05.584997 26803 ts_manager.cc:194] Registered new tserver with Master: 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:05.585800 16125 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014888022s
I20260709 12:14:05.586539 26803 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36678
I20260709 12:14:05.611794 26803 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36684:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:05.614545 26803 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:05.684964 26894 tablet_service.cc:1511] Processing CreateTablet for tablet 04b6cc63573a4f14b3de3e373f6c2aae (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:05.686648 26894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b6cc63573a4f14b3de3e373f6c2aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.685858 26895 tablet_service.cc:1511] Processing CreateTablet for tablet cf282c8f3ce447f395951ff368b594f5 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:05.688822 26892 tablet_service.cc:1511] Processing CreateTablet for tablet 977ac0238b6b424083c0baba746ad0db (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:05.690517 26892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977ac0238b6b424083c0baba746ad0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.690496 26893 tablet_service.cc:1511] Processing CreateTablet for tablet 6a8b2e063d634816b7621bbabd3048f3 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:05.693557 26893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a8b2e063d634816b7621bbabd3048f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.695469 26891 tablet_service.cc:1511] Processing CreateTablet for tablet 181ab3081f98411a85577185b650ae8f (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:05.696930 26891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ab3081f98411a85577185b650ae8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.698190 26895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf282c8f3ce447f395951ff368b594f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.710167 26890 tablet_service.cc:1511] Processing CreateTablet for tablet 138c38a5d50645e599e1362b7aa54098 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:05.711679 26890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138c38a5d50645e599e1362b7aa54098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.714639 26889 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa9316b550e4b12b2bacad9d23f7c6d (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:05.716127 26889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa9316b550e4b12b2bacad9d23f7c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.720695 26888 tablet_service.cc:1511] Processing CreateTablet for tablet 1845b4fc4d784696b1b684d970353400 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:05.722194 26888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1845b4fc4d784696b1b684d970353400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.727005 26970 tablet_service.cc:1511] Processing CreateTablet for tablet cf282c8f3ce447f395951ff368b594f5 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:05.728540 26970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf282c8f3ce447f395951ff368b594f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.731351 26969 tablet_service.cc:1511] Processing CreateTablet for tablet 04b6cc63573a4f14b3de3e373f6c2aae (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:05.732770 26969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b6cc63573a4f14b3de3e373f6c2aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.733338 26965 tablet_service.cc:1511] Processing CreateTablet for tablet 138c38a5d50645e599e1362b7aa54098 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:05.734753 26965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138c38a5d50645e599e1362b7aa54098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.735312 26968 tablet_service.cc:1511] Processing CreateTablet for tablet 6a8b2e063d634816b7621bbabd3048f3 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:05.736747 26968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a8b2e063d634816b7621bbabd3048f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.739305 26967 tablet_service.cc:1511] Processing CreateTablet for tablet 977ac0238b6b424083c0baba746ad0db (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:05.740734 26967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977ac0238b6b424083c0baba746ad0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.743273 26966 tablet_service.cc:1511] Processing CreateTablet for tablet 181ab3081f98411a85577185b650ae8f (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:05.744379 27094 tablet_bootstrap.cc:492] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:05.744791 26966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ab3081f98411a85577185b650ae8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.749830 26964 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa9316b550e4b12b2bacad9d23f7c6d (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:05.751335 26964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa9316b550e4b12b2bacad9d23f7c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.752581 26887 tablet_service.cc:1511] Processing CreateTablet for tablet d0dff9e1109044e59636887dd30f38c8 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:05.754041 26887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0dff9e1109044e59636887dd30f38c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.754572 27044 tablet_service.cc:1511] Processing CreateTablet for tablet cf282c8f3ce447f395951ff368b594f5 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:05.755930 27044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf282c8f3ce447f395951ff368b594f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.759289 27043 tablet_service.cc:1511] Processing CreateTablet for tablet 04b6cc63573a4f14b3de3e373f6c2aae (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:05.760782 27043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b6cc63573a4f14b3de3e373f6c2aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.760512 27038 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa9316b550e4b12b2bacad9d23f7c6d (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:05.761883 27038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa9316b550e4b12b2bacad9d23f7c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.767230 27042 tablet_service.cc:1511] Processing CreateTablet for tablet 6a8b2e063d634816b7621bbabd3048f3 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:05.762835 26963 tablet_service.cc:1511] Processing CreateTablet for tablet 1845b4fc4d784696b1b684d970353400 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:05.768560 27042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a8b2e063d634816b7621bbabd3048f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.768771 26963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1845b4fc4d784696b1b684d970353400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.763262 27039 tablet_service.cc:1511] Processing CreateTablet for tablet 138c38a5d50645e599e1362b7aa54098 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:05.770130 27036 tablet_service.cc:1511] Processing CreateTablet for tablet d0dff9e1109044e59636887dd30f38c8 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:05.771471 27039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138c38a5d50645e599e1362b7aa54098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.772092 27037 tablet_service.cc:1511] Processing CreateTablet for tablet 1845b4fc4d784696b1b684d970353400 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:05.765082 26962 tablet_service.cc:1511] Processing CreateTablet for tablet d0dff9e1109044e59636887dd30f38c8 (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:05.773830 26962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0dff9e1109044e59636887dd30f38c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.765074 27040 tablet_service.cc:1511] Processing CreateTablet for tablet 181ab3081f98411a85577185b650ae8f (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:05.766986 27041 tablet_service.cc:1511] Processing CreateTablet for tablet 977ac0238b6b424083c0baba746ad0db (DEFAULT_TABLE table=test-workload [id=46f7c5abb6b84a438801bc1875a6fc25]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:05.776873 27037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1845b4fc4d784696b1b684d970353400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.782966 27041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977ac0238b6b424083c0baba746ad0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.786734 27036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0dff9e1109044e59636887dd30f38c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.788321 27040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ab3081f98411a85577185b650ae8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.817437 27094 tablet_bootstrap.cc:654] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.872931 27094 tablet_bootstrap.cc:492] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:05.873451 27094 ts_tablet_manager.cc:1403] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.000s
I20260709 12:14:05.875445 27097 tablet_bootstrap.cc:492] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:05.883361 27094 raft_consensus.cc:359] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:05.884106 27094 raft_consensus.cc:385] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.884356 27094 raft_consensus.cc:740] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.885066 27094 consensus_queue.cc:260] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:05.897135 27097 tablet_bootstrap.cc:654] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.898483 26930 heartbeater.cc:499] Master 127.15.191.126:39417 was elected leader, sending a full tablet report...
I20260709 12:14:05.899797 27096 tablet_bootstrap.cc:492] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:05.905571 27096 tablet_bootstrap.cc:654] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.911623 27094 ts_tablet_manager.cc:1434] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.006s
I20260709 12:14:05.913163 27094 tablet_bootstrap.cc:492] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:05.917150 27096 tablet_bootstrap.cc:492] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:05.917862 27096 ts_tablet_manager.cc:1403] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:14:05.921157 27096 raft_consensus.cc:359] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:05.921998 27096 raft_consensus.cc:385] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.922405 27096 raft_consensus.cc:740] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.923187 27096 consensus_queue.cc:260] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:05.928504 27079 heartbeater.cc:499] Master 127.15.191.126:39417 was elected leader, sending a full tablet report...
I20260709 12:14:05.928936 27096 ts_tablet_manager.cc:1434] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:14:05.929369 27097 tablet_bootstrap.cc:492] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:05.929901 27097 ts_tablet_manager.cc:1403] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.004s
I20260709 12:14:05.930056 27096 tablet_bootstrap.cc:492] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:05.933136 27094 tablet_bootstrap.cc:654] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.933259 27097 raft_consensus.cc:359] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:05.934214 27097 raft_consensus.cc:385] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.934537 27097 raft_consensus.cc:740] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.935331 27097 consensus_queue.cc:260] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:05.937028 27096 tablet_bootstrap.cc:654] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.945017 27005 heartbeater.cc:499] Master 127.15.191.126:39417 was elected leader, sending a full tablet report...
I20260709 12:14:05.945247 27097 ts_tablet_manager.cc:1434] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:14:05.946717 27097 tablet_bootstrap.cc:492] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:05.954249 27097 tablet_bootstrap.cc:654] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.957556 27096 tablet_bootstrap.cc:492] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:05.958086 27096 ts_tablet_manager.cc:1403] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.028s	user 0.000s	sys 0.025s
I20260709 12:14:05.960033 27097 tablet_bootstrap.cc:492] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:05.960675 27097 ts_tablet_manager.cc:1403] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:14:05.961187 27096 raft_consensus.cc:359] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:05.961999 27096 raft_consensus.cc:385] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.962316 27096 raft_consensus.cc:740] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.962455 27094 tablet_bootstrap.cc:492] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:05.963150 27094 ts_tablet_manager.cc:1403] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.007s
I20260709 12:14:05.963135 27096 consensus_queue.cc:260] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:05.963814 27097 raft_consensus.cc:359] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:05.964579 27097 raft_consensus.cc:385] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.964872 27097 raft_consensus.cc:740] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.965782 27097 consensus_queue.cc:260] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:05.966888 27094 raft_consensus.cc:359] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:05.967403 27096 ts_tablet_manager.cc:1434] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:14:05.967782 27094 raft_consensus.cc:385] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.968083 27097 ts_tablet_manager.cc:1434] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:05.968184 27094 raft_consensus.cc:740] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.968513 27096 tablet_bootstrap.cc:492] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:05.969197 27094 consensus_queue.cc:260] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
W20260709 12:14:05.973338 27006 tablet.cc:2406] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:05.974409 27097 tablet_bootstrap.cc:492] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:05.975171 27096 tablet_bootstrap.cc:654] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.975689 27094 ts_tablet_manager.cc:1434] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:14:05.976827 27094 tablet_bootstrap.cc:492] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:05.982267 27097 tablet_bootstrap.cc:654] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.983183 27094 tablet_bootstrap.cc:654] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.995433 27094 tablet_bootstrap.cc:492] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:05.995986 27094 ts_tablet_manager.cc:1403] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 12:14:05.999306 27094 raft_consensus.cc:359] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.000051 27094 raft_consensus.cc:385] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.000355 27094 raft_consensus.cc:740] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.001243 27094 consensus_queue.cc:260] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.006328 27094 ts_tablet_manager.cc:1434] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.007s
I20260709 12:14:06.007231 27094 tablet_bootstrap.cc:492] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:06.008245 27097 tablet_bootstrap.cc:492] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:06.008819 27097 ts_tablet_manager.cc:1403] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.016s
I20260709 12:14:06.009543 27096 tablet_bootstrap.cc:492] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:06.010133 27096 ts_tablet_manager.cc:1403] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.011s
I20260709 12:14:06.011844 27097 raft_consensus.cc:359] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.012682 27097 raft_consensus.cc:385] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.012979 27097 raft_consensus.cc:740] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.013423 27094 tablet_bootstrap.cc:654] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.013154 27096 raft_consensus.cc:359] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.014003 27096 raft_consensus.cc:385] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.014499 27096 raft_consensus.cc:740] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.013926 27097 consensus_queue.cc:260] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.015303 27096 consensus_queue.cc:260] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.017941 27101 raft_consensus.cc:493] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.018549 27101 raft_consensus.cc:515] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:06.025080 27103 raft_consensus.cc:493] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.025806 27103 raft_consensus.cc:515] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.027079 27094 tablet_bootstrap.cc:492] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:06.027685 27094 ts_tablet_manager.cc:1403] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 12:14:06.030762 27094 raft_consensus.cc:359] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:06.033423 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:06.033852 27094 raft_consensus.cc:385] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.034195 27094 raft_consensus.cc:740] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.035006 27094 consensus_queue.cc:260] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:06.037788 26905 raft_consensus.cc:2468] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:06.038385 27101 leader_election.cc:290] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:06.042054 27103 leader_election.cc:290] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.049098 27094 ts_tablet_manager.cc:1434] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 12:14:06.050377 27094 tablet_bootstrap.cc:492] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:06.056998 27094 tablet_bootstrap.cc:654] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.063632 27103 raft_consensus.cc:493] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.064383 27103 raft_consensus.cc:515] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.066572 27018 leader_election.cc:304] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:06.067771 27101 raft_consensus.cc:2804] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.068207 27101 raft_consensus.cc:493] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.068598 27101 raft_consensus.cc:3060] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.068655 27094 tablet_bootstrap.cc:492] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:06.070669 27094 ts_tablet_manager.cc:1403] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:14:06.071569 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
W20260709 12:14:06.073616 27017 leader_election.cc:343] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.075067 27094 raft_consensus.cc:359] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.075870 27094 raft_consensus.cc:385] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.076180 27094 raft_consensus.cc:740] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.076926 27094 consensus_queue.cc:260] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.077956 27103 leader_election.cc:290] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.084388 27097 ts_tablet_manager.cc:1434] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 12:14:06.085173 27094 ts_tablet_manager.cc:1434] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:14:06.086588 27094 tablet_bootstrap.cc:492] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:06.093372 27094 tablet_bootstrap.cc:654] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.094735 27097 tablet_bootstrap.cc:492] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:06.105679 27094 tablet_bootstrap.cc:492] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:06.107226 27094 ts_tablet_manager.cc:1403] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 12:14:06.108105 27098 raft_consensus.cc:493] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.106165 27101 raft_consensus.cc:515] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:06.108759 27098 raft_consensus.cc:515] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.110466 27094 raft_consensus.cc:359] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.111279 27094 raft_consensus.cc:385] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.111568 27094 raft_consensus.cc:740] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.111934 27098 leader_election.cc:290] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.112509 27094 consensus_queue.cc:260] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.114820 27094 ts_tablet_manager.cc:1434] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:14:06.116035 27094 tablet_bootstrap.cc:492] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:06.119522 27097 tablet_bootstrap.cc:654] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.126989 27094 tablet_bootstrap.cc:654] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.131697 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.132570 27054 raft_consensus.cc:2468] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:06.131227 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845b4fc4d784696b1b684d970353400" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.135270 26945 leader_election.cc:304] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
W20260709 12:14:06.136420 26945 leader_election.cc:343] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.137177 27103 raft_consensus.cc:2804] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.137686 27103 raft_consensus.cc:493] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.138031 27103 raft_consensus.cc:3060] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.139000 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b6cc63573a4f14b3de3e373f6c2aae" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
W20260709 12:14:06.140780 26868 leader_election.cc:343] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.147696 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:06.148494 27096 ts_tablet_manager.cc:1434] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.138s	user 0.075s	sys 0.058s
I20260709 12:14:06.148880 27103 raft_consensus.cc:515] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
W20260709 12:14:06.149302 27017 leader_election.cc:343] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.150218 27094 tablet_bootstrap.cc:492] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:06.150828 27094 ts_tablet_manager.cc:1403] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 12:14:06.151314 27096 tablet_bootstrap.cc:492] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:06.152757 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:06.153450 27053 raft_consensus.cc:3060] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.153822 27101 leader_election.cc:290] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:06.154431 27094 raft_consensus.cc:359] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.155305 27094 raft_consensus.cc:385] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.155658 27094 raft_consensus.cc:740] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.156467 27094 consensus_queue.cc:260] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.158932 27096 tablet_bootstrap.cc:654] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.159345 27094 ts_tablet_manager.cc:1434] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:06.160627 27094 tablet_bootstrap.cc:492] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:06.162250 27103 leader_election.cc:290] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.163388 27053 raft_consensus.cc:2468] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:06.164913 26945 leader_election.cc:304] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:06.166015 27103 raft_consensus.cc:2804] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.167513 27094 tablet_bootstrap.cc:654] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.174219 27103 raft_consensus.cc:697] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:06.175074 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:06.175959 26904 raft_consensus.cc:3060] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.175494 27103 consensus_queue.cc:237] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.181799 27097 tablet_bootstrap.cc:492] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:06.182602 27097 ts_tablet_manager.cc:1403] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.003s
I20260709 12:14:06.185567 26904 raft_consensus.cc:2468] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:06.190068 27097 raft_consensus.cc:359] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.191010 27097 raft_consensus.cc:385] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.191335 27097 raft_consensus.cc:740] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.191699 27096 tablet_bootstrap.cc:492] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:06.192322 27096 ts_tablet_manager.cc:1403] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.019s
I20260709 12:14:06.193394 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b6cc63573a4f14b3de3e373f6c2aae" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.193518 27018 leader_election.cc:304] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:06.194299 27053 raft_consensus.cc:2468] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:06.195063 27101 raft_consensus.cc:2804] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.195667 27101 raft_consensus.cc:697] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:06.196849 27094 tablet_bootstrap.cc:492] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:06.197455 27094 ts_tablet_manager.cc:1403] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.011s
I20260709 12:14:06.198114 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
W20260709 12:14:06.197937 26851 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:06.200452 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845b4fc4d784696b1b684d970353400" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
W20260709 12:14:06.201177 26944 leader_election.cc:343] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.201150 27094 raft_consensus.cc:359] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.202142 27094 raft_consensus.cc:385] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.200079 27101 consensus_queue.cc:237] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:06.202500 27094 raft_consensus.cc:740] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.196022 27096 raft_consensus.cc:359] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.203131 27096 raft_consensus.cc:385] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.203469 27096 raft_consensus.cc:740] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.203529 27094 consensus_queue.cc:260] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.193449 27097 consensus_queue.cc:260] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.201409 26801 catalog_manager.cc:5697] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 0 to 1, leader changed from <none> to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 1 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.204351 27096 consensus_queue.cc:260] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.204792 26905 raft_consensus.cc:2468] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:06.206532 27094 ts_tablet_manager.cc:1434] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:06.201519 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:06.203538 26870 leader_election.cc:304] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:06.211386 27098 raft_consensus.cc:2804] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.211861 27098 raft_consensus.cc:493] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.212213 27098 raft_consensus.cc:3060] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.225080 27097 ts_tablet_manager.cc:1434] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:14:06.225920 27096 ts_tablet_manager.cc:1434] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.019s
I20260709 12:14:06.227108 27096 tablet_bootstrap.cc:492] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:06.221483 27098 raft_consensus.cc:515] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.227488 26944 leader_election.cc:304] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:06.228595 27094 tablet_bootstrap.cc:492] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
W20260709 12:14:06.231490 26944 leader_election.cc:343] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.232970 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b6cc63573a4f14b3de3e373f6c2aae" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:06.233666 26980 raft_consensus.cc:3060] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.234234 27097 tablet_bootstrap.cc:492] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:06.233183 27098 leader_election.cc:290] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.236723 27094 tablet_bootstrap.cc:654] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.236946 27096 tablet_bootstrap.cc:654] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.230690 27103 raft_consensus.cc:2804] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.239915 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b6cc63573a4f14b3de3e373f6c2aae" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:06.241086 27053 raft_consensus.cc:3060] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.243749 27125 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.246248 26980 raft_consensus.cc:2468] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:06.253551 26800 catalog_manager.cc:5697] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.255277 26868 leader_election.cc:304] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:06.248838 27098 raft_consensus.cc:493] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.257124 27098 raft_consensus.cc:515] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.262442 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.257757 27125 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
W20260709 12:14:06.264298 26870 leader_election.cc:343] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.264779 27098 leader_election.cc:290] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.243300 27103 raft_consensus.cc:493] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.269277 27103 raft_consensus.cc:3060] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.268851 27098 raft_consensus.cc:2804] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.279481 27098 raft_consensus.cc:697] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:06.279959 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:06.280525 27098 consensus_queue.cc:237] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.281821 27129 raft_consensus.cc:493] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:06.281610 26868 leader_election.cc:343] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.284698 26868 leader_election.cc:304] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4; no voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:06.284446 27129 raft_consensus.cc:515] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.285107 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.283859 27125 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.284374 27094 tablet_bootstrap.cc:492] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:06.286267 27094 ts_tablet_manager.cc:1403] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.002s
I20260709 12:14:06.279182 27053 raft_consensus.cc:2468] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
W20260709 12:14:06.288075 26870 leader_election.cc:343] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.288715 27129 leader_election.cc:290] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.290191 27096 tablet_bootstrap.cc:492] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:06.289912 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ab3081f98411a85577185b650ae8f" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.290848 27096 ts_tablet_manager.cc:1403] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.015s
I20260709 12:14:06.285045 27103 raft_consensus.cc:515] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.291656 27129 raft_consensus.cc:2749] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:06.291544 26870 leader_election.cc:343] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.291437 27094 raft_consensus.cc:359] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.293015 27094 raft_consensus.cc:385] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.293290 27094 raft_consensus.cc:740] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.294546 27097 tablet_bootstrap.cc:654] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.294548 27094 consensus_queue.cc:260] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.296119 27103 leader_election.cc:290] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.297973 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845b4fc4d784696b1b684d970353400" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:06.298753 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:06.298117 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845b4fc4d784696b1b684d970353400" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:06.298751 26904 raft_consensus.cc:3060] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:06.301484 26945 leader_election.cc:343] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.302795 27096 raft_consensus.cc:359] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.303639 27096 raft_consensus.cc:385] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.304005 27096 raft_consensus.cc:740] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.305032 27096 consensus_queue.cc:260] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.307793 27096 ts_tablet_manager.cc:1434] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:14:06.309119 26904 raft_consensus.cc:2468] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:06.300254 27094 ts_tablet_manager.cc:1434] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:14:06.311116 27096 tablet_bootstrap.cc:492] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:06.310925 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ab3081f98411a85577185b650ae8f" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
W20260709 12:14:06.311915 26868 leader_election.cc:343] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.313480 26868 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4; no voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:06.314489 27134 raft_consensus.cc:2749] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:06.315980 26868 leader_election.cc:343] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.316465 26868 leader_election.cc:304] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4; no voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:06.317286 27134 raft_consensus.cc:2749] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:06.319238 26944 leader_election.cc:304] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:06.320156 27103 raft_consensus.cc:2804] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.320652 27103 raft_consensus.cc:697] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:06.321491 27103 consensus_queue.cc:237] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.325338 27096 tablet_bootstrap.cc:654] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.326982 27098 raft_consensus.cc:493] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.327543 27098 raft_consensus.cc:515] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.330469 27098 leader_election.cc:290] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.329829 26803 catalog_manager.cc:5697] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.331156 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c38a5d50645e599e1362b7aa54098" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.331882 27053 raft_consensus.cc:2468] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:06.333362 26870 leader_election.cc:304] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:06.334255 27098 raft_consensus.cc:2804] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.334635 27098 raft_consensus.cc:493] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.334976 27098 raft_consensus.cc:3060] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.336199 27097 tablet_bootstrap.cc:492] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:06.336891 27097 ts_tablet_manager.cc:1403] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.107s	user 0.022s	sys 0.007s
I20260709 12:14:06.339124 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c38a5d50645e599e1362b7aa54098" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:06.339908 26980 raft_consensus.cc:2468] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:06.340543 27097 raft_consensus.cc:359] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.341506 27097 raft_consensus.cc:385] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.341823 27097 raft_consensus.cc:740] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.343324 27134 raft_consensus.cc:493] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.342906 27097 consensus_queue.cc:260] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.343881 27134 raft_consensus.cc:515] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.344843 27098 raft_consensus.cc:515] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.346378 27134 leader_election.cc:290] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.347795 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.348212 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:06.348759 27053 raft_consensus.cc:2393] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0598be35f1b49ddb4d91def97f830e4 in current term 1: Already voted for candidate b4a981f2bf1c4261806dfea3d38bf18d in this term.
I20260709 12:14:06.349822 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c38a5d50645e599e1362b7aa54098" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:06.350288 27098 leader_election.cc:290] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.351941 26870 leader_election.cc:304] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4; no voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:06.352620 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c38a5d50645e599e1362b7aa54098" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:06.350550 26979 raft_consensus.cc:3060] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.353243 27053 raft_consensus.cc:3060] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.355198 27096 tablet_bootstrap.cc:492] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:06.355763 27096 ts_tablet_manager.cc:1403] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.001s
I20260709 12:14:06.358904 27096 raft_consensus.cc:359] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.359658 27096 raft_consensus.cc:385] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.359952 27096 raft_consensus.cc:740] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.360737 27096 consensus_queue.cc:260] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.361008 27053 raft_consensus.cc:2468] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:06.361666 26979 raft_consensus.cc:2468] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:06.361241 26800 catalog_manager.cc:5697] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 0 to 1, leader changed from <none> to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 1 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.365469 26868 leader_election.cc:304] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:06.365590 27096 ts_tablet_manager.cc:1434] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:14:06.346091 27097 ts_tablet_manager.cc:1434] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:14:06.366405 27134 raft_consensus.cc:2804] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.367169 27134 raft_consensus.cc:697] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:06.367530 27096 tablet_bootstrap.cc:492] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:06.367666 27097 tablet_bootstrap.cc:492] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:06.368016 27134 consensus_queue.cc:237] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.362208 27098 raft_consensus.cc:3060] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.375049 27097 tablet_bootstrap.cc:654] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.375222 27096 tablet_bootstrap.cc:654] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.387892 27098 raft_consensus.cc:2749] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:06.397984 27096 tablet_bootstrap.cc:492] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:06.398876 27096 ts_tablet_manager.cc:1403] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.012s
I20260709 12:14:06.402637 27096 raft_consensus.cc:359] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.403375 27096 raft_consensus.cc:385] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.403614 27097 tablet_bootstrap.cc:492] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:06.403688 27096 raft_consensus.cc:740] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.404299 27097 ts_tablet_manager.cc:1403] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.016s
I20260709 12:14:06.404763 27096 consensus_queue.cc:260] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.404281 26802 catalog_manager.cc:5697] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.407236 27097 raft_consensus.cc:359] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.407979 27097 raft_consensus.cc:385] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.408351 27097 raft_consensus.cc:740] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.409132 27097 consensus_queue.cc:260] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.409796 27096 ts_tablet_manager.cc:1434] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:14:06.410970 27096 tablet_bootstrap.cc:492] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:06.411090 27097 ts_tablet_manager.cc:1434] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:06.412204 27097 tablet_bootstrap.cc:492] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:06.418303 27097 tablet_bootstrap.cc:654] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.419080 27096 tablet_bootstrap.cc:654] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.424613 27096 tablet_bootstrap.cc:492] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:06.424700 27097 tablet_bootstrap.cc:492] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:06.425132 27096 ts_tablet_manager.cc:1403] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 12:14:06.425277 27097 ts_tablet_manager.cc:1403] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:14:06.427956 27096 raft_consensus.cc:359] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.428148 27097 raft_consensus.cc:359] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.428653 27096 raft_consensus.cc:385] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.428834 27097 raft_consensus.cc:385] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.429026 27096 raft_consensus.cc:740] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.429186 27097 raft_consensus.cc:740] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.429872 27096 consensus_queue.cc:260] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.429958 27097 consensus_queue.cc:260] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.431963 27096 ts_tablet_manager.cc:1434] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:06.432008 27097 ts_tablet_manager.cc:1434] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:06.433019 27096 tablet_bootstrap.cc:492] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:06.433156 27097 tablet_bootstrap.cc:492] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:06.439455 27096 tablet_bootstrap.cc:654] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.439520 27097 tablet_bootstrap.cc:654] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.445498 27097 tablet_bootstrap.cc:492] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:06.445775 27096 tablet_bootstrap.cc:492] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:06.445950 27097 ts_tablet_manager.cc:1403] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:14:06.446355 27096 ts_tablet_manager.cc:1403] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 12:14:06.448191 27097 raft_consensus.cc:359] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:06.448782 27097 raft_consensus.cc:385] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.448662 27096 raft_consensus.cc:359] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.449144 27097 raft_consensus.cc:740] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.449318 27096 raft_consensus.cc:385] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.449616 27096 raft_consensus.cc:740] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.449841 27097 consensus_queue.cc:260] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:06.450204 27096 consensus_queue.cc:260] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.451776 27096 ts_tablet_manager.cc:1434] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:06.451879 27097 ts_tablet_manager.cc:1434] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:06.452885 27097 tablet_bootstrap.cc:492] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:06.457930 27097 tablet_bootstrap.cc:654] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.462841 27097 tablet_bootstrap.cc:492] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:06.463306 27097 ts_tablet_manager.cc:1403] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:14:06.465528 27097 raft_consensus.cc:359] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.466053 27097 raft_consensus.cc:385] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.466302 27097 raft_consensus.cc:740] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.466851 27097 consensus_queue.cc:260] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.468586 27097 ts_tablet_manager.cc:1434] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:06.484754 27098 raft_consensus.cc:493] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.485335 27098 raft_consensus.cc:515] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.487179 27098 leader_election.cc:290] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.488015 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:06.488250 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.488621 26979 raft_consensus.cc:2468] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:06.488910 27053 raft_consensus.cc:2468] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:06.489683 26868 leader_election.cc:304] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:06.490585 27098 raft_consensus.cc:2804] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.490872 27098 raft_consensus.cc:493] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.491117 27098 raft_consensus.cc:3060] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.496699 27098 raft_consensus.cc:515] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.498943 27098 leader_election.cc:290] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.499505 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:06.499859 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:06.500130 26979 raft_consensus.cc:3060] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.500429 27053 raft_consensus.cc:3060] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.506522 26979 raft_consensus.cc:2468] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:06.506704 27053 raft_consensus.cc:2468] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:06.507851 26868 leader_election.cc:304] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:06.508522 27098 raft_consensus.cc:2804] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.508919 27098 raft_consensus.cc:697] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:06.509553 27098 consensus_queue.cc:237] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.517179 26803 catalog_manager.cc:5697] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.564386 27101 raft_consensus.cc:493] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.564978 27101 raft_consensus.cc:515] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.566955 27101 leader_election.cc:290] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:06.567745 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845b4fc4d784696b1b684d970353400" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:06.568198 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845b4fc4d784696b1b684d970353400" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:06.568668 26904 raft_consensus.cc:2393] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 448cf7456ed247c5aed55ba83537dd8c in current term 1: Already voted for candidate b4a981f2bf1c4261806dfea3d38bf18d in this term.
I20260709 12:14:06.569919 27018 leader_election.cc:304] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c; no voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:06.570691 27101 raft_consensus.cc:3060] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.576131 27101 raft_consensus.cc:2749] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:06.581588 27103 consensus_queue.cc:1048] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.594035 27121 consensus_queue.cc:1048] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.660313 27101 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.660831 27101 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.662588 27101 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:06.663425 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:06.663674 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:06.664067 26904 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:06.664328 26979 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:06.665118 27018 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:06.665838 27101 raft_consensus.cc:2804] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.666234 27101 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.666500 27101 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.671826 27101 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.673851 27101 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:06.674400 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:06.674870 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:06.675051 26904 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.675505 26979 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.681205 26904 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:06.681260 26979 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:06.682454 27018 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:06.683154 27101 raft_consensus.cc:2804] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.683629 27101 raft_consensus.cc:697] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:06.684396 27101 consensus_queue.cc:237] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.691681 26800 catalog_manager.cc:5697] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.697940 27098 consensus_queue.cc:1048] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.701498 26980 raft_consensus.cc:3060] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.711004 27129 consensus_queue.cc:1048] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.715308 27101 consensus_queue.cc:1048] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.725822 27121 raft_consensus.cc:493] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.726415 27121 raft_consensus.cc:515] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.728680 27121 leader_election.cc:290] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.729851 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.730671 27053 raft_consensus.cc:2468] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:06.730716 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:06.731415 26905 raft_consensus.cc:2468] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:06.731953 26945 leader_election.cc:304] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:06.734859 27121 raft_consensus.cc:2804] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.735206 27121 raft_consensus.cc:493] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.735272 27103 raft_consensus.cc:493] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.735549 27121 raft_consensus.cc:3060] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.735883 27103 raft_consensus.cc:515] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.737694 27103 leader_election.cc:290] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.738893 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ab3081f98411a85577185b650ae8f" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:06.739189 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ab3081f98411a85577185b650ae8f" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:06.739647 26905 raft_consensus.cc:2468] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:06.739814 27053 raft_consensus.cc:2468] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:06.740963 26944 leader_election.cc:304] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:06.742889 27103 raft_consensus.cc:2804] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.743269 27103 raft_consensus.cc:493] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.743629 27103 raft_consensus.cc:3060] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.744266 27158 consensus_queue.cc:1048] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.746317 27121 raft_consensus.cc:515] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.752975 27134 consensus_queue.cc:1048] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.754554 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:06.755262 27053 raft_consensus.cc:3060] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.755710 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:06.756317 26905 raft_consensus.cc:3060] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.763536 27053 raft_consensus.cc:2468] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:06.765007 26945 leader_election.cc:304] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:06.765727 26905 raft_consensus.cc:2468] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:06.766016 27161 raft_consensus.cc:2804] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.766764 27161 raft_consensus.cc:697] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:06.767757 27161 consensus_queue.cc:237] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.769757 27103 raft_consensus.cc:515] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.770169 27121 leader_election.cc:290] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.772360 27103 leader_election.cc:290] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:06.773270 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ab3081f98411a85577185b650ae8f" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:06.773689 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ab3081f98411a85577185b650ae8f" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:06.773972 26905 raft_consensus.cc:3060] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.774492 27053 raft_consensus.cc:3060] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.782603 27053 raft_consensus.cc:2468] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:06.783923 26945 leader_election.cc:304] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:06.784920 27103 raft_consensus.cc:2804] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.785473 27103 raft_consensus.cc:697] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:06.786554 27103 consensus_queue.cc:237] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:06.787963 27129 consensus_queue.cc:1048] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.805613 27121 consensus_queue.cc:1048] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.817562 26905 raft_consensus.cc:2468] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:06.825590 27161 consensus_queue.cc:1048] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.831082 26800 catalog_manager.cc:5697] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 0 to 1, leader changed from <none> to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 1 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.833114 26800 catalog_manager.cc:5697] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 0 to 1, leader changed from <none> to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 1 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.906374 27054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
mode: GRACEFUL
new_leader_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:47302
I20260709 12:14:06.906975 27054 raft_consensus.cc:606] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Received request to transfer leadership to TS b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:06.918068 27054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
mode: GRACEFUL
new_leader_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:47302
I20260709 12:14:06.918582 27054 raft_consensus.cc:606] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Received request to transfer leadership to TS b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:06.934624 26905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "138c38a5d50645e599e1362b7aa54098"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
mode: GRACEFUL
new_leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
 from {username='slave'} at 127.0.0.1:45690
I20260709 12:14:06.935155 26905 raft_consensus.cc:606] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Received request to transfer leadership to TS b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:06.954131 26980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8"
dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
mode: GRACEFUL
new_leader_uuid: "448cf7456ed247c5aed55ba83537dd8c"
 from {username='slave'} at 127.0.0.1:39514
I20260709 12:14:06.954674 26980 raft_consensus.cc:606] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Received request to transfer leadership to TS 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:07.006649 27129 consensus_queue.cc:1048] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:07.017738 27134 consensus_queue.cc:1048] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:07.183337 27161 consensus_queue.cc:1048] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:07.190843 27159 raft_consensus.cc:993] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d: : Instructing follower 448cf7456ed247c5aed55ba83537dd8c to start an election
I20260709 12:14:07.191365 27166 raft_consensus.cc:1081] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Signalling peer 448cf7456ed247c5aed55ba83537dd8c to start an election
I20260709 12:14:07.193457 27054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
 from {username='slave'} at 127.0.0.1:47278
I20260709 12:14:07.197978 27054 raft_consensus.cc:493] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.197777 27166 consensus_queue.cc:1048] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:07.198563 27054 raft_consensus.cc:3060] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.217900 27054 raft_consensus.cc:515] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:07.220602 27054 leader_election.cc:290] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:07.220997 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:07.221710 26905 raft_consensus.cc:3060] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.222586 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dff9e1109044e59636887dd30f38c8" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:07.223279 26980 raft_consensus.cc:3055] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:07.223600 26980 raft_consensus.cc:740] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:07.224402 26980 consensus_queue.cc:260] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:07.225441 26980 raft_consensus.cc:3060] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.228317 26905 raft_consensus.cc:2468] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 2.
I20260709 12:14:07.229692 27018 leader_election.cc:304] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:07.230505 27158 raft_consensus.cc:2804] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.230892 27158 raft_consensus.cc:697] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:07.231602 27158 consensus_queue.cc:237] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:07.231851 26980 raft_consensus.cc:2468] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 2.
I20260709 12:14:07.238801 26800 catalog_manager.cc:5697] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 1 to 2, leader changed from b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66) to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 2 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:07.243791 27158 consensus_queue.cc:1048] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:07.252175 27110 raft_consensus.cc:993] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c: : Instructing follower b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:07.252972 27158 raft_consensus.cc:1081] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Signalling peer b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:07.255319 26904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:45678
I20260709 12:14:07.255951 26904 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.256268 26904 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.258203 27110 consensus_queue.cc:1048] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:07.263994 26904 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:07.265234 26905 raft_consensus.cc:1240] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Rejecting Update request from peer 448cf7456ed247c5aed55ba83537dd8c for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:07.267483 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:07.268436 26980 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.272040 27110 consensus_queue.cc:1059] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:07.273131 27158 raft_consensus.cc:3055] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:07.273489 27158 raft_consensus.cc:740] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:07.274528 27158 consensus_queue.cc:260] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:07.275700 27158 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.275969 26980 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:07.277146 26868 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:07.277798 27134 raft_consensus.cc:2804] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.278187 27134 raft_consensus.cc:697] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:07.279109 26904 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:07.279022 27134 consensus_queue.cc:237] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:07.285888 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:07.286687 26800 catalog_manager.cc:5697] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 1 to 2, leader changed from 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67) to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.287796 27159 consensus_queue.cc:1048] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:07.296566 27054 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:07.310460 27159 consensus_queue.cc:1048] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:07.341511 27179 raft_consensus.cc:993] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c: : Instructing follower b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:07.342046 27158 raft_consensus.cc:1081] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Signalling peer b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:07.343704 26904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:45678
I20260709 12:14:07.344203 26904 raft_consensus.cc:493] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.344563 26904 raft_consensus.cc:3060] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.349992 26904 raft_consensus.cc:515] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:07.351758 26904 leader_election.cc:290] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Requested vote from peers 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:07.352653 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:07.352902 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:07.353413 27054 raft_consensus.cc:3055] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:07.353453 26980 raft_consensus.cc:3060] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.353894 27054 raft_consensus.cc:740] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:07.354823 27054 consensus_queue.cc:260] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:07.356127 27054 raft_consensus.cc:3060] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.361459 26980 raft_consensus.cc:2468] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:07.362870 26868 leader_election.cc:304] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:07.363665 27054 raft_consensus.cc:2468] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:07.363763 27134 raft_consensus.cc:2804] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.364354 27134 raft_consensus.cc:697] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:07.365234 27134 consensus_queue.cc:237] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:07.371919 26803 catalog_manager.cc:5697] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 1 to 2, leader changed from 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67) to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.409368 27129 raft_consensus.cc:993] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4: : Instructing follower b4a981f2bf1c4261806dfea3d38bf18d to start an election
I20260709 12:14:07.409864 27134 raft_consensus.cc:1081] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Signalling peer b4a981f2bf1c4261806dfea3d38bf18d to start an election
I20260709 12:14:07.411492 26980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "138c38a5d50645e599e1362b7aa54098"
dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
 from {username='slave'} at 127.0.0.1:39506
I20260709 12:14:07.411991 26980 raft_consensus.cc:493] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.412299 26980 raft_consensus.cc:3060] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.417658 26980 raft_consensus.cc:515] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:07.419339 26980 leader_election.cc:290] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:07.420368 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c38a5d50645e599e1362b7aa54098" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:07.420466 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c38a5d50645e599e1362b7aa54098" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:07.421001 26904 raft_consensus.cc:3055] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:07.421090 27054 raft_consensus.cc:3060] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.421319 26904 raft_consensus.cc:740] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:07.422077 26904 consensus_queue.cc:260] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:07.423103 26904 raft_consensus.cc:3060] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.426900 27054 raft_consensus.cc:2468] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 2.
I20260709 12:14:07.428284 26945 leader_election.cc:304] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:07.428907 26904 raft_consensus.cc:2468] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 2.
I20260709 12:14:07.429131 27159 raft_consensus.cc:2804] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.429709 27159 raft_consensus.cc:697] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:07.430500 27159 consensus_queue.cc:237] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:07.436884 26803 catalog_manager.cc:5697] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 1 to 2, leader changed from b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65) to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 2 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.638092 26980 raft_consensus.cc:1275] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Refusing update from remote peer 448cf7456ed247c5aed55ba83537dd8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.639552 27158 consensus_queue.cc:1048] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.649194 26905 raft_consensus.cc:1275] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Refusing update from remote peer 448cf7456ed247c5aed55ba83537dd8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.651052 27179 consensus_queue.cc:1048] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.750355 27054 raft_consensus.cc:1275] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.751595 27134 consensus_queue.cc:1048] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.760319 26980 raft_consensus.cc:1275] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.762275 27098 consensus_queue.cc:1048] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.779655 26980 raft_consensus.cc:1275] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.780901 27098 consensus_queue.cc:1048] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.790055 27054 raft_consensus.cc:1275] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.791640 27129 consensus_queue.cc:1048] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.845417 27054 raft_consensus.cc:1275] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.846755 27159 consensus_queue.cc:1048] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.855023 26904 raft_consensus.cc:1275] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.857023 27161 consensus_queue.cc:1048] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.987252 26803 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38846:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:09.989518 26803 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:10.042342 26889 tablet_service.cc:1511] Processing CreateTablet for tablet 7da255b50f1742859f03978bf73390fe (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:10.043691 26889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da255b50f1742859f03978bf73390fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.043424 26966 tablet_service.cc:1511] Processing CreateTablet for tablet 7da255b50f1742859f03978bf73390fe (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:10.044729 26966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da255b50f1742859f03978bf73390fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.045982 27040 tablet_service.cc:1511] Processing CreateTablet for tablet 7da255b50f1742859f03978bf73390fe (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:10.047355 27040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da255b50f1742859f03978bf73390fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.047138 26888 tablet_service.cc:1511] Processing CreateTablet for tablet 680e8e32e933465da9bdac21fc668398 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:10.048470 26888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680e8e32e933465da9bdac21fc668398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.064000 26970 tablet_service.cc:1511] Processing CreateTablet for tablet 680e8e32e933465da9bdac21fc668398 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:10.065580 26970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680e8e32e933465da9bdac21fc668398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.065997 27042 tablet_service.cc:1511] Processing CreateTablet for tablet 680e8e32e933465da9bdac21fc668398 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:10.067319 27042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680e8e32e933465da9bdac21fc668398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.070631 26968 tablet_service.cc:1511] Processing CreateTablet for tablet 59863737cc454e3e8daac0e73fccd7f2 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:10.071120 26887 tablet_service.cc:1511] Processing CreateTablet for tablet 59863737cc454e3e8daac0e73fccd7f2 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:10.072052 26968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59863737cc454e3e8daac0e73fccd7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.072391 26887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59863737cc454e3e8daac0e73fccd7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.075174 27044 tablet_service.cc:1511] Processing CreateTablet for tablet 59863737cc454e3e8daac0e73fccd7f2 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:10.076572 27044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59863737cc454e3e8daac0e73fccd7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.082540 26890 tablet_service.cc:1511] Processing CreateTablet for tablet abc4adc1e8434db884aa527cad0df2fc (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:10.084188 26890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc4adc1e8434db884aa527cad0df2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.097136 26967 tablet_service.cc:1511] Processing CreateTablet for tablet abc4adc1e8434db884aa527cad0df2fc (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:10.098743 26967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc4adc1e8434db884aa527cad0df2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.106959 27207 tablet_bootstrap.cc:492] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:10.109349 27041 tablet_service.cc:1511] Processing CreateTablet for tablet abc4adc1e8434db884aa527cad0df2fc (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:10.111353 27041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc4adc1e8434db884aa527cad0df2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.109053 27208 tablet_bootstrap.cc:492] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:10.116953 26888 tablet_service.cc:1511] Processing CreateTablet for tablet 56db4d61dc344508bae3ee8757a73e5d (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:10.118448 26888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56db4d61dc344508bae3ee8757a73e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.128379 27040 tablet_service.cc:1511] Processing CreateTablet for tablet 56db4d61dc344508bae3ee8757a73e5d (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:10.129908 27040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56db4d61dc344508bae3ee8757a73e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.129590 26889 tablet_service.cc:1511] Processing CreateTablet for tablet 211df838dab449f389ad249309668ba1 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:10.131153 26889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211df838dab449f389ad249309668ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.133265 27036 tablet_service.cc:1511] Processing CreateTablet for tablet 211df838dab449f389ad249309668ba1 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:10.135128 26891 tablet_service.cc:1511] Processing CreateTablet for tablet f03242e247e9400ca840f18849f6c582 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:10.136526 26891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f03242e247e9400ca840f18849f6c582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.138949 27036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211df838dab449f389ad249309668ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.140336 26970 tablet_service.cc:1511] Processing CreateTablet for tablet 211df838dab449f389ad249309668ba1 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:10.141876 26970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211df838dab449f389ad249309668ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.142472 27206 tablet_bootstrap.cc:492] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:10.144833 27207 tablet_bootstrap.cc:654] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.157383 26966 tablet_service.cc:1511] Processing CreateTablet for tablet f03242e247e9400ca840f18849f6c582 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:10.146344 27208 tablet_bootstrap.cc:654] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.158996 26966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f03242e247e9400ca840f18849f6c582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.160092 27037 tablet_service.cc:1511] Processing CreateTablet for tablet f03242e247e9400ca840f18849f6c582 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:10.161494 27037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f03242e247e9400ca840f18849f6c582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.165403 26962 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffa5a12575b4bed9b5526b84cc43a49 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:10.166985 26962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffa5a12575b4bed9b5526b84cc43a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.172945 27207 tablet_bootstrap.cc:492] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:10.161384 26890 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffa5a12575b4bed9b5526b84cc43a49 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:10.173571 27207 ts_tablet_manager.cc:1403] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 12:14:10.175031 26890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffa5a12575b4bed9b5526b84cc43a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.180358 27208 tablet_bootstrap.cc:492] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:10.180976 27208 ts_tablet_manager.cc:1403] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.072s	user 0.006s	sys 0.005s
I20260709 12:14:10.181221 27206 tablet_bootstrap.cc:654] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.184060 27208 raft_consensus.cc:359] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.184877 27208 raft_consensus.cc:385] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.185180 27208 raft_consensus.cc:740] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.187114 26968 tablet_service.cc:1511] Processing CreateTablet for tablet 56db4d61dc344508bae3ee8757a73e5d (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:10.188704 26968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56db4d61dc344508bae3ee8757a73e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.177436 27207 raft_consensus.cc:359] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.192940 27207 raft_consensus.cc:385] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.193343 27207 raft_consensus.cc:740] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.194638 27207 consensus_queue.cc:260] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.197193 27207 ts_tablet_manager.cc:1434] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:14:10.185932 27208 consensus_queue.cc:260] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.204059 27208 ts_tablet_manager.cc:1434] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 12:14:10.205152 27207 tablet_bootstrap.cc:492] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:10.212292 27208 tablet_bootstrap.cc:492] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:10.218118 27206 tablet_bootstrap.cc:492] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:10.218828 27206 ts_tablet_manager.cc:1403] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.000s
I20260709 12:14:10.220541 26889 tablet_service.cc:1511] Processing CreateTablet for tablet 3dcea95364ac40d88dadf83f17155d3c (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:10.221920 26889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dcea95364ac40d88dadf83f17155d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.224829 27206 raft_consensus.cc:359] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.229269 27206 raft_consensus.cc:385] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.229607 27206 raft_consensus.cc:740] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.230527 27206 consensus_queue.cc:260] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.232913 27207 tablet_bootstrap.cc:654] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:10.238405 26851 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:10.240818 27037 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffa5a12575b4bed9b5526b84cc43a49 (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:10.243635 27206 ts_tablet_manager.cc:1434] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:14:10.244663 27037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffa5a12575b4bed9b5526b84cc43a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.241262 26968 tablet_service.cc:1511] Processing CreateTablet for tablet 3dcea95364ac40d88dadf83f17155d3c (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:10.246302 26968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dcea95364ac40d88dadf83f17155d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.249607 27206 tablet_bootstrap.cc:492] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:10.243772 27208 tablet_bootstrap.cc:654] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.256174 27036 tablet_service.cc:1511] Processing CreateTablet for tablet 3dcea95364ac40d88dadf83f17155d3c (DEFAULT_TABLE table=soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:10.264159 27036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dcea95364ac40d88dadf83f17155d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.271806 27207 tablet_bootstrap.cc:492] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:10.272687 27207 ts_tablet_manager.cc:1403] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.015s
I20260709 12:14:10.275367 27206 tablet_bootstrap.cc:654] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.276194 27207 raft_consensus.cc:359] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.277096 27207 raft_consensus.cc:385] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.277451 27207 raft_consensus.cc:740] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.271800 27208 tablet_bootstrap.cc:492] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:10.279032 27208 ts_tablet_manager.cc:1403] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.001s
I20260709 12:14:10.278474 27207 consensus_queue.cc:260] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.282279 27208 raft_consensus.cc:359] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.283056 27208 raft_consensus.cc:385] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.283360 27208 raft_consensus.cc:740] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.284510 27207 ts_tablet_manager.cc:1434] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:14:10.284425 27208 consensus_queue.cc:260] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.285857 27207 tablet_bootstrap.cc:492] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:10.287206 27208 ts_tablet_manager.cc:1434] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:10.288480 27208 tablet_bootstrap.cc:492] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:10.292913 27207 tablet_bootstrap.cc:654] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.297289 27208 tablet_bootstrap.cc:654] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.299578 27206 tablet_bootstrap.cc:492] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:10.301313 27206 ts_tablet_manager.cc:1403] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.004s
I20260709 12:14:10.304374 27206 raft_consensus.cc:359] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.304935 27206 raft_consensus.cc:385] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.305008 27208 tablet_bootstrap.cc:492] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:10.305601 27208 ts_tablet_manager.cc:1403] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:14:10.306231 27206 raft_consensus.cc:740] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.307101 27206 consensus_queue.cc:260] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.308758 27208 raft_consensus.cc:359] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.309384 27208 raft_consensus.cc:385] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.309549 27206 ts_tablet_manager.cc:1434] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:10.309643 27208 raft_consensus.cc:740] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.310956 27206 tablet_bootstrap.cc:492] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:10.310726 27208 consensus_queue.cc:260] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.312770 27207 tablet_bootstrap.cc:492] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:10.313063 27208 ts_tablet_manager.cc:1434] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:14:10.313488 27207 ts_tablet_manager.cc:1403] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 12:14:10.314208 27208 tablet_bootstrap.cc:492] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:10.318514 27206 tablet_bootstrap.cc:654] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.320065 27207 raft_consensus.cc:359] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.322168 27207 raft_consensus.cc:385] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.322561 27207 raft_consensus.cc:740] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.323503 27207 consensus_queue.cc:260] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.327431 27208 tablet_bootstrap.cc:654] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.329412 27207 ts_tablet_manager.cc:1434] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 12:14:10.330958 27207 tablet_bootstrap.cc:492] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:10.335162 27206 tablet_bootstrap.cc:492] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:10.335794 27206 ts_tablet_manager.cc:1403] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 12:14:10.336458 27208 tablet_bootstrap.cc:492] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:10.337046 27208 ts_tablet_manager.cc:1403] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 12:14:10.339056 27206 raft_consensus.cc:359] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.339954 27206 raft_consensus.cc:385] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.340266 27206 raft_consensus.cc:740] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.340564 27207 tablet_bootstrap.cc:654] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.340152 27208 raft_consensus.cc:359] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.341217 27208 raft_consensus.cc:385] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.341581 27208 raft_consensus.cc:740] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.341324 27206 consensus_queue.cc:260] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.342465 27208 consensus_queue.cc:260] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.344129 27206 ts_tablet_manager.cc:1434] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:10.345381 27206 tablet_bootstrap.cc:492] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:10.351099 27208 ts_tablet_manager.cc:1434] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:14:10.354687 27208 tablet_bootstrap.cc:492] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:10.355407 27207 tablet_bootstrap.cc:492] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:10.356024 27207 ts_tablet_manager.cc:1403] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.005s
I20260709 12:14:10.352386 27206 tablet_bootstrap.cc:654] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.359135 27191 raft_consensus.cc:493] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.359301 27207 raft_consensus.cc:359] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.359747 27191 raft_consensus.cc:515] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.360178 27207 raft_consensus.cc:385] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.360646 27207 raft_consensus.cc:740] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.361647 27207 consensus_queue.cc:260] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.362067 27191 leader_election.cc:290] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.364317 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da255b50f1742859f03978bf73390fe" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:10.365077 27054 raft_consensus.cc:2468] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:10.365502 27208 tablet_bootstrap.cc:654] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.367306 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da255b50f1742859f03978bf73390fe" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:10.368016 26904 raft_consensus.cc:2468] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:10.371668 26945 leader_election.cc:304] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.372387 27200 raft_consensus.cc:2804] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.372771 27200 raft_consensus.cc:493] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.373090 27200 raft_consensus.cc:3060] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.373943 27207 ts_tablet_manager.cc:1434] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:14:10.375234 27207 tablet_bootstrap.cc:492] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:10.378340 27208 tablet_bootstrap.cc:492] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:10.379009 27208 ts_tablet_manager.cc:1403] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 12:14:10.381758 27207 tablet_bootstrap.cc:654] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.382222 27208 raft_consensus.cc:359] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.382982 27208 raft_consensus.cc:385] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.383272 27208 raft_consensus.cc:740] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.383983 27208 consensus_queue.cc:260] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.384002 27200 raft_consensus.cc:515] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.385749 27208 ts_tablet_manager.cc:1434] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:14:10.387025 27208 tablet_bootstrap.cc:492] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:10.388513 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da255b50f1742859f03978bf73390fe" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:10.389006 27206 tablet_bootstrap.cc:492] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:10.389282 27054 raft_consensus.cc:3060] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.389556 27206 ts_tablet_manager.cc:1403] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.008s
I20260709 12:14:10.392303 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da255b50f1742859f03978bf73390fe" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:10.392882 27206 raft_consensus.cc:359] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.395462 27208 tablet_bootstrap.cc:654] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.395655 27206 raft_consensus.cc:385] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.396044 27206 raft_consensus.cc:740] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.396884 27200 leader_election.cc:290] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.396812 27206 consensus_queue.cc:260] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.398388 27054 raft_consensus.cc:2468] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:10.400410 27206 ts_tablet_manager.cc:1434] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:10.393225 26904 raft_consensus.cc:3060] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.401513 27206 tablet_bootstrap.cc:492] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:10.402513 26945 leader_election.cc:304] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.403522 27200 raft_consensus.cc:2804] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.404026 27200 raft_consensus.cc:697] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:10.405186 27200 consensus_queue.cc:237] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.409358 27206 tablet_bootstrap.cc:654] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.411661 27208 tablet_bootstrap.cc:492] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:10.412295 27208 ts_tablet_manager.cc:1403] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 12:14:10.412426 27207 tablet_bootstrap.cc:492] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:10.413017 27207 ts_tablet_manager.cc:1403] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 12:14:10.416047 27207 raft_consensus.cc:359] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.416795 27207 raft_consensus.cc:385] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.417088 27207 raft_consensus.cc:740] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.417549 27208 raft_consensus.cc:359] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.418418 27208 raft_consensus.cc:385] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.417966 27207 consensus_queue.cc:260] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.418834 27208 raft_consensus.cc:740] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.419737 27208 consensus_queue.cc:260] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.429144 27208 ts_tablet_manager.cc:1434] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:14:10.430302 27208 tablet_bootstrap.cc:492] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:10.435640 27207 ts_tablet_manager.cc:1434] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:14:10.436959 27208 tablet_bootstrap.cc:654] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.444231 26904 raft_consensus.cc:2468] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:10.449362 27208 tablet_bootstrap.cc:492] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:10.450032 27208 ts_tablet_manager.cc:1403] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 12:14:10.450420 27206 tablet_bootstrap.cc:492] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:10.451020 27206 ts_tablet_manager.cc:1403] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.018s
I20260709 12:14:10.451661 27207 tablet_bootstrap.cc:492] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:10.451324 26802 catalog_manager.cc:5697] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 0 to 1, leader changed from <none> to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 1 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.453243 27208 raft_consensus.cc:359] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.454118 27208 raft_consensus.cc:385] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.454612 27208 raft_consensus.cc:740] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.454268 27206 raft_consensus.cc:359] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.455108 27206 raft_consensus.cc:385] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.455407 27206 raft_consensus.cc:740] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.455507 27208 consensus_queue.cc:260] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.458093 27208 ts_tablet_manager.cc:1434] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:14:10.459376 27208 tablet_bootstrap.cc:492] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:10.456362 27206 consensus_queue.cc:260] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.462250 27206 ts_tablet_manager.cc:1434] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:14:10.463377 27206 tablet_bootstrap.cc:492] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:10.466812 27208 tablet_bootstrap.cc:654] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.469551 27207 tablet_bootstrap.cc:654] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.471431 27206 tablet_bootstrap.cc:654] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.490500 27207 tablet_bootstrap.cc:492] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:10.491176 27207 ts_tablet_manager.cc:1403] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.005s
I20260709 12:14:10.492383 27206 tablet_bootstrap.cc:492] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:10.493096 27206 ts_tablet_manager.cc:1403] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.005s
I20260709 12:14:10.494786 27207 raft_consensus.cc:359] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.495698 27207 raft_consensus.cc:385] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.496074 27207 raft_consensus.cc:740] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.496665 27206 raft_consensus.cc:359] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.497696 27206 raft_consensus.cc:385] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.497081 27207 consensus_queue.cc:260] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.498023 27206 raft_consensus.cc:740] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.499574 27206 consensus_queue.cc:260] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.502183 27206 ts_tablet_manager.cc:1434] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:14:10.503451 27206 tablet_bootstrap.cc:492] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:10.511003 27206 tablet_bootstrap.cc:654] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.514060 27200 raft_consensus.cc:493] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.514798 27200 raft_consensus.cc:515] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.517220 27200 leader_election.cc:290] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.518441 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211df838dab449f389ad249309668ba1" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:10.518705 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211df838dab449f389ad249309668ba1" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:10.519102 26904 raft_consensus.cc:2468] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:10.519440 27054 raft_consensus.cc:2468] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 0.
I20260709 12:14:10.520460 26944 leader_election.cc:304] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.520915 27208 tablet_bootstrap.cc:492] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:10.521540 27208 ts_tablet_manager.cc:1403] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.062s	user 0.029s	sys 0.020s
I20260709 12:14:10.521541 27200 raft_consensus.cc:2804] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.522177 27200 raft_consensus.cc:493] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.522535 27200 raft_consensus.cc:3060] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.523602 27207 ts_tablet_manager.cc:1434] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:14:10.524406 27206 tablet_bootstrap.cc:492] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:10.524842 27207 tablet_bootstrap.cc:492] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:10.524962 27206 ts_tablet_manager.cc:1403] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:14:10.524993 27208 raft_consensus.cc:359] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.525902 27208 raft_consensus.cc:385] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.526207 27208 raft_consensus.cc:740] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.526921 27208 consensus_queue.cc:260] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.529162 27208 ts_tablet_manager.cc:1434] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:14:10.530582 27208 tablet_bootstrap.cc:492] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c: Bootstrap starting.
I20260709 12:14:10.532861 27207 tablet_bootstrap.cc:654] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.536876 27230 raft_consensus.cc:493] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.537331 27208 tablet_bootstrap.cc:654] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.537465 27230 raft_consensus.cc:515] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.541522 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:10.542423 26980 raft_consensus.cc:2468] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:10.543859 26868 leader_election.cc:304] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.544759 27098 raft_consensus.cc:2804] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.545118 27098 raft_consensus.cc:493] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.545433 27098 raft_consensus.cc:3060] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.539937 27230 leader_election.cc:290] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.551040 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:10.551748 27206 raft_consensus.cc:359] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.552000 27054 raft_consensus.cc:2468] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:10.552546 27206 raft_consensus.cc:385] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.552896 27206 raft_consensus.cc:740] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.550966 27200 raft_consensus.cc:515] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.553946 27206 consensus_queue.cc:260] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.556370 27206 ts_tablet_manager.cc:1434] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:14:10.557835 27206 tablet_bootstrap.cc:492] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:10.560595 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211df838dab449f389ad249309668ba1" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:10.561399 27054 raft_consensus.cc:3060] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.557834 27098 raft_consensus.cc:515] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.567255 27205 raft_consensus.cc:493] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.567807 27205 raft_consensus.cc:515] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.569339 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:10.570021 26980 raft_consensus.cc:3060] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.572690 27200 leader_election.cc:290] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.572966 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:10.575253 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:10.576361 27054 raft_consensus.cc:2468] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
W20260709 12:14:10.576952 27018 leader_election.cc:343] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.577889 27234 raft_consensus.cc:493] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.578428 26945 leader_election.cc:304] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.580142 27234 raft_consensus.cc:515] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.580541 27200 raft_consensus.cc:2804] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.581413 27200 raft_consensus.cc:697] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:10.582654 27234 leader_election.cc:290] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:10.582472 27200 consensus_queue.cc:237] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.583335 27234 raft_consensus.cc:493] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.565954 27206 tablet_bootstrap.cc:654] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.583851 27234 raft_consensus.cc:515] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.570037 27205 leader_election.cc:290] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:10.579320 27208 tablet_bootstrap.cc:492] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c: No bootstrap required, opened a new log
I20260709 12:14:10.579412 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211df838dab449f389ad249309668ba1" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:10.585664 27208 ts_tablet_manager.cc:1403] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.028s
I20260709 12:14:10.585755 26904 raft_consensus.cc:3060] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.587800 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:10.588639 26905 raft_consensus.cc:2468] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:10.589344 27208 raft_consensus.cc:359] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.590121 27207 tablet_bootstrap.cc:492] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:10.590261 27018 leader_election.cc:304] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:10.590783 27207 ts_tablet_manager.cc:1403] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.004s
I20260709 12:14:10.590202 27208 raft_consensus.cc:385] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.592001 27208 raft_consensus.cc:740] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.592854 27208 consensus_queue.cc:260] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.591449 27205 raft_consensus.cc:2804] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.594728 27205 raft_consensus.cc:493] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.595077 27208 ts_tablet_manager.cc:1434] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:14:10.595129 27205 raft_consensus.cc:3060] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.599198 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680e8e32e933465da9bdac21fc668398" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:10.600087 26905 raft_consensus.cc:2468] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:10.601346 27207 raft_consensus.cc:359] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.598019 27234 leader_election.cc:290] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:10.578696 26980 raft_consensus.cc:2468] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:10.602666 27018 leader_election.cc:304] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:10.602185 27207 raft_consensus.cc:385] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.603538 27207 raft_consensus.cc:740] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.603782 26868 leader_election.cc:304] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.604063 27234 raft_consensus.cc:2804] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.595402 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:10.604676 27230 raft_consensus.cc:2804] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.605206 27207 consensus_queue.cc:260] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.605726 26904 raft_consensus.cc:2468] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:10.606051 27054 raft_consensus.cc:3060] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.604450 27234 raft_consensus.cc:493] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.607046 27234 raft_consensus.cc:3060] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.579269 27098 leader_election.cc:290] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.616299 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:10.617077 26980 raft_consensus.cc:2468] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:10.617889 27205 raft_consensus.cc:515] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.618146 27234 raft_consensus.cc:515] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.617100 27207 ts_tablet_manager.cc:1434] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:14:10.619302 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680e8e32e933465da9bdac21fc668398" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:10.620136 27207 tablet_bootstrap.cc:492] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:10.620114 26979 raft_consensus.cc:2468] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
W20260709 12:14:10.621835 27017 leader_election.cc:343] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.623507 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:10.623646 27017 leader_election.cc:304] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c; no voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:10.624384 26904 raft_consensus.cc:3060] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.627416 27207 tablet_bootstrap.cc:654] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.627198 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:10.622469 27205 leader_election.cc:290] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:10.629980 27234 leader_election.cc:290] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:10.627957 26980 raft_consensus.cc:3060] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.630262 27230 raft_consensus.cc:697] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:10.630827 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680e8e32e933465da9bdac21fc668398" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:10.631460 26905 raft_consensus.cc:3060] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.631740 27230 consensus_queue.cc:237] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.637210 26904 raft_consensus.cc:2468] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:10.638274 26980 raft_consensus.cc:2468] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:10.627987 27235 raft_consensus.cc:2749] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.648129 27018 leader_election.cc:304] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:10.648875 26800 catalog_manager.cc:5697] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 0 to 1, leader changed from <none> to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 1 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.651609 27234 raft_consensus.cc:2804] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.651684 27054 raft_consensus.cc:2468] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:10.652413 27234 raft_consensus.cc:697] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:10.653188 27234 consensus_queue.cc:237] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.660462 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680e8e32e933465da9bdac21fc668398" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:10.662634 26980 raft_consensus.cc:3060] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.658852 26905 raft_consensus.cc:2468] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:10.669384 27018 leader_election.cc:304] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:10.671680 27235 raft_consensus.cc:2804] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.672219 27235 raft_consensus.cc:697] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:10.673105 27235 consensus_queue.cc:237] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.673674 27206 tablet_bootstrap.cc:492] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:10.674413 27206 ts_tablet_manager.cc:1403] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.117s	user 0.028s	sys 0.022s
I20260709 12:14:10.676566 26980 raft_consensus.cc:2468] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:10.684000 27207 tablet_bootstrap.cc:492] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:10.684722 27207 ts_tablet_manager.cc:1403] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.012s
I20260709 12:14:10.684005 26799 catalog_manager.cc:5697] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.686803 27206 raft_consensus.cc:359] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.687103 27207 raft_consensus.cc:359] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.687781 27207 raft_consensus.cc:385] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.688071 27207 raft_consensus.cc:740] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.687572 27206 raft_consensus.cc:385] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.689230 27206 raft_consensus.cc:740] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.688848 27207 consensus_queue.cc:260] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.690407 27206 consensus_queue.cc:260] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.691160 27207 ts_tablet_manager.cc:1434] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:10.692261 27207 tablet_bootstrap.cc:492] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4: Bootstrap starting.
I20260709 12:14:10.694310 27237 raft_consensus.cc:493] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.694918 27237 raft_consensus.cc:515] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.697150 27237 leader_election.cc:290] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.697250 27207 tablet_bootstrap.cc:654] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.698081 27206 ts_tablet_manager.cc:1434] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:14:10.699229 27206 tablet_bootstrap.cc:492] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d: Bootstrap starting.
I20260709 12:14:10.699981 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db4d61dc344508bae3ee8757a73e5d" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:10.700685 26980 raft_consensus.cc:2468] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:10.701957 26868 leader_election.cc:304] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.703423 27237 raft_consensus.cc:2804] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.703581 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db4d61dc344508bae3ee8757a73e5d" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:10.703986 27237 raft_consensus.cc:493] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.704306 27054 raft_consensus.cc:2468] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:10.704406 27237 raft_consensus.cc:3060] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.704687 27207 tablet_bootstrap.cc:492] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4: No bootstrap required, opened a new log
I20260709 12:14:10.705299 27207 ts_tablet_manager.cc:1403] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.005s
I20260709 12:14:10.706753 27206 tablet_bootstrap.cc:654] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.708011 27207 raft_consensus.cc:359] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.708597 27207 raft_consensus.cc:385] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.708796 27207 raft_consensus.cc:740] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.709394 27207 consensus_queue.cc:260] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.710971 27207 ts_tablet_manager.cc:1434] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:10.713668 27206 tablet_bootstrap.cc:492] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d: No bootstrap required, opened a new log
I20260709 12:14:10.713822 27237 raft_consensus.cc:515] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.714320 27206 ts_tablet_manager.cc:1403] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:14:10.715087 26800 catalog_manager.cc:5697] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.717212 27206 raft_consensus.cc:359] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.717976 27206 raft_consensus.cc:385] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.718271 27206 raft_consensus.cc:740] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.719058 27206 consensus_queue.cc:260] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.721544 27206 ts_tablet_manager.cc:1434] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:10.722836 27230 raft_consensus.cc:493] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.722477 26802 catalog_manager.cc:5697] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.723368 27230 raft_consensus.cc:515] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.725623 27230 leader_election.cc:290] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.726462 27237 leader_election.cc:290] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.727572 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:10.728034 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db4d61dc344508bae3ee8757a73e5d" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:10.728328 26980 raft_consensus.cc:2468] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:10.728691 26979 raft_consensus.cc:3060] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.729708 26868 leader_election.cc:304] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.730656 27237 raft_consensus.cc:2804] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.731017 27237 raft_consensus.cc:493] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.731344 27237 raft_consensus.cc:3060] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.734040 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db4d61dc344508bae3ee8757a73e5d" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:10.734817 27053 raft_consensus.cc:3060] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.734707 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:10.735663 27054 raft_consensus.cc:2468] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 0.
I20260709 12:14:10.738611 26979 raft_consensus.cc:2468] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:10.740203 26868 leader_election.cc:304] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.740962 27230 raft_consensus.cc:2804] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.741374 27230 raft_consensus.cc:697] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:10.742233 27230 consensus_queue.cc:237] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.743038 27053 raft_consensus.cc:2468] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:10.743075 27237 raft_consensus.cc:515] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.745736 27237 leader_election.cc:290] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:10.747545 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:10.748030 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:10.748333 27053 raft_consensus.cc:3060] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.748809 26979 raft_consensus.cc:3060] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.754712 27053 raft_consensus.cc:2468] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:10.755839 26870 leader_election.cc:304] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:10.756517 27230 raft_consensus.cc:2804] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.756917 27230 raft_consensus.cc:697] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:10.757280 26979 raft_consensus.cc:2468] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 1.
I20260709 12:14:10.757632 27230 consensus_queue.cc:237] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.761556 26799 catalog_manager.cc:5697] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.774785 26799 catalog_manager.cc:5697] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 1 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.831806 27235 raft_consensus.cc:493] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.832377 27235 raft_consensus.cc:515] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.834192 27235 leader_election.cc:290] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:10.835009 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcea95364ac40d88dadf83f17155d3c" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:10.835197 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcea95364ac40d88dadf83f17155d3c" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:10.835700 26905 raft_consensus.cc:2468] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:10.835974 26979 raft_consensus.cc:2468] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:10.836733 27018 leader_election.cc:304] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:10.837456 27235 raft_consensus.cc:2804] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.837895 27235 raft_consensus.cc:493] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.838218 27235 raft_consensus.cc:3060] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.843789 27234 raft_consensus.cc:493] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.844067 27235 raft_consensus.cc:515] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.844445 27234 raft_consensus.cc:515] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.846455 27234 leader_election.cc:290] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:10.847316 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcea95364ac40d88dadf83f17155d3c" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:10.847509 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03242e247e9400ca840f18849f6c582" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:10.848008 26905 raft_consensus.cc:3060] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.848376 27235 leader_election.cc:290] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:10.848187 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03242e247e9400ca840f18849f6c582" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:10.849188 26980 raft_consensus.cc:2468] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:10.848255 26904 raft_consensus.cc:2468] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 0.
I20260709 12:14:10.849473 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcea95364ac40d88dadf83f17155d3c" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:10.850538 27017 leader_election.cc:304] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:10.850579 26979 raft_consensus.cc:3060] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.852059 27235 raft_consensus.cc:2804] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.852509 27235 raft_consensus.cc:493] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.852911 27235 raft_consensus.cc:3060] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.856338 26905 raft_consensus.cc:2468] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:10.857761 26979 raft_consensus.cc:2468] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:10.857666 27018 leader_election.cc:304] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:10.858744 27234 raft_consensus.cc:2804] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.859246 27234 raft_consensus.cc:697] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:10.860039 27234 consensus_queue.cc:237] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.860170 27235 raft_consensus.cc:515] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.862145 27235 leader_election.cc:290] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:10.863036 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03242e247e9400ca840f18849f6c582" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:10.863301 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03242e247e9400ca840f18849f6c582" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:10.864883 26979 raft_consensus.cc:3060] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.864264 26905 raft_consensus.cc:3060] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.869479 26799 catalog_manager.cc:5697] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.872879 26905 raft_consensus.cc:2468] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:10.874372 26979 raft_consensus.cc:2468] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 1.
I20260709 12:14:10.874850 27018 leader_election.cc:304] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:10.875759 27235 raft_consensus.cc:2804] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.876295 27235 raft_consensus.cc:697] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:10.877195 27235 consensus_queue.cc:237] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:10.884999 26799 catalog_manager.cc:5697] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 1 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.963286 27200 consensus_queue.cc:1048] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:10.975087 27191 consensus_queue.cc:1048] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:10.998262 26979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7da255b50f1742859f03978bf73390fe"
dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
mode: GRACEFUL
new_leader_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:39514
I20260709 12:14:10.998826 26979 raft_consensus.cc:606] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Received request to transfer leadership to TS b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:11.004276 27053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "680e8e32e933465da9bdac21fc668398"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
mode: GRACEFUL
new_leader_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:47302
I20260709 12:14:11.004794 27053 raft_consensus.cc:606] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Received request to transfer leadership to TS b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:11.013051 27053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
mode: GRACEFUL
new_leader_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:47302
I20260709 12:14:11.013572 27053 raft_consensus.cc:606] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Received request to transfer leadership to TS b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:11.018640 26905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56db4d61dc344508bae3ee8757a73e5d"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
mode: GRACEFUL
new_leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
 from {username='slave'} at 127.0.0.1:45690
I20260709 12:14:11.019202 26905 raft_consensus.cc:606] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Received request to transfer leadership to TS b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:11.027117 27053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f03242e247e9400ca840f18849f6c582"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
mode: GRACEFUL
new_leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
 from {username='slave'} at 127.0.0.1:47302
I20260709 12:14:11.027644 27053 raft_consensus.cc:606] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Received request to transfer leadership to TS b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:11.032737 26905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
mode: GRACEFUL
new_leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
 from {username='slave'} at 127.0.0.1:45690
I20260709 12:14:11.033284 26905 raft_consensus.cc:606] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Received request to transfer leadership to TS b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:11.058068 27191 consensus_queue.cc:1048] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.070351 27257 consensus_queue.cc:1048] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.078325 27234 consensus_queue.cc:1048] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.091312 27234 consensus_queue.cc:1048] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.100018 27235 raft_consensus.cc:993] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c: : Instructing follower b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:11.100535 27235 raft_consensus.cc:1081] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Signalling peer b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:11.102433 26905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:45678
I20260709 12:14:11.102921 26905 raft_consensus.cc:493] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.103233 26905 raft_consensus.cc:3060] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.111159 26905 raft_consensus.cc:515] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.112814 26905 leader_election.cc:290] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:11.113880 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:11.113759 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:11.114667 27053 raft_consensus.cc:3055] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.114741 26979 raft_consensus.cc:3060] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.115077 27053 raft_consensus.cc:740] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:11.115960 27053 consensus_queue.cc:260] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.117342 27053 raft_consensus.cc:3060] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.120119 27205 consensus_queue.cc:1048] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.122898 26979 raft_consensus.cc:2468] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:11.124248 26868 leader_election.cc:304] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:11.125223 27230 raft_consensus.cc:2804] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.125783 27230 raft_consensus.cc:697] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:11.125855 27053 raft_consensus.cc:2468] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:11.126780 27230 consensus_queue.cc:237] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.137244 27234 consensus_queue.cc:1048] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.139704 26802 catalog_manager.cc:5697] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 1 to 2, leader changed from 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67) to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.141661 27237 consensus_queue.cc:1048] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.146904 27234 raft_consensus.cc:993] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c: : Instructing follower b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:11.147420 27205 raft_consensus.cc:1081] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Signalling peer b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:11.149087 26905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "680e8e32e933465da9bdac21fc668398"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:45678
I20260709 12:14:11.149590 26905 raft_consensus.cc:493] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.149900 26905 raft_consensus.cc:3060] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.156060 26905 raft_consensus.cc:515] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.159008 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680e8e32e933465da9bdac21fc668398" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:11.159658 26979 raft_consensus.cc:3060] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.165520 26905 leader_election.cc:290] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:11.167336 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680e8e32e933465da9bdac21fc668398" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:11.167972 27054 raft_consensus.cc:3055] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.167747 26979 raft_consensus.cc:2468] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:11.168427 27054 raft_consensus.cc:740] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:11.169329 26868 leader_election.cc:304] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:11.170141 27238 raft_consensus.cc:2804] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.170087 27054 consensus_queue.cc:260] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.170776 27238 raft_consensus.cc:697] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:11.171617 27054 raft_consensus.cc:3060] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.171690 27238 consensus_queue.cc:237] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.173239 27237 consensus_queue.cc:1048] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.181563 27054 raft_consensus.cc:2468] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:11.189148 26800 catalog_manager.cc:5697] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 1 to 2, leader changed from 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67) to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.196288 27230 consensus_queue.cc:1048] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.210929 27238 consensus_queue.cc:1048] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.220014 27230 raft_consensus.cc:993] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4: : Instructing follower b4a981f2bf1c4261806dfea3d38bf18d to start an election
I20260709 12:14:11.220490 27230 raft_consensus.cc:1081] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Signalling peer b4a981f2bf1c4261806dfea3d38bf18d to start an election
I20260709 12:14:11.221951 26980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56db4d61dc344508bae3ee8757a73e5d"
dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
 from {username='slave'} at 127.0.0.1:39506
I20260709 12:14:11.222618 26980 raft_consensus.cc:493] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.222985 26980 raft_consensus.cc:3060] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.228225 26980 raft_consensus.cc:515] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.229715 26980 leader_election.cc:290] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:11.230867 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db4d61dc344508bae3ee8757a73e5d" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:11.231400 27053 raft_consensus.cc:3060] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.230754 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56db4d61dc344508bae3ee8757a73e5d" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:11.232064 26905 raft_consensus.cc:3055] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.232391 26905 raft_consensus.cc:740] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:11.233214 26905 consensus_queue.cc:260] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.234556 26905 raft_consensus.cc:3060] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.238807 27053 raft_consensus.cc:2468] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 2.
I20260709 12:14:11.240326 26945 leader_election.cc:304] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:11.241191 27257 raft_consensus.cc:2804] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.241719 27257 raft_consensus.cc:697] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 2 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:11.241926 26905 raft_consensus.cc:2468] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 2.
I20260709 12:14:11.242702 27257 consensus_queue.cc:237] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.250308 26800 catalog_manager.cc:5697] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 1 to 2, leader changed from b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65) to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 2 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.262029 27205 consensus_queue.cc:1048] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.281436 27234 consensus_queue.cc:1048] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.400810 27234 consensus_queue.cc:1048] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.503294 27205 raft_consensus.cc:993] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c: : Instructing follower b4a981f2bf1c4261806dfea3d38bf18d to start an election
I20260709 12:14:11.504040 27205 raft_consensus.cc:1081] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Signalling peer b4a981f2bf1c4261806dfea3d38bf18d to start an election
I20260709 12:14:11.512166 26980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f03242e247e9400ca840f18849f6c582"
dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
 from {username='slave'} at 127.0.0.1:39500
I20260709 12:14:11.513033 26980 raft_consensus.cc:493] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.513475 26980 raft_consensus.cc:3060] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.575795 27234 consensus_queue.cc:1048] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.597468 26980 raft_consensus.cc:515] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.601001 26980 leader_election.cc:290] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:11.603070 27053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03242e247e9400ca840f18849f6c582" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:11.603866 27053 raft_consensus.cc:3055] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.604171 27053 raft_consensus.cc:740] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:11.605597 27053 consensus_queue.cc:260] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:11.609021 27053 raft_consensus.cc:3060] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.625087 27053 raft_consensus.cc:2468] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 2.
W20260709 12:14:12.020700 27018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.076314 27018 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:33181, user_credentials={real_user=slave}} blocked reactor thread for 50796.8us
I20260709 12:14:12.080260 27054 raft_consensus.cc:1275] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.081658 27049 raft_consensus.cc:1275] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.084394 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03242e247e9400ca840f18849f6c582" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:12.085068 26905 raft_consensus.cc:3060] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.087306 26903 raft_consensus.cc:1275] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.088774 26978 raft_consensus.cc:1275] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.090806 26976 raft_consensus.cc:1275] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.087141 27275 consensus_queue.cc:1048] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.095957 27274 consensus_queue.cc:1048] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:12.096385 27200 consensus_queue.cc:1048] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:12.097317 27275 consensus_queue.cc:1048] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.098999 27275 consensus_queue.cc:1048] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.104959 26905 raft_consensus.cc:2468] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 2.
I20260709 12:14:12.107455 27277 consensus_queue.cc:1048] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:12.125785 26945 leader_election.cc:304] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:12.130788 27271 raft_consensus.cc:2804] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:12.131316 27271 raft_consensus.cc:697] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:12.132495 27271 consensus_queue.cc:237] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
W20260709 12:14:12.136894 26945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.67:46459, user_credentials={real_user=slave}} blocked reactor thread for 510350us
I20260709 12:14:12.146725 27049 raft_consensus.cc:1275] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.151043 27271 consensus_queue.cc:1048] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:12.223815 27238 raft_consensus.cc:993] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4: : Instructing follower b4a981f2bf1c4261806dfea3d38bf18d to start an election
I20260709 12:14:12.224468 27238 raft_consensus.cc:1081] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Signalling peer b4a981f2bf1c4261806dfea3d38bf18d to start an election
W20260709 12:14:12.228585 26944 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.191.65:33181, user_credentials={real_user=slave}} blocked reactor thread for 117102us
I20260709 12:14:12.236534 27191 raft_consensus.cc:993] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d: : Instructing follower b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:12.237205 27191 raft_consensus.cc:1081] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Signalling peer b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:12.252868 26980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49"
dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
 from {username='slave'} at 127.0.0.1:39506
I20260709 12:14:12.253638 26980 raft_consensus.cc:493] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:12.254032 26980 raft_consensus.cc:3060] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.255563 26904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7da255b50f1742859f03978bf73390fe"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:45680
I20260709 12:14:12.256301 26904 raft_consensus.cc:493] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:12.256703 26904 raft_consensus.cc:3060] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.264391 26980 raft_consensus.cc:515] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:12.271934 26980 leader_election.cc:290] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:12.275651 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:12.277163 27049 raft_consensus.cc:3060] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.283594 26977 raft_consensus.cc:1240] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Rejecting Update request from peer b0598be35f1b49ddb4d91def97f830e4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:12.287029 27276 consensus_queue.cc:1059] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.288040 27276 raft_consensus.cc:3055] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:12.288393 27276 raft_consensus.cc:740] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:12.290585 26905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffa5a12575b4bed9b5526b84cc43a49" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:12.289577 27276 consensus_queue.cc:260] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:12.300895 27276 raft_consensus.cc:3060] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.297900 26904 raft_consensus.cc:515] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:12.312865 27049 raft_consensus.cc:2468] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 2.
I20260709 12:14:12.317135 26975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da255b50f1742859f03978bf73390fe" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:12.318836 27048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da255b50f1742859f03978bf73390fe" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:12.325858 27048 raft_consensus.cc:3060] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.326072 26945 leader_election.cc:304] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:12.327140 27271 raft_consensus.cc:2804] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:12.327646 27271 raft_consensus.cc:697] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:12.328017 27053 raft_consensus.cc:1240] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Rejecting Update request from peer b0598be35f1b49ddb4d91def97f830e4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:12.328622 27271 consensus_queue.cc:237] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:12.324476 26904 leader_election.cc:290] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:12.332976 26975 raft_consensus.cc:3055] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:12.333449 26975 raft_consensus.cc:740] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:12.334668 26975 consensus_queue.cc:260] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:12.336211 26975 raft_consensus.cc:3060] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.345301 26799 catalog_manager.cc:5697] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 1 to 2, leader changed from 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67) to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 2 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.339967 27048 raft_consensus.cc:2468] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:12.346832 26905 raft_consensus.cc:2468] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 2.
I20260709 12:14:12.347498 26870 leader_election.cc:304] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:12.348712 27276 raft_consensus.cc:2804] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:12.349964 27276 raft_consensus.cc:697] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:12.351082 27276 consensus_queue.cc:237] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:12.358601 26975 raft_consensus.cc:2468] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:12.381613 26801 catalog_manager.cc:5697] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 1 to 2, leader changed from b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65) to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 2 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.382342 26799 catalog_manager.cc:5697] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 1 to 2, leader changed from b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66) to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 2 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.606849 27049 raft_consensus.cc:1275] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.608050 27200 consensus_queue.cc:1048] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.618790 26905 raft_consensus.cc:1275] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.620596 27200 consensus_queue.cc:1048] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.731988 27049 raft_consensus.cc:1275] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.733505 27278 consensus_queue.cc:1048] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.745385 26975 raft_consensus.cc:1275] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.746989 27278 consensus_queue.cc:1048] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.751616 26905 raft_consensus.cc:1275] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.753089 27257 consensus_queue.cc:1048] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:12.764166 27049 raft_consensus.cc:1275] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.765910 27257 consensus_queue.cc:1048] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:13.069437 26926 debug-util.cc:398] Leaking SignalData structure 0x7b080003a8a0 after lost signal to thread 16128
W20260709 12:14:13.070581 26926 debug-util.cc:398] Leaking SignalData structure 0x7b080021ad20 after lost signal to thread 26837
W20260709 12:14:13.071707 26926 debug-util.cc:398] Leaking SignalData structure 0x7b080022e6c0 after lost signal to thread 26929
W20260709 12:14:13.072692 26926 debug-util.cc:398] Leaking SignalData structure 0x7b0800238580 after lost signal to thread 27004
W20260709 12:14:13.073865 26926 debug-util.cc:398] Leaking SignalData structure 0x7b080025b260 after lost signal to thread 27078
I20260709 12:14:14.348333 26802 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38846:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:14:14.377748 26802 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38846:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
W20260709 12:14:14.497635 27311 log.cc:927] Time spent T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4: Append to log took a long time: real 0.060s	user 0.000s	sys 0.004s
I20260709 12:14:14.514335 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:14.542596 26944 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:33181, user_credentials={real_user=slave}} blocked reactor thread for 44387.1us
W20260709 12:14:14.555264 26870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:46459, user_credentials={real_user=slave}} blocked reactor thread for 49806.9us
I20260709 12:14:14.599745 27345 tablet.cc:1724] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:14.699054 26944 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:33181, user_credentials={real_user=slave}} blocked reactor thread for 65614.5us
I20260709 12:14:14.717485 27338 tablet.cc:1724] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.744200 27348 tablet.cc:1724] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.748904 27356 tablet.cc:1724] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.733764 27343 tablet.cc:1724] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.739494 27347 tablet.cc:1724] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:14.760694 27336 log.cc:927] Time spent T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:14:14.776274 26945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:46459, user_credentials={real_user=slave}} blocked reactor thread for 58062.6us
I20260709 12:14:14.783687 27365 tablet.cc:1724] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.787653 27363 tablet.cc:1724] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.791229 27362 tablet.cc:1724] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.806552 27362 tablet.cc:1724] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.826997 27368 tablet.cc:1724] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.828948 27359 tablet.cc:1724] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.854246 27345 tablet.cc:1724] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.813455 27366 tablet.cc:1724] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.867799 27356 tablet.cc:1724] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.878114 27363 tablet.cc:1724] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.907033 26975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1845b4fc4d784696b1b684d970353400"
dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
mode: GRACEFUL
new_leader_uuid: "448cf7456ed247c5aed55ba83537dd8c"
 from {username='slave'} at 127.0.0.1:47554
I20260709 12:14:14.907895 26975 raft_consensus.cc:606] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Received request to transfer leadership to TS 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:14.909672 27347 tablet.cc:1724] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.919916 27343 tablet.cc:1724] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.846419 27365 tablet.cc:1724] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.949036 27363 tablet.cc:1724] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.971293 27366 tablet.cc:1724] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.949366 27338 tablet.cc:1724] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:14.984432 27359 tablet.cc:1724] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:15.016726 27359 tablet.cc:1724] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:15.028612 27348 tablet.cc:1724] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:15.038663 27365 tablet.cc:1724] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:15.038930 27362 tablet.cc:1724] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:15.062261 26904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
mode: GRACEFUL
new_leader_uuid: "448cf7456ed247c5aed55ba83537dd8c"
 from {username='slave'} at 127.0.0.1:45640
I20260709 12:14:15.062881 26904 raft_consensus.cc:606] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Received request to transfer leadership to TS 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:15.064690 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:15.065402 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:15.071312 27302 raft_consensus.cc:993] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d: : Instructing follower 448cf7456ed247c5aed55ba83537dd8c to start an election
I20260709 12:14:15.072114 27369 raft_consensus.cc:1081] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Signalling peer 448cf7456ed247c5aed55ba83537dd8c to start an election
I20260709 12:14:15.074442 27049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1845b4fc4d784696b1b684d970353400"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
 from {username='slave'} at 127.0.0.1:47278
I20260709 12:14:15.075080 27049 raft_consensus.cc:493] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.075438 27049 raft_consensus.cc:3060] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.088668 27049 raft_consensus.cc:515] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:15.091995 27049 leader_election.cc:290] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:15.092186 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845b4fc4d784696b1b684d970353400" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:15.092972 26904 raft_consensus.cc:3060] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.094844 26975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845b4fc4d784696b1b684d970353400" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:15.095583 26975 raft_consensus.cc:3055] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:15.095942 26975 raft_consensus.cc:740] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:15.096880 26975 consensus_queue.cc:260] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:15.098671 26975 raft_consensus.cc:3060] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.101398 26904 raft_consensus.cc:2468] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 2.
I20260709 12:14:15.102967 27018 leader_election.cc:304] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:15.103999 27351 raft_consensus.cc:2804] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.104562 27351 raft_consensus.cc:697] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:15.105523 27351 consensus_queue.cc:237] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:15.104123 26802 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c: soft_deleted_table [id=a07a7fc69caa48f883b53ad08f665f67] alter complete (version 1)
I20260709 12:14:15.108480 26975 raft_consensus.cc:2468] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 2.
I20260709 12:14:15.123759 26802 catalog_manager.cc:5697] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 1 to 2, leader changed from b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66) to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 2 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.151345 27238 raft_consensus.cc:993] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4: : Instructing follower 448cf7456ed247c5aed55ba83537dd8c to start an election
I20260709 12:14:15.151898 27238 raft_consensus.cc:1081] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Signalling peer 448cf7456ed247c5aed55ba83537dd8c to start an election
I20260709 12:14:15.153667 27049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
 from {username='slave'} at 127.0.0.1:47288
I20260709 12:14:15.154306 27049 raft_consensus.cc:493] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.154690 27049 raft_consensus.cc:3060] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.162909 27049 raft_consensus.cc:515] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:15.165576 27049 leader_election.cc:290] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:15.165848 26904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:15.166218 26975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:15.166819 26904 raft_consensus.cc:3055] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:15.166832 26975 raft_consensus.cc:3060] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.167244 26904 raft_consensus.cc:740] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:15.168093 26904 consensus_queue.cc:260] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:15.169467 26904 raft_consensus.cc:3060] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.175091 26975 raft_consensus.cc:2468] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 2.
I20260709 12:14:15.176970 26904 raft_consensus.cc:2468] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 2.
I20260709 12:14:15.177114 27017 leader_election.cc:304] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:15.178117 27351 raft_consensus.cc:2804] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.178617 27351 raft_consensus.cc:697] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:15.179512 27351 consensus_queue.cc:237] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:15.188630 26802 catalog_manager.cc:5697] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 1 to 2, leader changed from b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65) to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 2 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.546355 26975 raft_consensus.cc:1275] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Refusing update from remote peer 448cf7456ed247c5aed55ba83537dd8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:15.548079 27351 consensus_queue.cc:1048] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:15.561285 26904 raft_consensus.cc:1275] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Refusing update from remote peer 448cf7456ed247c5aed55ba83537dd8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:15.563719 27351 consensus_queue.cc:1048] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:15.714128 26975 raft_consensus.cc:1275] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Refusing update from remote peer 448cf7456ed247c5aed55ba83537dd8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:15.715704 27351 consensus_queue.cc:1048] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:15.728472 26904 raft_consensus.cc:1275] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Refusing update from remote peer 448cf7456ed247c5aed55ba83537dd8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:15.730945 27351 consensus_queue.cc:1048] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.066532 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:16.074122 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:16.077940 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:17.079088 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.084398 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:17.084933 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:18.085976 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:18.091255 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:18.091696 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:18.617292 27017 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.66:43929, user_credentials={real_user=slave}} blocked reactor thread for 121174us
I20260709 12:14:19.330358 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.338860 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:19.339709 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:19.457109 27396 raft_consensus.cc:493] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:19.457993 27396 raft_consensus.cc:515] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:19.460620 27396 leader_election.cc:290] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:19.542841 27399 raft_consensus.cc:493] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
W20260709 12:14:19.543196 26945 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.023s	sys 0.028s
W20260709 12:14:19.544598 26945 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.024s	sys 0.029s
W20260709 12:14:19.545228 26945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.67:46459, user_credentials={real_user=slave}} blocked reactor thread for 924195us
I20260709 12:14:19.543442 27391 raft_consensus.cc:493] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
W20260709 12:14:19.545274 26944 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.191.65:33181, user_credentials={real_user=slave}} blocked reactor thread for 49499.1us
I20260709 12:14:19.546018 27391 raft_consensus.cc:515] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:19.547108 27393 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:19.547643 27393 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:19.548521 27391 leader_election.cc:290] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:19.549734 27393 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:19.550431 27389 raft_consensus.cc:493] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:19.551159 27389 raft_consensus.cc:515] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:19.553653 27389 leader_election.cc:290] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:19.572861 26902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:19.574549 27054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:19.575258 27054 raft_consensus.cc:2468] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 1.
I20260709 12:14:19.543845 27397 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:19.558086 26903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:19.555491 27404 raft_consensus.cc:493] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:19.564610 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:19.566929 27399 raft_consensus.cc:515] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:19.571974 26901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:19.565341 27391 raft_consensus.cc:493] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:19.577633 26901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:19.578344 27399 leader_election.cc:290] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:19.578529 27397 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:19.578347 27391 raft_consensus.cc:515] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } }
I20260709 12:14:19.580807 27049 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 2.
I20260709 12:14:19.582006 27397 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:19.582912 26975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:19.586846 26945 leader_election.cc:304] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:19.589290 27391 leader_election.cc:290] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:19.589258 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc4adc1e8434db884aa527cad0df2fc" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:19.589929 26901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b6cc63573a4f14b3de3e373f6c2aae" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:19.590828 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b6cc63573a4f14b3de3e373f6c2aae" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:19.576327 27404 raft_consensus.cc:515] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:19.591929 26903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:19.592422 26980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:19.593603 26979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:19.591871 27302 raft_consensus.cc:2804] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:19.594981 27404 leader_election.cc:290] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:19.595168 27302 raft_consensus.cc:493] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:19.594815 27017 leader_election.cc:304] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c; no voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:19.595667 27302 raft_consensus.cc:3060] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:19.597497 27017 leader_election.cc:304] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c; no voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:19.597857 27397 raft_consensus.cc:2749] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.598186 26903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680e8e32e933465da9bdac21fc668398" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:19.599996 27397 raft_consensus.cc:2749] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.601544 26945 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b4a981f2bf1c4261806dfea3d38bf18d; no voters: b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:19.602731 27404 raft_consensus.cc:2804] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:19.602845 26903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf282c8f3ce447f395951ff368b594f5" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:19.603214 27404 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:19.603672 27404 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:19.605897 27302 raft_consensus.cc:515] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:19.605919 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680e8e32e933465da9bdac21fc668398" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:19.607371 27018 leader_election.cc:304] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c; no voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:19.608202 27302 leader_election.cc:290] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:19.608230 27391 raft_consensus.cc:2749] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.608645 27018 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c; no voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:19.608867 26903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:19.610944 26945 leader_election.cc:304] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4a981f2bf1c4261806dfea3d38bf18d; no voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:19.609659 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:19.611675 27302 raft_consensus.cc:2749] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.612691 27018 leader_election.cc:304] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c; no voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:19.612895 27391 raft_consensus.cc:2749] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.613040 27404 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:19.613471 27397 raft_consensus.cc:2749] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.613881 26945 leader_election.cc:304] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4a981f2bf1c4261806dfea3d38bf18d; no voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:19.614605 27302 raft_consensus.cc:2749] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.615394 27404 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 3 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:19.615937 26903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:19.616364 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:19.617638 26945 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4a981f2bf1c4261806dfea3d38bf18d; no voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:19.618422 27404 raft_consensus.cc:2749] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:19.823503 16130 debug-util.cc:398] Leaking SignalData structure 0x7b08003f4a60 after lost signal to thread 26945
W20260709 12:14:19.972146 26926 debug-util.cc:398] Leaking SignalData structure 0x7b080024d600 after lost signal to thread 16128
W20260709 12:14:19.973224 26926 debug-util.cc:398] Leaking SignalData structure 0x7b08002aaae0 after lost signal to thread 26837
W20260709 12:14:19.974416 26926 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4ac0 after lost signal to thread 26929
W20260709 12:14:19.975566 26926 debug-util.cc:398] Leaking SignalData structure 0x7b0800266880 after lost signal to thread 27004
W20260709 12:14:19.976737 26926 debug-util.cc:398] Leaking SignalData structure 0x7b08001dfde0 after lost signal to thread 27078
I20260709 12:14:20.069967 26979 raft_consensus.cc:1240] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Rejecting Update request from peer b0598be35f1b49ddb4d91def97f830e4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:20.071560 27340 consensus_queue.cc:1059] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:20.072554 27394 raft_consensus.cc:3055] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:20.072877 27394 raft_consensus.cc:740] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:20.073599 27394 consensus_queue.cc:260] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:20.074697 27394 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.124747 26977 raft_consensus.cc:1240] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Rejecting Update request from peer b0598be35f1b49ddb4d91def97f830e4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:20.125999 27394 consensus_queue.cc:1059] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:20.126889 27340 raft_consensus.cc:3055] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:20.127199 27340 raft_consensus.cc:740] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:20.127951 27340 consensus_queue.cc:260] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:20.129019 27340 raft_consensus.cc:3060] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:20.341053 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:20.350199 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:20.350756 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:21.260365 27391 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:21.260919 27391 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.263051 27391 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:21.263833 26903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:21.264076 26977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:21.264454 26903 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 3.
I20260709 12:14:21.264822 26977 raft_consensus.cc:2393] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 448cf7456ed247c5aed55ba83537dd8c in current term 3: Already voted for candidate b4a981f2bf1c4261806dfea3d38bf18d in this term.
I20260709 12:14:21.265535 27018 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:21.266336 27391 raft_consensus.cc:2804] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:21.266727 27391 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:21.267088 27391 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.274909 27391 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.276508 27391 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:21.277331 26903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:21.277514 26977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:21.278255 26977 raft_consensus.cc:2393] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 448cf7456ed247c5aed55ba83537dd8c in current term 3: Already voted for candidate b4a981f2bf1c4261806dfea3d38bf18d in this term.
I20260709 12:14:21.283701 26903 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 3.
I20260709 12:14:21.284931 27018 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: b4a981f2bf1c4261806dfea3d38bf18d
I20260709 12:14:21.285741 27391 raft_consensus.cc:2804] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:21.286240 27391 raft_consensus.cc:697] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 3 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:21.287075 27391 consensus_queue.cc:237] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.297775 26801 catalog_manager.cc:5697] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 2 to 3, leader changed from b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65) to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 3 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:21.308118 27409 raft_consensus.cc:493] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.308739 27409 raft_consensus.cc:515] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.311512 27409 leader_election.cc:290] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:21.312161 26977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:21.312750 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:21.312922 26977 raft_consensus.cc:2468] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 2.
I20260709 12:14:21.314386 26868 leader_election.cc:304] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:21.314980 27409 raft_consensus.cc:2804] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:21.315338 27409 raft_consensus.cc:493] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.315670 27409 raft_consensus.cc:3060] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.321419 27409 raft_consensus.cc:515] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.323175 27409 leader_election.cc:290] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 3 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:21.323951 26977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:21.324792 26977 raft_consensus.cc:3060] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.324141 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:21.331436 26977 raft_consensus.cc:2468] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 3.
I20260709 12:14:21.332612 26868 leader_election.cc:304] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:21.333287 27409 raft_consensus.cc:2804] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:21.333727 27409 raft_consensus.cc:697] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 3 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:21.334530 27409 consensus_queue.cc:237] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.344023 26801 catalog_manager.cc:5697] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.351889 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:21.359828 27391 raft_consensus.cc:493] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0598be35f1b49ddb4d91def97f830e4)
I20260709 12:14:21.360635 27391 raft_consensus.cc:515] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.363044 27391 leader_election.cc:290] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:21.363970 26903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:21.364181 26977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59863737cc454e3e8daac0e73fccd7f2" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" is_pre_election: true
I20260709 12:14:21.364965 26977 raft_consensus.cc:2368] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 448cf7456ed247c5aed55ba83537dd8c for earlier term 2. Current term is 3.
I20260709 12:14:21.365998 27017 leader_election.cc:400] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 pre-election: Vote denied by peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929) with higher term. Message: Invalid argument: T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 448cf7456ed247c5aed55ba83537dd8c for earlier term 2. Current term is 3.
I20260709 12:14:21.366289 27017 leader_election.cc:403] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:21.366780 27391 raft_consensus.cc:3060] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.372882 27391 raft_consensus.cc:2749] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929) with higher term. Message: Invalid argument: T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 448cf7456ed247c5aed55ba83537dd8c for earlier term 2. Current term is 3.
I20260709 12:14:21.376117 27049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
mode: GRACEFUL
new_leader_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:39264
I20260709 12:14:21.376729 27049 raft_consensus.cc:606] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Received request to transfer leadership to TS b0598be35f1b49ddb4d91def97f830e4
I20260709 12:14:21.377841 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:14:21.378347 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:21.519438 27404 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.520293 27404 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.523028 27404 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:21.524258 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c" is_pre_election: true
I20260709 12:14:21.524183 26901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4" is_pre_election: true
I20260709 12:14:21.525537 26901 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 3.
I20260709 12:14:21.526883 26944 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:21.527649 27404 raft_consensus.cc:2804] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:21.527968 27404 raft_consensus.cc:493] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.528188 27404 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.538036 27404 raft_consensus.cc:515] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.540198 27404 leader_election.cc:290] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 4 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:21.541038 26901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:21.541946 26901 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.542320 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977ac0238b6b424083c0baba746ad0db" candidate_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:21.553313 26901 raft_consensus.cc:2468] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a981f2bf1c4261806dfea3d38bf18d in term 4.
I20260709 12:14:21.554751 26944 leader_election.cc:304] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:21.555384 27404 raft_consensus.cc:2804] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:21.555846 27404 raft_consensus.cc:697] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 4 LEADER]: Becoming Leader. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:21.556923 27404 consensus_queue.cc:237] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.569007 27408 raft_consensus.cc:993] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c: : Instructing follower b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:21.569648 27391 raft_consensus.cc:1081] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Signalling peer b0598be35f1b49ddb4d91def97f830e4 to start an election
I20260709 12:14:21.570482 26801 catalog_manager.cc:5697] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d reported cstate change: term changed from 3 to 4, leader changed from 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67) to b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66). New cstate: current_term: 4 leader_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.571425 26901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3"
dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
 from {username='slave'} at 127.0.0.1:45678
I20260709 12:14:21.572363 26901 raft_consensus.cc:493] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:21.572798 26901 raft_consensus.cc:3060] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.580051 26901 raft_consensus.cc:515] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.582834 26901 leader_election.cc:290] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 3 election: Requested vote from peers b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929), 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67:46459)
I20260709 12:14:21.583509 27049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
I20260709 12:14:21.583613 26977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8b2e063d634816b7621bbabd3048f3" candidate_uuid: "b0598be35f1b49ddb4d91def97f830e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:21.584244 27049 raft_consensus.cc:3055] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:21.584499 26977 raft_consensus.cc:3060] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.584657 27049 raft_consensus.cc:740] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:21.585836 27049 consensus_queue.cc:260] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.587304 27049 raft_consensus.cc:3060] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.593123 26977 raft_consensus.cc:2468] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 3.
I20260709 12:14:21.594753 26868 leader_election.cc:304] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0598be35f1b49ddb4d91def97f830e4, b4a981f2bf1c4261806dfea3d38bf18d; no voters: 
I20260709 12:14:21.595624 27409 raft_consensus.cc:2804] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:21.595966 27049 raft_consensus.cc:2468] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0598be35f1b49ddb4d91def97f830e4 in term 3.
I20260709 12:14:21.596189 27409 raft_consensus.cc:697] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 3 LEADER]: Becoming Leader. State: Replica: b0598be35f1b49ddb4d91def97f830e4, State: Running, Role: LEADER
I20260709 12:14:21.597787 27409 consensus_queue.cc:237] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.607230 26801 catalog_manager.cc:5697] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 reported cstate change: term changed from 2 to 3, leader changed from 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67) to b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65). New cstate: current_term: 3 leader_uuid: "b0598be35f1b49ddb4d91def97f830e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.747824 27054 raft_consensus.cc:1275] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:21.748991 27409 consensus_queue.cc:1048] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:21.763437 26977 raft_consensus.cc:1275] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:21.765784 27340 consensus_queue.cc:1048] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:21.777750 26903 raft_consensus.cc:1240] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 4 FOLLOWER]: Rejecting Update request from peer 448cf7456ed247c5aed55ba83537dd8c for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:21.779261 27391 consensus_queue.cc:1059] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:21.780150 27408 raft_consensus.cc:3055] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:21.780553 27408 raft_consensus.cc:740] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:21.781581 27408 consensus_queue.cc:260] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:21.782675 27408 raft_consensus.cc:3060] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.994918 26903 raft_consensus.cc:1275] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 4 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:21.996266 27404 consensus_queue.cc:1048] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:21.999601 27054 raft_consensus.cc:1275] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:22.000918 27340 consensus_queue.cc:1048] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:22.011579 27049 raft_consensus.cc:1275] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 4 FOLLOWER]: Refusing update from remote peer b4a981f2bf1c4261806dfea3d38bf18d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:14:22.012041 27049 pending_rounds.cc:85] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c: Aborting all ops after (but not including) 2
I20260709 12:14:22.012264 27049 pending_rounds.cc:107] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:22.012517 27049 raft_consensus.cc:2889] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:22.014595 27429 consensus_queue.cc:1048] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:22.022768 26977 raft_consensus.cc:1275] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Refusing update from remote peer b0598be35f1b49ddb4d91def97f830e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:22.025825 27340 consensus_queue.cc:1048] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:22.379503 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:22.389526 26979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d"
dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
mode: GRACEFUL
new_leader_uuid: "448cf7456ed247c5aed55ba83537dd8c"
 from {username='slave'} at 127.0.0.1:47554
I20260709 12:14:22.390092 26979 raft_consensus.cc:606] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Received request to transfer leadership to TS 448cf7456ed247c5aed55ba83537dd8c
I20260709 12:14:22.391603 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:14:22.392241 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:22.683564 27428 raft_consensus.cc:993] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d: : Instructing follower 448cf7456ed247c5aed55ba83537dd8c to start an election
I20260709 12:14:22.684007 27404 raft_consensus.cc:1081] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Signalling peer 448cf7456ed247c5aed55ba83537dd8c to start an election
I20260709 12:14:22.685645 27049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d"
dest_uuid: "448cf7456ed247c5aed55ba83537dd8c"
 from {username='slave'} at 127.0.0.1:47278
I20260709 12:14:22.686154 27049 raft_consensus.cc:493] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:22.686461 27049 raft_consensus.cc:3060] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.691851 27049 raft_consensus.cc:515] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:22.693425 27049 leader_election.cc:290] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 election: Requested vote from peers b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181), b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929)
I20260709 12:14:22.694268 26901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0598be35f1b49ddb4d91def97f830e4"
I20260709 12:14:22.694593 26977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9316b550e4b12b2bacad9d23f7c6d" candidate_uuid: "448cf7456ed247c5aed55ba83537dd8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4a981f2bf1c4261806dfea3d38bf18d"
I20260709 12:14:22.694969 26901 raft_consensus.cc:3060] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.695286 26977 raft_consensus.cc:3055] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:22.695688 26977 raft_consensus.cc:740] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4a981f2bf1c4261806dfea3d38bf18d, State: Running, Role: LEADER
I20260709 12:14:22.696655 26977 consensus_queue.cc:260] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:22.698230 26977 raft_consensus.cc:3060] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.701380 26901 raft_consensus.cc:2468] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 2.
I20260709 12:14:22.702840 27018 leader_election.cc:304] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 448cf7456ed247c5aed55ba83537dd8c, b0598be35f1b49ddb4d91def97f830e4; no voters: 
I20260709 12:14:22.703518 27408 raft_consensus.cc:2804] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:22.704511 27408 raft_consensus.cc:697] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Becoming Leader. State: Replica: 448cf7456ed247c5aed55ba83537dd8c, State: Running, Role: LEADER
I20260709 12:14:22.705643 27408 consensus_queue.cc:237] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } }
I20260709 12:14:22.705830 26977 raft_consensus.cc:2468] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 448cf7456ed247c5aed55ba83537dd8c in term 2.
I20260709 12:14:22.713272 26802 catalog_manager.cc:5697] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c reported cstate change: term changed from 1 to 2, leader changed from b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66) to 448cf7456ed247c5aed55ba83537dd8c (127.15.191.67). New cstate: current_term: 2 leader_uuid: "448cf7456ed247c5aed55ba83537dd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "448cf7456ed247c5aed55ba83537dd8c" member_type: VOTER last_known_addr { host: "127.15.191.67" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.138046 26977 raft_consensus.cc:1275] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Refusing update from remote peer 448cf7456ed247c5aed55ba83537dd8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:23.139411 27408 consensus_queue.cc:1048] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a981f2bf1c4261806dfea3d38bf18d" member_type: VOTER last_known_addr { host: "127.15.191.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:23.152599 26901 raft_consensus.cc:1275] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Refusing update from remote peer 448cf7456ed247c5aed55ba83537dd8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:23.154420 27434 consensus_queue.cc:1048] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0598be35f1b49ddb4d91def97f830e4" member_type: VOTER last_known_addr { host: "127.15.191.65" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:23.393527 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:23.399931 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:23.400373 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:24.401327 16125 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:24.406773 16125 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:24.407230 16125 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:25.468617 16125 tablet_server.cc:179] TabletServer@127.15.191.65:0 shutting down...
I20260709 12:14:25.501896 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:25.502785 16125 tablet_replica.cc:333] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.503943 16125 raft_consensus.cc:2243] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.504518 16125 raft_consensus.cc:2272] T 1ffa5a12575b4bed9b5526b84cc43a49 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.507184 16125 tablet_replica.cc:333] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.508147 16125 raft_consensus.cc:2243] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.508742 16125 raft_consensus.cc:2272] T f03242e247e9400ca840f18849f6c582 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.511251 16125 tablet_replica.cc:333] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.511952 16125 raft_consensus.cc:2243] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.512535 16125 raft_consensus.cc:2272] T 56db4d61dc344508bae3ee8757a73e5d P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.515170 16125 tablet_replica.cc:333] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.515808 16125 raft_consensus.cc:2243] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.516772 16125 raft_consensus.cc:2272] T abc4adc1e8434db884aa527cad0df2fc P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.519374 16125 tablet_replica.cc:333] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.520037 16125 raft_consensus.cc:2243] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.520645 16125 raft_consensus.cc:2272] T 3dcea95364ac40d88dadf83f17155d3c P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.522363 26944 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 12:14:25.523370 16125 tablet_replica.cc:333] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.524200 16125 raft_consensus.cc:2243] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.525221 16125 raft_consensus.cc:2272] T 7da255b50f1742859f03978bf73390fe P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.525408 26944 consensus_peers.cc:597] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d -> Peer b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181): Couldn't send request to peer b0598be35f1b49ddb4d91def97f830e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.527973 16125 tablet_replica.cc:333] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.528681 16125 raft_consensus.cc:2243] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.529122 16125 raft_consensus.cc:2272] T 4aa9316b550e4b12b2bacad9d23f7c6d P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.531463 16125 tablet_replica.cc:333] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.532416 16125 raft_consensus.cc:2243] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.533082 16125 raft_consensus.cc:2272] T 1845b4fc4d784696b1b684d970353400 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.535997 16125 tablet_replica.cc:333] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.536573 16125 raft_consensus.cc:2243] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.537070 16125 raft_consensus.cc:2272] T d0dff9e1109044e59636887dd30f38c8 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.539590 16125 tablet_replica.cc:333] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.540222 16125 raft_consensus.cc:2243] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.541209 16125 raft_consensus.cc:2272] T 680e8e32e933465da9bdac21fc668398 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.543768 16125 tablet_replica.cc:333] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.544360 16125 raft_consensus.cc:2243] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.544863 16125 raft_consensus.cc:2272] T 181ab3081f98411a85577185b650ae8f P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.547451 16125 tablet_replica.cc:333] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.547977 16125 raft_consensus.cc:2243] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.548453 16125 raft_consensus.cc:2272] T 138c38a5d50645e599e1362b7aa54098 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.550918 16125 tablet_replica.cc:333] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.551457 16125 raft_consensus.cc:2243] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.551959 16125 raft_consensus.cc:2272] T 211df838dab449f389ad249309668ba1 P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.554370 16125 tablet_replica.cc:333] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.554960 16125 raft_consensus.cc:2243] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.555828 16125 raft_consensus.cc:2272] T 59863737cc454e3e8daac0e73fccd7f2 P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.558233 16125 tablet_replica.cc:333] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.558902 16125 raft_consensus.cc:2243] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.559823 16125 raft_consensus.cc:2272] T 04b6cc63573a4f14b3de3e373f6c2aae P b0598be35f1b49ddb4d91def97f830e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.562405 16125 tablet_replica.cc:333] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.562971 16125 raft_consensus.cc:2243] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.563905 16125 raft_consensus.cc:2272] T cf282c8f3ce447f395951ff368b594f5 P b0598be35f1b49ddb4d91def97f830e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.566450 16125 tablet_replica.cc:333] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.566992 16125 raft_consensus.cc:2243] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.567801 16125 raft_consensus.cc:2272] T 6a8b2e063d634816b7621bbabd3048f3 P b0598be35f1b49ddb4d91def97f830e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.570302 16125 tablet_replica.cc:333] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4: stopping tablet replica
I20260709 12:14:25.570875 16125 raft_consensus.cc:2243] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.571316 16125 raft_consensus.cc:2272] T 977ac0238b6b424083c0baba746ad0db P b0598be35f1b49ddb4d91def97f830e4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.618989 27018 consensus_peers.cc:597] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c -> Peer b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181): Couldn't send request to peer b0598be35f1b49ddb4d91def97f830e4. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.645202 16125 tablet_server.cc:196] TabletServer@127.15.191.65:0 shutdown complete.
I20260709 12:14:25.688290 16125 tablet_server.cc:179] TabletServer@127.15.191.66:0 shutting down...
W20260709 12:14:25.705478 27018 consensus_peers.cc:597] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c -> Peer b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181): Couldn't send request to peer b0598be35f1b49ddb4d91def97f830e4. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.726253 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:25.727069 16125 tablet_replica.cc:333] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.727790 16125 raft_consensus.cc:2243] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.728734 16125 raft_consensus.cc:2272] T 1ffa5a12575b4bed9b5526b84cc43a49 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.731084 16125 tablet_replica.cc:333] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.731701 16125 raft_consensus.cc:2243] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.732579 16125 raft_consensus.cc:2272] T 56db4d61dc344508bae3ee8757a73e5d P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.735080 16125 tablet_replica.cc:333] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.735674 16125 raft_consensus.cc:2243] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.736536 16125 raft_consensus.cc:2272] T f03242e247e9400ca840f18849f6c582 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.739024 16125 tablet_replica.cc:333] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.739601 16125 raft_consensus.cc:2243] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.740221 16125 raft_consensus.cc:2272] T abc4adc1e8434db884aa527cad0df2fc P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.742703 16125 tablet_replica.cc:333] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.743325 16125 raft_consensus.cc:2243] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.743803 16125 raft_consensus.cc:2272] T 3dcea95364ac40d88dadf83f17155d3c P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.745990 16125 tablet_replica.cc:333] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.746697 16125 raft_consensus.cc:2243] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.747382 16125 raft_consensus.cc:2272] T 7da255b50f1742859f03978bf73390fe P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.750463 16125 tablet_replica.cc:333] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.751109 16125 raft_consensus.cc:2243] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.751626 16125 raft_consensus.cc:2272] T 6a8b2e063d634816b7621bbabd3048f3 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.751637 27018 consensus_peers.cc:597] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c -> Peer b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181): Couldn't send request to peer b0598be35f1b49ddb4d91def97f830e4. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.754703 16125 tablet_replica.cc:333] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.755563 16125 raft_consensus.cc:2243] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.756604 16125 raft_consensus.cc:2272] T 977ac0238b6b424083c0baba746ad0db P b4a981f2bf1c4261806dfea3d38bf18d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.759568 16125 tablet_replica.cc:333] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.760152 16125 raft_consensus.cc:2243] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.760646 16125 raft_consensus.cc:2272] T d0dff9e1109044e59636887dd30f38c8 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.763029 16125 tablet_replica.cc:333] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.763586 16125 raft_consensus.cc:2243] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.764045 16125 raft_consensus.cc:2272] T cf282c8f3ce447f395951ff368b594f5 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.766402 16125 tablet_replica.cc:333] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.766994 16125 raft_consensus.cc:2243] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.767928 16125 raft_consensus.cc:2272] T 211df838dab449f389ad249309668ba1 P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.770536 16125 tablet_replica.cc:333] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.771176 16125 raft_consensus.cc:2243] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.771649 16125 raft_consensus.cc:2272] T 04b6cc63573a4f14b3de3e373f6c2aae P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.773860 16125 tablet_replica.cc:333] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.774451 16125 raft_consensus.cc:2243] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.774874 16125 raft_consensus.cc:2272] T 59863737cc454e3e8daac0e73fccd7f2 P b4a981f2bf1c4261806dfea3d38bf18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.777038 16125 tablet_replica.cc:333] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.777568 16125 raft_consensus.cc:2243] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.777962 16125 raft_consensus.cc:2272] T 4aa9316b550e4b12b2bacad9d23f7c6d P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.780102 16125 tablet_replica.cc:333] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.780645 16125 raft_consensus.cc:2243] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.781077 16125 raft_consensus.cc:2272] T 1845b4fc4d784696b1b684d970353400 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.783520 16125 tablet_replica.cc:333] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.784080 16125 raft_consensus.cc:2243] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.784658 16125 raft_consensus.cc:2272] T 680e8e32e933465da9bdac21fc668398 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.786978 16125 tablet_replica.cc:333] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.787488 16125 raft_consensus.cc:2243] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.788425 16125 raft_consensus.cc:2272] T 181ab3081f98411a85577185b650ae8f P b4a981f2bf1c4261806dfea3d38bf18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.790838 16125 tablet_replica.cc:333] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d: stopping tablet replica
I20260709 12:14:25.791353 16125 raft_consensus.cc:2243] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.792259 16125 raft_consensus.cc:2272] T 138c38a5d50645e599e1362b7aa54098 P b4a981f2bf1c4261806dfea3d38bf18d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.807663 27017 consensus_peers.cc:597] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c -> Peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929): Couldn't send request to peer b4a981f2bf1c4261806dfea3d38bf18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.836395 16125 tablet_server.cc:196] TabletServer@127.15.191.66:0 shutdown complete.
I20260709 12:14:25.874848 16125 tablet_server.cc:179] TabletServer@127.15.191.67:0 shutting down...
W20260709 12:14:25.885226 27018 consensus_peers.cc:597] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c -> Peer b0598be35f1b49ddb4d91def97f830e4 (127.15.191.65:33181): Couldn't send request to peer b0598be35f1b49ddb4d91def97f830e4. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.65:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:25.904805 27017 consensus_peers.cc:597] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c -> Peer b4a981f2bf1c4261806dfea3d38bf18d (127.15.191.66:43929): Couldn't send request to peer b4a981f2bf1c4261806dfea3d38bf18d. Status: Network error: Client connection negotiation failed: client connection to 127.15.191.66:43929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.906425 16125 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:25.907194 16125 tablet_replica.cc:333] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.907892 16125 raft_consensus.cc:2243] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.908444 16125 raft_consensus.cc:2272] T 56db4d61dc344508bae3ee8757a73e5d P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.910858 16125 tablet_replica.cc:333] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.911512 16125 raft_consensus.cc:2243] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.912000 16125 raft_consensus.cc:2272] T 1ffa5a12575b4bed9b5526b84cc43a49 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.914311 16125 tablet_replica.cc:333] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.914852 16125 raft_consensus.cc:2243] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.915367 16125 raft_consensus.cc:2272] T f03242e247e9400ca840f18849f6c582 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.917528 16125 tablet_replica.cc:333] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.918227 16125 raft_consensus.cc:2243] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.919183 16125 raft_consensus.cc:2272] T 3dcea95364ac40d88dadf83f17155d3c P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.921351 16125 tablet_replica.cc:333] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.921926 16125 raft_consensus.cc:2243] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.922439 16125 raft_consensus.cc:2272] T 7da255b50f1742859f03978bf73390fe P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.924681 16125 tablet_replica.cc:333] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.925257 16125 raft_consensus.cc:2243] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.925657 16125 raft_consensus.cc:2272] T 6a8b2e063d634816b7621bbabd3048f3 P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.927666 16125 tablet_replica.cc:333] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.928234 16125 raft_consensus.cc:2243] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.928656 16125 raft_consensus.cc:2272] T 977ac0238b6b424083c0baba746ad0db P 448cf7456ed247c5aed55ba83537dd8c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.930749 16125 tablet_replica.cc:333] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.931313 16125 raft_consensus.cc:2243] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.932159 16125 raft_consensus.cc:2272] T d0dff9e1109044e59636887dd30f38c8 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.934365 16125 tablet_replica.cc:333] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.934976 16125 raft_consensus.cc:2243] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.935793 16125 raft_consensus.cc:2272] T 4aa9316b550e4b12b2bacad9d23f7c6d P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.937999 16125 tablet_replica.cc:333] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.938597 16125 raft_consensus.cc:2243] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:25.939500 16125 raft_consensus.cc:2272] T 1845b4fc4d784696b1b684d970353400 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.941802 16125 tablet_replica.cc:333] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.942407 16125 raft_consensus.cc:2243] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.942858 16125 raft_consensus.cc:2272] T cf282c8f3ce447f395951ff368b594f5 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.945101 16125 tablet_replica.cc:333] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.945653 16125 raft_consensus.cc:2243] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.946182 16125 raft_consensus.cc:2272] T 211df838dab449f389ad249309668ba1 P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.948297 16125 tablet_replica.cc:333] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.948843 16125 raft_consensus.cc:2243] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.949317 16125 raft_consensus.cc:2272] T 59863737cc454e3e8daac0e73fccd7f2 P 448cf7456ed247c5aed55ba83537dd8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.951637 16125 tablet_replica.cc:333] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.952358 16125 raft_consensus.cc:2243] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.952854 16125 raft_consensus.cc:2272] T 04b6cc63573a4f14b3de3e373f6c2aae P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.955030 16125 tablet_replica.cc:333] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.955598 16125 raft_consensus.cc:2243] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.956090 16125 raft_consensus.cc:2272] T abc4adc1e8434db884aa527cad0df2fc P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.958361 16125 tablet_replica.cc:333] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.958884 16125 raft_consensus.cc:2243] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.959611 16125 raft_consensus.cc:2272] T 138c38a5d50645e599e1362b7aa54098 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.961771 16125 tablet_replica.cc:333] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.962318 16125 raft_consensus.cc:2243] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.962857 16125 raft_consensus.cc:2272] T 680e8e32e933465da9bdac21fc668398 P 448cf7456ed247c5aed55ba83537dd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:25.964998 16125 tablet_replica.cc:333] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c: stopping tablet replica
I20260709 12:14:25.965505 16125 raft_consensus.cc:2243] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.965983 16125 raft_consensus.cc:2272] T 181ab3081f98411a85577185b650ae8f P 448cf7456ed247c5aed55ba83537dd8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:26.007704 16125 tablet_server.cc:196] TabletServer@127.15.191.67:0 shutdown complete.
I20260709 12:14:26.044703 16125 master.cc:562] Master@127.15.191.126:39417 shutting down...
I20260709 12:14:26.067288 16125 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:26.067871 16125 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:26.068192 16125 tablet_replica.cc:333] T 00000000000000000000000000000000 P 92c37802078341d991dd41b280b1d92c: stopping tablet replica
I20260709 12:14:26.089058 16125 master.cc:584] Master@127.15.191.126:39417 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21075 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (42021 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (373593 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:14:26.145259 16125 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2180 messages since previous log ~32 seconds ago
I20260709 12:14:26.145470 16125 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2180 messages since previous log ~32 seconds ago
I20260709 12:14:26.145606 16125 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2179 messages since previous log ~32 seconds ago
I20260709 12:14:26.145763 16125 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:14:26.145906 16125 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:14:26.146077 16125 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~161 seconds ago
I20260709 12:14:26.146238 16125 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~198 seconds ago
I20260709 12:14:26.146379 16125 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~199 seconds ago
I20260709 12:14:26.146567 16125 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 12:14:26.146831 16125 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
